Sawbridgeworth is a popular commuter town near the Essex border, which made headlines in 1999 when David and Victoria Beckham bought their mansion, dubbed Beckingham Palace.
The town sits on the River Stort, which runs past the field in question, just off Sheering Mill Lane.
Residents said the area was rich in wildlife.
“There are lots of birds, lots of reptiles, you’ve got crested newts, apparently badgers, muntjac deer – but it’s all gone,” said Liz Coxhall.
Neil Leighton, 56, runs a handyman business and has lived locally for more than 30 years.
“We walk round here a lot: It’s a really nice area, it’s very green, you can see the canal,” he explained.
Sawbridgeworth’s mayor, Angus Parsad-Wyatt, told the BBC: “It is important to say this is a flood plain, a nature reserve, a wildlife area and, so, this is not just about travellers moving into a site and a random piece of field.
“This is a part of the town that everyone really cares about.”