But Tim Farron, the MP for Westmorland and Lonsdale in Cumbria, says some second home owners visit “just a couple of times a year”.
“They’re definitely not sending their children to local schools either,” he adds.
The Liberal Democrat’s constituency includes part of the Lake District National Park where one in four properties is a holiday home.
Farron wants to go even further than applying restrictions to new-builds and is advocating a change in planning law.
“If I wanted to change my house into a fish and chip shop, I’d have to apply for planning permission,” he says.
“But if I want to turn it into a second home or a holiday let, I can just do that. But it has a material impact on the community I live in.”
He wants separate categories of planning use for holiday lets and second homes, which would allow local authorities to limit their numbers.
“That way we can ensure rural communities don’t die.”