Where does Downham Market end?

Another interesting story on the radio this week on the way to work was about Downham Market, and some discussions over where the town ended. There are plans to start to create neighbourhood plans for the town, but to do that means determining where the neighbourhoods are.

This could equally go for any town. When does the urban area end, and where does the influence of the town end?