“Why can't we, with a more intelligent policy, actually have houses that are affordable, built at higher densities than they are at the moment and built on brownfield sites.”