“The end of free movement means that we will be able to consider the impact on the existing labour market when determining whether we want unskilled workers from the E.U. to be able to come to the U.K.”