“One point leavers and remainers agree on is that if there had never been a referendum, and this deal had been proposed as the basis for our country's future, it would have rightly been rejected by parliament and the public.”