“If you look at Griswold, what you can see is the first time the Court recognized the right to privacy, which ends up becoming ultimately the right to abortion.”