“Sometimes it leads me even to hesitate whether I am strictly correct in my idea that all men are born to equal rights, for their conduct seems to me to contravene the doctrine.”