“If you read the memoirs of slave-owning families, you'd be hard pressed to find evidence of black people in the lives of the whites, even though for most of the time on the plantations black people outnumbered whites by a ratio of seven to one.”