“I never ceased to be surprised when southern whites, at their homes or clubs, told racial jokes and spoke so derogatorily of blacks while longtime servants, for whom they quite clearly had some affection, were well within earshot.”