“Before the Civil War, the Negro was certainly as efficient a workman as the raw immigrant from Ireland or Germany. But, whereas the Irishmen found economic opportunity wide and daily growing wider, the Negro found public opinion determined to 'keep him in his place.'”