“One of the things that will decline over time is the demand that the society or the government bring forth a particularized racial remedy based on a history of deprivation. That will be even more difficult to do in the future.”