“What is so remarkable about the success of affirmative action is that it has been accomplished despite the Justice Department and the policies of the federal government.”