“When population shifts - brought about by fair housing laws, affirmative action and landmark school desegregation rulings - political power is challenged as well.”