The Civil-Rights Act of 1964 enacted into law the principle of a colorblind society.
Affirmative action goes against that principle.
Abolishing affirmative action would cause a massive and immediate drop in the black presence at universities, in the military, and in the civil service. Even those institutions that don't discriminate would be forced to select and promote people on the basis of test scores, in which there are still enormous racial gaps in performance. Unless you think that minorities and whites have equal opportunity, you can't end affirmative action. Mend It, Don't End It. Jettison set-aside program, which reserve a fixed percentage of government business for women and minorities, but preserve affirmative action in university admissions and support the general principle of encouraging positive efforts at minority recruitment and training.