The Fifteenth Amendment specifically stated that the right to vote should not be abridged on account of color.
The trick was to frame a set of qualifications that would technically apply to everybody but actually eliminate the Negro without touching the white.