Blacks have often been denied the right to vote