Move potential color into _get_piece_color