Ken Wyatt's supporters say he could be next Indigenous affairs minister