Australian refugee activists plan protest during minister's speech