Toga was from the Saulaka village near Nadi. Originally a rugby union player, he was part of the Fiji team that won the rugby tournament at the 1963 South Pacific Games, playing three matches and scoring three tries. His brother Sela later also represented Fiji, making his debut the following year.