Lyttelton, New Zealand
Joyce was born in Lyttelton, New Zealand in 1904 and spent part of his childhood in Loburn, where he attended Rangiora High School. He trained for the priesthood at Holy Cross College, Mosgiel.