The Milisits family escaped the Hungarian Revolution in 1956 and migrated to Adelaide, South Australia. Their first home was a modest place in Carrington Street in the city. Vili left school aged 14 to work at Kazzy's Cake Shop in Burnside, run by fellow countryman Kazzy Ujvari. After completing his apprenticeship he ventured to open his own Continental cake shop using rented equipment and employing his fiancée, Rosemary and his sister, as he was unable to secure a bank loan. (His sister later opened her own "patisserie", "Olga's Cakes", in Leigh Street, Adelaide). Around 1965 he purchased a home at 14 Manchester Street, Mile End, which doubled as a bakery.