Pryce took an interest in cars while driving a baker's van at the age of 10, before informing his parents that he wanted to be a racing driver.
Prycev starejši brat David je umrl v starosti treh let, tako da je Pryce večino mladosti odraščal kot edinec, čeprav je družina nekaj časa skrbela za mlado deklico Sandro.