In his childhood he had a serious illness and, though his recovery was complete, he was not sent to school. Mr J Griffith, of Jesus College, himself a well-known Oxford mathematician with a strong interest in elliptic functions, noticed Rogers' marked mathematical ability, and taught him during his boyhood.
Sa kanyang pagkabata siya nagkaroon ng malubhang sakit at, kahit na ang kanyang paggaling ay kumpleto na, siya ay hindi na ipinadala sa paaralan. Mr J Griffith, College of Jesus, kanyang sarili na isang kilalang-kilalang Oxford dalubbilang na may isang malakas na interes sa tambilugin function, napansin Rogers' minarkahan matematiko kakayahan, at itinuro sa kanya sa panahon ng kanyang kabataan.