He was one of five children born to François-Marie Devéria, a Bureau Chief in the Ministry of the Navy. His mother, Désirée François-Chaumont, came from a colonial family in Saint-Domingue that fled to France during the Revolution. His brother, Achille, was also a painter. After their father's death, Achille became the family's provider.