At the beginning of the Reign of Terror, Varlet was again arrested. He was released on 29 October 1793, but after the fall of Robespierre he was arrested yet again and spent almost a year in prison. After his release, Varlet settled at Pailly, Yonne, marrying and having three children. He became a Bonapartist after 1800 and lived some time in Nantes. He returned to Paris for several months in 1830 to participate in the July Revolution. In 1836 he left Nantes to live at Corbeil-Essonnes, where he drowned on 4 October 1837.