His first marriage was with Stella Crowther (Wimbledon, London, England, July 24, 1913 – † Henfield, West Sussex, England, December 27, 1990); on June 2, 1936, which happened in the Sigismund Chapel in Buda, Budapest. The swearing-in ceremony was performed by Lajos Shvoy, Bishop of Székesfehérvár. In afternoon, after the wedding, the wedding crowd had lunch at the Park Club, then the young couple traveled to the village. Their son, Count Péter Széchenyi, was born in London on February 4, 1939, and three of them lived in Hungary. Stella Crowther and his son Péter Széchenyi moved back to their homeland at the beginning of the war. During the siege of Budapest, together with the values of their villa in the name of his wife, their home was burned to the ground, Zsigmond Széchenyi lived in his father's house in Budavár until his deportation. On March 13, 1945, he was taken by the Soviet authorities, held in a camp in Tisza Kálmán - Republic Square, and then in Csömör until April 19, 1945.