After Hemchandra Chowdhury's death, his successors crossed the country in fear of communal riots during the partition of India and Pakistan in 1946. Shyamkanta Ganguly and his son Kamal Ganguly went to Hemnagar, but during the war of 1965, they also emigrated. During the Bangladesh War of Liberation, the Rajbari of Hemanagar was used as a shelter for the freedom fighters.