In 1942, during the Japanese occupation of Malaya, the Japanese Imperial Army led by General Yamashita Tomoyuki stationed themselves at the building and Istana Bukit Serene to plan for the invasion of Singapore. The Japanese used the building as a fortress and a command centre to spy on the British activities in Singapore. The building was partly damaged during the Japanese invasion and the damaged parts are still visible today.