Masjid India was built in 1983. It was initially erected as a wooden structure. Members of the Indian Muslims mercantile community living in the premises along Jalan Tuanku Abdul Rahman (then Batu Road), Jalan Tun Perak (the Java Street) and adjacent areas were the main sponsors and financiers of the construction of this Masjid. The original wooden structure was demolished in 1963 and replaced by the present three storey building.