Bangladesh Awami League
Rahman served as a Minister of Local Government, Rural Development and Co-operatives and the deputy leader of parliament in the Awami League government between 1996 and 2001. He was re-elected General Secretary of Bangladesh Awami League in 1997. He was re-elected to Parliament in 2001. His wife, Ivy Rahman, was killed the 2004 Dhaka grenade attack. She was a leader of Bangladesh Awami League and its women's front the Mohila League. He served as the temporary President of Bangladesh Awami League during the 2006–08 Bangladeshi political crisis when President of Bangladesh Awami League, Sheikh Hasina, was imprisoned by the military backed caretaker government. He was re-elected to Parliament in 2008.