The iconic weapon in Granny Horror Multiplayer is the baseball bat, known for its simplicity and effectiveness in fending off threats.