Fix another input map modification bug