Fix #12863. Prevent oldIE from calling `.removeAttribute`