Remove smilref attributes before adding them