Strip new AnnotationRef elements on downgrade