Don't ignore attribute namespaces

Hopefully, we shouldn't. I can add a check here in case we hit that situation.