Clean up validation of atomic modifiers on attributes