Only check safe modifier when necessary