A block account or not being friends will make your Messenger app's “Remove for everyone” option inaccessible. The other person must unblock or add you as a friend to regain this option.