If you decide to defer, agree on a time when you will take the issue off the table and revisit the problem. It may be necessary for one or both of you to give in. This does not need to be a negative outcome. Without compromise, relationships cannot work. You adjust your schedule in order to pick up the kids from soccer practice, and your spouse stops by the grocery store because you don't have time.
Compromise can be good, and it happens all the time.
If, however, you sense that you are the one doing all the accommodating, that this is the pattern which has emerged over the years, then perhaps you are in an unhealthy relationship with a dominant, controlling personality and should seek counseling. Perhaps you are able to decide that this is a problem you can live with. Be certain you are not simply in a state of denial, and that the issue is so inconsequential that accepting it is, after all, no big deal. You refuse to make an issue of it any more, and you're okay with it. If you cannot defer, or compromise, or co-exist with the problem, seek counseling.