Begin with the U.S. Post Office’s online Change of Address Form. It’s also important to notify your banks, insurance providers, credit card companies, and magazine subscriptions of your new address.