It can take the IRS four to six weeks to update your address, so it's best to get your new address submitted as soon as possible.