Switching accounts can temporarily lower your credit score and could have more of an impact if you switch frequently. This is because your credit score is supported by having a stable banking history. If you're applying for a mortgage, you may want to avoid switching accounts until after your application has been processed, to avoid any impact on your credit score.