Yes, you can switch mortgage brokers. However, you may want to think twice about changing brokers during the application process unless you feel that a mortgage broker is not working in your best interests.