No, bankers can work in various financial institutions such as commercial banks, investment banks, credit unions, and private wealth management firms. They can also work in areas like corporate finance, financial consulting, and government institutions.