Yes. In the first instance, you'll need to complain to the provider itself - hopefully it will be able to rectify the issue to your satisfaction. If not, and you're a small business or sole trader, you should be able to escalate your complaint to the Financial Ombudsman, just as you would with any complaint about your personal banking.
Use this list on the Financial Ombudsman's site to check it can deal with your business banking complaint.
If the Ombudsman can't help you as you don't fall under its remit, then the Business Banking Resolution Service may be able to step in, though generally this will only apply to larger SMEs.