Yes. You are not required to be a UK resident or citizen to set up a limited company in the UK.
The same is true for business bank accounts. Unlike in other countries, opening a bank account for non-residents in the UK is legal. Of course, you must meet the criteria of the bank you're applying to.