Yes. Most banks will take deposits in the form of cash, checks, money orders, or cashier's checks. If you're using a check to open an account, there may be a holding period while the new bank waits for the check to clear.