Yes, obviously you can transfer money with only an account number but to ensure the current account holder, you have to provide other details such as routing number, social security number, and ID.