Legally speaking, there is nothing wrong with having a separate bank account. You aren't required to keep joint accounts or file joint tax returns. You aren't even required to legally tell your spouse about your secret account, that is, until divorce proceedings start.