To set up a memorial fund at a bank, you need to visit the bank with the tax identification number as well as the contact information of the recipient party. Also, you will be required to go along with the death certificate of the deceased, then speak with a new account representative to set up the new account.