Absolutely! If you have a mutual contact or were referred to the position by someone within the bank or your professional network, it can be a valuable addition. Mention the referral early in your cover letter to establish a connection and show that you have inside knowledge of the organization.