As per the Player's Handbook, holy symbols are intended to be used as a spellcasting focus. They can be either held in your hand, adorned atop a shield, or worn visibly on your clothes.