Yes, the Altars of Lilith are shared between all your characters. The benefits they provide are account-wide, so they apply to all your characters, irrespective of their class or level. So, you only need to discover an Altar once to reap its benefits on all your characters.