Never Out of His Sight: Learning to Discern the Voices