Finally managed to get the ambient audio to play if it's parent is in the viewport.