Not at all. Creating an immersion environment is ideal for learners of all levels. It's especially helpful for beginners to develop familiarity with the language's sounds and patterns. And it's okay to not understand 100% of what you're hearing!