Yes, watching a series without subtitles will most likely be hard at the beginning. You'll feel like you don't understand almost anything. Yes, you might even want to give up, thinking “I'm not at the right level yet.” But don't do it!