If you're not interested in the Boba Fett spinoff, the good news is that you can jump right into Episode 5 and be completely fine. Mando literally takes over the whole show. Episode 6 is equally as The Mandalorian-centric and continues the story from the previous episode, so you'll also be fine there.