No, you don't need to thaw the blueberries first. In fact, if you're using frozen blueberries, it's better not to thaw them, as they tend to release their juices and make your batter purple!