Thankfully, the new skills that you will ha ve learnt while moving on will help make earlier stages that once seemed difficult, much easier.
If a particular sub-game, of which there are many, is proving too awkward, you can try something different and go back later.