But then you start to put words to it, to snarl the plot and mess with your characters and develop your themes, and that's where the real effort comes in.
The more you cared about your original vision, the tougher things are, because no book is ever as perfect as you hoped it might be.