That's very bad, of course. However, it's not the end of the world. Many, many very successful people have come back from just such a situation. The point is, your fears need to be resolved. Sort of like taking out the garbage.
Fears build up as a result of our activities.
They're a necessary part of life, but if they stay around too long they start to really get messy. Acknowledge your fears, deal with them, and get on with what you need to do.