It's up to you if you want to give into these reasons or not. Tell them how much you love and appreciate them. You do not want to live your dreams by yourself. The fun part of living your dreams is the journey. It's the piece that builds character and the piece that you will remember the most.
Fear is a normal part of human nature.
If you can accept that fear will occur during this process then you don't have to spend time worrying what you will do if you do get afraid because you will have this part handled. The only way past fear is through it and not around it. There are no guarantees, but the rewards are plentiful if you believe in yourself. No one is going to live your dreams for you. It's up to you to create your own life.