But hey, at least you're on a bus, heading somewhere, presumably. The basis for this fear, like most others, is fear of the unknown. The mind invents rationales and worries to accommodate fear of the unknown. You conquer it by getting on your bus or train or airplane and seeing what happens. You can read all you want about the unknown, make all kinds of plans, but eventually you have to march into it.
Every journey is a series of steps taken one at a time.
Also not always easy. Fortunately, bus drivers all over the world have the uncanny ability to know where you want off if you ask them. If possible sit near the front, perhaps at some point reminding the driver of your destination. Ask someone near you if this is your stop. When you reach your stop it's not unusual for two or three people to let you know at the same time.