Yes, a passport application can be rejected if you don't pay the fee in the stipulated time. Some other reasons include mistakes on the application form, incorrect documents, police verification not done, criminal history, and more.