Absolutely not. Withdrawing is a better option if an applicant believes the company would not be the best fit. Being hired and then leaving quickly vs withdrawing during the hiring process would be more offensive to employers.