The damage dealt by a single missed payment will likely be innocuous, but a string of missed payments will negatively impact your credit score in the long run.