There is no regular mail delivery by the United States Postal Service on Veterans Day. However, UPS and FedEx will both deliver packages on that day. If you need to send a regular letter, these carriers will deliver that as well. However, it will cost you much more than a first-class stamp to have UPS or FedEx deliver your letter.