In 1860 Olcott married Mary Epplee Morgan, daughter of the rector of Trinity parish, New Rochelle, New York.
Pada 1860 Olcott menikah dengan Mary Epplee Morgan, putri dari rektor parish Trinity, New Rochelle, New York.