The settlement was first known as Brown's Mill, but was later changed to Dime Box. The origin of the name "Dime Box" stemmed from a custom in which early settlers would use a large, wooden box to forward and receive mail, or order small items from a carrier on horseback traveling to nearby Giddings.