Around 1804, Spanish soldiers established a temporary fort at the location that would become the town of Bastrop.