The First Lady of Georgia Founded in 1803, Milledgeville served as the capital of Georgia during the Civil War. Today our charming southern town boasts a hip college vibe that has an eclectic mix of locally owned shops and dining options.