The southern portion of the Point Loma peninsula was set aside for military purposes as early as 1852