In 1578, the English sea captain Francis Drake, regarded as a privateer by the Portuguese, attacked the fort and caused serious damage, leading to significant reconstruction work under the instructions of Philip III of Portugal, which was not completed until 1632. This remains the basis of the existing structure, despite it having been significantly damaged by the 1755 earthquake.