It was rebuilt by British forces in the 1760s, around an earlier Spanish fort, the "Castell de Sant Felip", which had been established about 1554. It is best known for its unsuccessful defence on two occasions by the British: during the Siege of Fort St Philip (1756) and the Invasion of Minorca, 1781. Following the latter event, the castle was partly demolished.