The name refers to the tower in modern usage but originally the hill itself was the origin of its name.