Gradually, the Gorkhas annexed Sirmour and Shimla