Governorate of Livonia
The first part of today's Estonia that was occupied was island Ruhnu (then part of Governorate of Livonia) in 1915.