Remove pan control from minimap

(basically same issue as c537811e9b996bdcda80510d4e04e17fd3654796)