Try to prevent stuff from moving around when switching from local to server search and back