Handle mouse back/forward as switch-to-*-buffer