Only scroll to *locally* inserted annotation

Reimplement logic to fix #486