Do not remove other users' annotation.