Okay, I've moved it to the DELETE functionality for the backend and modified the client the expect answer for delete too.  
https://github.com/hypothesis/h/commits/edit_delete_annotations-2
https://github.com/hypothesis/annotator-store/commits/edit_delete_annotations