Refactoring get patch annotation code
Revert back to using description instead of git-notes for annotations

Fixes #4