You can imagine what a thorn in the flesh I am to him!
You can imagine how much I bother him!