VB: don't own the conversation in the buddy.

Fixes #1029.