Allow deleting direct messages

I am able to delete direct messages and after deletion the message disappears from threaded view. But it doesn't get removed from main direct message view (which shows a list of all conversations). Any suggestions how to fix it ?