I believe Emacs 24.3.50 is the "trunk".
Yeah, you have to set point to the beginning of the rectangle when you delete, so that you are positioned to yank.  That avoids the `pop-to-mark-command'.  Your command only works when you mark the rectangle to delete with point at the end.