Remove TODO file.

The file is obsoleted by the Issues tracker, and its content is obsoleted by the fact that now libav does allocation for us.