[BUG]Readd the destroyhandler as a requirement for some opt.

This fix bugs on the CPU in fast_compile introduced in:
commit 4f8f0da5f3a046ad3e89433fd061dd494c312b74
Date:   Thu Feb 27 09:56:12 2014 -0500
pep8
[crash fix] fix crash in fast compile introduced recently.
Merge pull request #1770 from nouiz/fast_compile

Bug and crash fix in fast_compile