Add destroy event handlers for directives