Clean up on scope destroy, not element destroy