Ensures affix directive cleans up event listeners when scope is destroyed