Unsubscribe from buffer when destroyed