ccieth/driver: fix the endpoint destroy

Clarify and cleanup the destruction of an endpoint in the driver
with respect to deferred works, connection timers, rcu-callbacks.
And stop using idr_removal_all(), it's being deprecated in kernel 3.9.