remove timeouts when directive is destroyed.