Plugin: start releasing worker resources on exit

Signed-off-by: Eduardo Silva <eduardo@monkey.io>