Removing TA from manager when TA exit

Change-Id: If4af6ca83898189cf87abf60278ea80095225bd5
Signed-off-by: TanelDettenborn <tanel.dettenborn@gmail.com>