Remove configuration data after thread finishes in finalize callback

Change-Id: Ib21f4d73adacedfa1c3fa8f5a14b85dd2303048f