Improve reply finished signal handling

Connecting finished signal to a component is a bit dangerous as the
component can be deleted at any point.