Serializer Closing Fix

The current system of setting channels to inactive 
past the last serializer can close ongoing serializers
from a different stream. This fix sets serialisers of
a specific stream to inactive at the moment that stream
is closed.

Signed-off-by: Cor Peters <corpeters@incas3.nl>