Close underlying buffers/channels when FragmentContext is closed.

* Fixes unit test failures due race condition between closing the allocator and last message handling.