[runtime] Make sure that serializers release their very large intermediate buffers early