Fix crashes upon close in lowest latency mode