Use LavMemoryManager in the background thread for the big sample buffer