Reduce real-time queue memory usage.

Memory now scales with load, periodically
cleans up.