just streaming puts directly to avoid memory spikes and have reasonably fast writes