Even less alloc

Clean up the last bits of performance we're giving away for free.