Streamline PerfSample

Just removing the allocation overhead in PerfSample since it's amenable to it.