Remove unnecessary byte buffer allocations in the input path
Remove unnecessary byte buffer allocations in the most frequent control stream packets