Revert "Add assertion around buffer processing"

This reverts commit 2b5b1186cc3d51e247b51cc571ef929e4c52ae39.