An apparatus configured to encode video data, the apparatus comprising: a memory configured to store a block of video data; and one or more processors in communication with the memory, the one or more processors configured to: determine a coding mode for encoding the block of video data from among one or more coding modes based on a minimum syntax element size and a maximum syntax element size such that encoding the block of video data in a plurality of sub streams according to the determined coding mode results in one or more syntax elements for each substream, wherein each of the one or more syntax elements has a size between the minimum and maximum syntax element sizes, inclusive; encode the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data; store the plurality of encoded substreams of video data in respective balance FIFO buffers, wherein the size of each of the respective balance FIFO buffers grows with the difference between the maximum syntax element size and the minimum syntax element size; and multiplex the plurality of encoded substreams in a bitstream for transmitting to a decoder; and characterized in that the minimum syntax element size is greater than 1 bit. a memory configured to store a block of video data; and one or more processors in communication with the memory, the one or more processors configured to: determine a coding mode for encoding the block of video data from among one or more coding modes based on a minimum syntax element size and a maximum syntax element size such that encoding the block of video data in a plurality of sub streams according to the determined coding mode results in one or more syntax elements for each substream, wherein each of the one or more syntax elements has a size between the minimum and maximum syntax element sizes, inclusive; encode the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data; store the plurality of encoded substreams of video data in respective balance FIFO buffers, wherein the size of each of the respective balance FIFO buffers grows with the difference between the maximum syntax element size and the minimum syntax element size; and multiplex the plurality of encoded substreams in a bitstream for transmitting to a decoder; and characterized in that the minimum syntax element size is greater than 1 bit. determine a coding mode for encoding the block of video data from among one or more coding modes based on a minimum syntax element size and a maximum syntax element size such that encoding the block of video data in a plurality of sub streams according to the determined coding mode results in one or more syntax elements for each substream, wherein each of the one or more syntax elements has a size between the minimum and maximum syntax element sizes, inclusive; encode the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data; store the plurality of encoded substreams of video data in respective balance FIFO buffers, wherein the size of each of the respective balance FIFO buffers grows with the difference between the maximum syntax element size and the minimum syntax element size; and multiplex the plurality of encoded substreams in a bitstream for transmitting to a decoder; and characterized in that the minimum syntax element size is greater than 1 bit.