A computer-implemented method of coding video data, comprising: obtaining, at a video coding device, video data including a plurality of encoded video frames; determining, for a first block from an encoded video frame from the plurality of encoded video frames, a first activity value among pixels in the first block; determining, for a second block from the encoded video frame, a second activity value among pixels in the second block, wherein the second block is immediately right of the first block within the video frame; determining, using the first activity value and the second activity value, an average activity of the first block and the second block; determining, using the first activity value and the second activity value, a difference in activities between the first block and the second block; selecting, using the average activity and the difference in activities, a classification category for a boundary between the first block and the second block; selecting, using the classification category, a filter; applying the filter to the pixels in the first block or the pixels in the second block to smooth transitions between the pixels; subsequent to applying the filter, outputting the first block and the second block and adding the first block and the second block to a reconstructed video frame; wherein the pixels in the first block and the pixels in the second block are along a segment of the boundary between the first block and the second block, the segment being less than the full length of the boundary, and wherein the pixels in the first block and pixels in the second block are up to eight pixels away from the boundary, and wherein selecting the classification category for the boundary between the first block and the second block using the average activity and the difference in activities comprises: applying non-uniform quantization to the average activity and to the difference in activities, wherein the non-uniform quantization produces a leveled average activity and a leveled difference in the activities, and determining the classification category for the boundary using an association between the combination of the leveled average activity and the leveled difference in activities to the classification category. obtaining, at a video coding device, video data including a plurality of encoded video frames; determining, for a first block from an encoded video frame from the plurality of encoded video frames, a first activity value among pixels in the first block; determining, for a second block from the encoded video frame, a second activity value among pixels in the second block, wherein the second block is immediately right of the first block within the video frame; determining, using the first activity value and the second activity value, an average activity of the first block and the second block; determining, using the first activity value and the second activity value, a difference in activities between the first block and the second block; selecting, using the average activity and the difference in activities, a classification category for a boundary between the first block and the second block; selecting, using the classification category, a filter; applying the filter to the pixels in the first block or the pixels in the second block to smooth transitions between the pixels; subsequent to applying the filter, outputting the first block and the second block and adding the first block and the second block to a reconstructed video frame; wherein the pixels in the first block and the pixels in the second block are along a segment of the boundary between the first block and the second block, the segment being less than the full length of the boundary, and wherein the pixels in the first block and pixels in the second block are up to eight pixels away from the boundary, and wherein selecting the classification category for the boundary between the first block and the second block using the average activity and the difference in activities comprises: applying non-uniform quantization to the average activity and to the difference in activities, wherein the non-uniform quantization produces a leveled average activity and a leveled difference in the activities, and determining the classification category for the boundary using an association between the combination of the leveled average activity and the leveled difference in activities to the classification category.