Revert "Move box classification logic into PackedBoxList"

This reverts commit 08a01be350d23e80776bb1fe227a9b1f2cdb1645.