The masked textures on the brick were messing up the bounds calculation of the DisplayObject, so I made the bounds calculation independent of the DisplayObject.