If a Panel has no background, use empty actual size to calculate extents.