Allow viewports shrink to fit their content.

This only occurs when the viewports have xfill or yfill set
to False.