Don't try to fit bounds unless we have a valid bounds