Leave empty querysets alone