Shouldn't predictions accumulate on CPU, not GPU?
In https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pytorch_lightning/trainer/predict_loop.py#L111:
        predictions = self.trainer.accelerator.predict_step(args)

        if predictions is None:
            self.warning_cache.warn("predict returned None if it was on purpose, ignore this warning...")

        self.trainer.call_hook("on_predict_batch_end", predictions, batch, batch_idx, dataloader_idx)

        if self.should_store_predictions:
            self.predictions[dataloader_idx].append(predictions)
Shouldn't .cpu() be called on predictions before appending them to self.predictions so that predictions accumulate con CPU memory, not GPU memory?
This was fixed in #9085