How to display progress on IterableDataset?
When I use an IterableDataset, the Trainer.fit() gives something like:
Epoch 0: : 21it [02:41,  7.69s/it, loss=0.663, v_num=18]  

Which does not display a progress. Even if I specify a validation interval, there is no progress shown. Is there a way I can specify an "epoch length", or something like that for IterableDataset?
Hi
IterableDatasets don't have a lengh defined. They can either be infinite in size or raise StopIteration at an arbitrary point. Hence, there is no notion of epochs and we cannot anticipate when it finishes iterations.
If you really need to have epochs, I suggest you try to rewrite your dataset logic into a regular Dataset.