irc_disentangle - Issue with splitting data
Opened by eor51355 (closed)

### Describe the bug

I am trying to access your database through python using "datasets.load_dataset("irc_disentangle")" and I am getting this error message:

ValueError: Instruction "train" corresponds to no data!

### Steps to reproduce the bug

import datasets
ds = datasets.load_dataset('irc_disentangle')
ds

### Expected behavior

The data is supposed to load into ds and be accessable as such:
ds['train'][1050], ds['train'][1055]

### Environment info

I tired Python 3.12 and 3.10

Comments:
Thank you I will try this out!

On Tue, Jun 11, 2024 at 3:55 AM Vincent Lau ***@***.***>
wrote:

> I add a "streaming=True" after the name of the dataset, and it
> works.....hope it can help you
>
> And if you install the version datasets==2.15.0, this bug will not happen.
> I don't know why, but all of them works
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#issuecomment-2160041812>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7AMBT2MNO34SC3Z5G3ZG2UOXAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRQGA2DCOBRGI>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>


I still find out that there are some strange bug in v2.15.0 of datasets. it seems like that the *.arrow file cannot be established. it may be an index of the subsets. well I still try to debug it. but, one of the most efficient way may be using the google colab to build this index in the ~/huggingface/datasets, and than download them to replace the local file.....lol......it works!

Yeah I did try what you suggested and it didn’t work. I was able to get it
on a local from someone who access the dataset in the past. Let me know
when you end up fixing this bug.

On Tue, Jun 11, 2024 at 10:33 PM Vincent Lau ***@***.***>
wrote:

> I still find out that there are some strange bug in v2.15.0 of datasets.
> it seems like that the *.arrow file cannot be established. it may be an
> index of the subsets. well I still try to debug it. but, one of the most
> efficient way may be using the google colab to build this index in the
> ~/huggingface/datasets, and than download them to replace the local
> file.....lol......it works!
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#issuecomment-2161988798>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7BCJE2LOCWRVWPMNODZG6XPJAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRRHE4DQNZZHA>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>


Could you please provide more information, as required by the Bug template: https://github.com/huggingface/datasets/issues/new?assignees=&labels=&projects=&template=bug-report.yml

Without all that information, it is very difficult for us to understand the underlying issue and to give a pertinent answer.

What are the versions of the libraries you are using? Datasets, pyarrow, fsspec,...
> Environment info
> Please share your environemnt info with us. You can run the command datasets-cli env and copy-paste its output below.

What is the output you get after executing these code lines?
```python
import datasets
ds = datasets.load_dataset('irc_disentangle')
ds
```



We have made the following fixes:
- [Fix source data URL](https://huggingface.co/datasets/jkkummerfeld/irc_disentangle/discussions/4)
- [Convert dataset to Parquet](https://huggingface.co/datasets/jkkummerfeld/irc_disentangle/discussions/5)

Thank you for the fixes. Sorry I lost this conversation in my inbox.

On Mon, Jul 8, 2024 at 2:18 AM Albert Villanova del Moral <
***@***.***> wrote:

> Closed #6906 <https://github.com/huggingface/datasets/issues/6906> as
> completed.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#event-13418330895>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7HREJDE5BZSOEJFJI3ZLIVLNAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJTGQYTQMZTGA4DSNI>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>