Hugging Face's logo

Spaces:
autoevaluate
/
model-evaluator
Running

App Files Community
59

Gated datasets are not supported: HTTPError: 401 Client Error: Unauthorized for url: https://datasets-server.huggingface.co/is-valid

#33
by jordimas - opened
Discussion
jordimas

Hello,

When I select the "mozilla-foundation/common_voice_10_0" dataset I get this error:

Captura de pantalla 2022-12-12 a les 16.44.06.png

Thanks

albertvillanova

@tomersagi also reported the same issue: https://huggingface.co/datasets/bigscience-data/roots_ar_openiti_proc/discussions/2

This issue arises with "gated" datasets: the user authentication credentials are not properly passed to the model-evaluator space.

Are you planning to support this?
CC: @lewtun

albertvillanova changed discussion title from Error HTTPError: 401 Client Error: Unauthorized for url when selecting the "mozilla-foundation/common_voice_10_0" to Gated datasets are not supported: HTTPError: 401 Client Error: Unauthorized for url: https://datasets-server.huggingface.co/is-valid
lewtun
 Evaluation on the Hub org

Hi @jordimas , indeed this is a limitation with the current implementation of the evaluation service - it only support evaluation on fully public datasets / models.

Sign up or log in to comment