Hugging Face's logo

Spaces:
crag-mm-2025
/
README
Running

App Files Community
jackiewang92 commited on
Commit
3f50b38
·
verified ·
1 Parent(s): 2f701c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -25,17 +25,17 @@ Below are the core datasets and search indices needed for the CRAG-MM benchmark,
25
  | Type | Resource | Description | Latest Release |
26
  |------|----------|-------------|----------------|
27
  | 📚 Dataset | [🤗 crag-mm-single-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public) | Single-turn conversations, images, and metadata | [v0.1.2](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public/tree/v0.1.2) |
28
- | 🌐 Web Search Index | [🤗 web-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/web-search-index-validation) | Web index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.5`, API: `v0.5.0` |
29
- | 🌐 Web Search Index | [🤗 web-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/web-search-index-public-test) | Web index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.5`, API: `v0.5.0` |
30
- | 🖼️ Image Search Index | [🤗 image-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/image-search-index-validation) | Image index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.5`, API: `v0.5.0` |
31
- | 🖼️ Image Search Index | [🤗 image-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/image-search-index-public-test) | Image index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.5`, API: `v0.5.0` |
32
 
33
 
34
  | Type | Resource | Description | Latest Release |
35
  |------|----------|-------------|----------------|
36
  | 📚 Dataset | [🤗 crag-mm-single-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public) | Single-turn conversations, images, and metadata | [v0.1.1](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public/tree/v0.1.1) |
37
- | 🌐 Web Search Index | [🤗 web-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/web-search-index-validation) | Web index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.4`, API: `v0.4.0` |
38
- | 🖼️ Image Search Index | [🤗 image-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/image-search-index-validation) | Image index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Index: `v0.4`, API: `v0.4.0` |
39
 
40
 
41
  Note: For the final evaluation, we will use a different (and larger) index than `web-search-index-validation`. It will cover everything in the `validation` index, so you can assume that the behaviors are similar.
@@ -44,6 +44,15 @@ Note: For the final evaluation, we will use a different (and larger) index than
44
 
45
  ## 📌 Multi-Turn Resources
46
 
 
 
 
 
 
 
 
 
 
47
  | Type | Resource | Description | Latest Release |
48
  |------|----------|-------------|----------------|
49
  | 📚 Dataset | [🤗 crag-mm-multi-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public) | Multi-turn conversations with images and URLs | [v0.1.1](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public/tree/v0.1.1) |
 
25
  | Type | Resource | Description | Latest Release |
26
  |------|----------|-------------|----------------|
27
  | 📚 Dataset | [🤗 crag-mm-single-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public) | Single-turn conversations, images, and metadata | [v0.1.2](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public/tree/v0.1.2) |
28
+ | 🌐 Web Search Index | [🤗 web-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/web-search-index-validation) | Web index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
29
+ | 🌐 Web Search Index | [🤗 web-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/web-search-index-public-test) | Web index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
30
+ | 🖼️ Image Search Index | [🤗 image-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/image-search-index-validation) | Image index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
31
+ | 🖼️ Image Search Index | [🤗 image-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/image-search-index-public-test) | Image index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
32
 
33
 
34
  | Type | Resource | Description | Latest Release |
35
  |------|----------|-------------|----------------|
36
  | 📚 Dataset | [🤗 crag-mm-single-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public) | Single-turn conversations, images, and metadata | [v0.1.1](https://huggingface.co/datasets/crag-mm-2025/crag-mm-single-turn-public/tree/v0.1.1) |
37
+ | 🌐 Web Search Index | [🤗 web-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/web-search-index-validation) | Web index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.1, Index: `v0.4`, API: `v0.4.0` |
38
+ | 🖼️ Image Search Index | [🤗 image-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/image-search-index-validation) | Image index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.1, Index: `v0.4`, API: `v0.4.0` |
39
 
40
 
41
  Note: For the final evaluation, we will use a different (and larger) index than `web-search-index-validation`. It will cover everything in the `validation` index, so you can assume that the behaviors are similar.
 
44
 
45
  ## 📌 Multi-Turn Resources
46
 
47
+ | Type | Resource | Description | Latest Release |
48
+ |------|----------|-------------|----------------|
49
+ | 📚 Dataset | [🤗 crag-mm-multi-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public) | Multi-turn conversations with images and URLs | [v0.1.1](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public/tree/v0.1.2) |
50
+ | 🌐 Web Search Index | [🤗 web-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/web-search-index-validation) | Web index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
51
+ | 🌐 Web Search Index | [🤗 web-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/web-search-index-public-test) | Web index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
52
+ | 🖼️ Image Search Index | [🤗 image-search-index-validation](https://huggingface.co/datasets/crag-mm-2025/image-search-index-validation) | Image index for validation (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
53
+ | 🖼️ Image Search Index | [🤗 image-search-index-public-test](https://huggingface.co/datasets/crag-mm-2025/image-search-index-public-test) | Image index for public test (via [CRAG Search API](https://gitlab.aicrowd.com/aicrowd/challenges/meta-comprehensive-rag-benchmark-kdd-cup-2025/meta-comprehensive-rag-benchmark-starter-kit/-/blob/main/docs/search_api.md?ref_type=heads)) | Dataset version: v0.1.2, Index: `v0.5`, API: `v0.5.0` |
54
+
55
+
56
  | Type | Resource | Description | Latest Release |
57
  |------|----------|-------------|----------------|
58
  | 📚 Dataset | [🤗 crag-mm-multi-turn-public](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public) | Multi-turn conversations with images and URLs | [v0.1.1](https://huggingface.co/datasets/crag-mm-2025/crag-mm-multi-turn-public/tree/v0.1.1) |