Repository: Cloud-CV/EvalAI
Issue: Restructure EvalAI Documentation into User-Centric Organized Directory Structure

**Description:**

The current EvalAI documentation faces challenges including mixed user types within sections, scattered setup instructions, overlapping content, and unclear user journeys. To address these, I propose a comprehensive reorganization of the docs directory into a clear, user-focused, and logically grouped structure.

---

## Current Issues with Documentation Organization

* Mixed content for hosts, participants, and developers in same sections
* Setup instructions are scattered across multiple pages
* Similar functionalities documented separately, causing duplication
* No clear user journey paths, making navigation harder

---

## Proposed Reorganized Structure

```
docs/
├── 01-getting-started/
│   ├── README.md
│   ├── introduction.md
│   ├── installation.md
│   └── setup/
│       ├── docker-setup.md
│       ├── manual-setup.md
│       ├── linux-setup.md
│       ├── windows-setup.md
│       └── macos-setup.md
├── 02-for-challenge-hosts/
│   ├── README.md
│   ├── hosting-guide/
│   │   ├── getting-started.md
│   │   ├── challenge-types.md
│   │   ├── host-challenge.md
│   │   └── approval-process.md
│   ├── configuration/
│   │   ├── challenge-config.md
│   │   ├── yaml-reference.md
│   │   ├── phases-setup.md
│   │   └── dataset-splits.md
│   ├── evaluation/
│   │   ├── evaluation-scripts.md
│   │   ├── prediction-upload.md
│   │   ├── remote-evaluation.md
│   │   └── metrics-leaderboards.md
│   └── templates/
│       ├── html-templates.md
│       ├── submission-guidelines.md
│       └── example-challenges.md
├── 03-for-participants/
│   ├── README.md
│   ├── participation-guide/
│   │   ├── getting-started.md
│   │   ├── team-management.md
│   │   └── participate.md
│   ├── submissions/
│   │   ├── submission-types.md
│   │   ├── prediction-upload.md
│   │   ├── submission-status.md
│   │   └── troubleshooting.md
│   ├── cli-tools/
│   │   ├── evalai-cli.md
│   │   ├── cli-commands.md
│   │   └── cli-troubleshooting.md
│   └── visibility/
│       ├── public-submissions.md
│       ├── private-submissions.md
│       └── baseline-submissions.md
├── 04-development/
│   ├── README.md
│   ├── architecture/
│   │   ├── system-architecture.md
│   │   ├── architectural-decisions.md
│   │   ├── directory-structure.md
│   │   └── technology-stack.md
│   ├── contributing/
│   │   ├── contribution-guide.md
│   │   ├── pull-requests.md
│   │   ├── code-standards.md
│   │   └── testing-guidelines.md
│   ├── deployment/
│   │   ├── production-deployment.md
│   │   ├── worker-setup.md
│   │   └── scaling-guidelines.md
│   └── maintenance/
│       ├── migrations.md
│       ├── monitoring.md
│       └── backup-recovery.md
├── 05-api-reference/
│   ├── README.md
│   ├── authentication.md
│   ├── endpoints/
│   │   ├── challenges.md
│   │   ├── submissions.md
│   │   ├── users.md
│   │   └── leaderboards.md
│   ├── cli-reference/
│   │   ├── command-reference.md
│   │   └── api-examples.md
│   └── webhooks/
│       ├── webhook-setup.md
│       └── webhook-events.md
├── 06-examples-tutorials/
│   ├── README.md
│   ├── host-examples/
│   │   ├── simple-prediction.md
│   │   ├── code-upload-rl.md
│   │   ├── multi-phase.md
│   │   └── remote-evaluation.md
│   ├── participant-examples/
│   │   ├── first-submission.md
│   │   └── team-collaboration.md
│   └── integration-examples/
│       ├── github-integration.md
│       ├── jupyter-notebook.md
│       └── colab-integration.md
├── 07-troubleshooting/
│   ├── README.md
│   ├── common-issues/
│   │   ├── installation-issues.md
│   │   ├── submission-errors.md
│   │   ├── evaluation-issues.md
│   │   └── cli-issues.md
│   ├── error-codes/
│   │   ├── error-reference.md
│   │   └── debugging-guide.md
│   └── support/
│       ├── faq.md
│       ├── community-support.md
│       └── contact-support.md
└── 08-reference/
    ├── README.md
    ├── glossary.md
    ├── cite.md
    ├── changelog.md
    ├── roadmap.md
    ├── config-reference/
    │   ├── yaml-schema.md
    │   ├── evaluation-metrics.md
    │   └── phase-settings.md
    └── legal/
        ├── license.md
        ├── privacy-policy.md
        └── terms-of-service.md
```

**This restructuring will create a more intuitive, maintainable, and scalable documentation experience tailored to different user roles.**