Commit ·
dfa6c8b
1
Parent(s): 9809c02
Log: state + queued work for tomorrow; cron 586420c6 handles resume
Browse files- logs/README.md +43 -0
logs/README.md
CHANGED
|
@@ -55,3 +55,46 @@ Second bulk run, kicked off after the 24h reset. Same command, same 12 workers.
|
|
| 55 |
- A recurring cron (`10 */6 * * *`, job id kept in session state) retries the
|
| 56 |
same command until all are pushed; `--skip-existing` makes each attempt
|
| 57 |
idempotent.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
- A recurring cron (`10 */6 * * *`, job id kept in session state) retries the
|
| 56 |
same command until all are pushed; `--skip-existing` makes each attempt
|
| 57 |
idempotent.
|
| 58 |
+
|
| 59 |
+
## Session: 2026-04-20 (evening) — queued for tomorrow
|
| 60 |
+
|
| 61 |
+
Hit the 300/day HF quota again mid-afternoon. All pending work is queued via
|
| 62 |
+
the existing recurring cron (job `586420c6`, `10 */6 * * *`) — next fires
|
| 63 |
+
at 00:10, 06:10, 12:10, 18:10 local. The first fire after HF's window
|
| 64 |
+
refreshes picks up everything via `--skip-existing`.
|
| 65 |
+
|
| 66 |
+
### Pending when quota reopens (~24 h from the first 429 of day 2)
|
| 67 |
+
|
| 68 |
+
1. **~136 remaining metadata stubs** — the cron will push them automatically
|
| 69 |
+
(`python scripts/push_metadata_stubs.py --all --skip-existing --workers 12`).
|
| 70 |
+
2. **Push the org card** at `org-readme/README.md`. Two ways:
|
| 71 |
+
- Create `EEGDash/README` as a **Space** (amazon-style — lets us host
|
| 72 |
+
images alongside the card):
|
| 73 |
+
```python
|
| 74 |
+
from huggingface_hub import HfApi
|
| 75 |
+
api = HfApi()
|
| 76 |
+
api.create_repo("EEGDash/README", repo_type="space", space_sdk="static", exist_ok=True)
|
| 77 |
+
api.upload_file(
|
| 78 |
+
repo_id="EEGDash/README",
|
| 79 |
+
repo_type="space",
|
| 80 |
+
path_or_fileobj="org-readme/README.md",
|
| 81 |
+
path_in_repo="README.md",
|
| 82 |
+
)
|
| 83 |
+
```
|
| 84 |
+
- Or just paste the markdown from `org-readme/README.md` into the
|
| 85 |
+
description field at https://huggingface.co/organizations/EEGDash/settings.
|
| 86 |
+
3. **Empty-commit the Space** once stubs are done so the `on 🤗` cache
|
| 87 |
+
refreshes.
|
| 88 |
+
|
| 89 |
+
### Reference: current state
|
| 90 |
+
|
| 91 |
+
| | |
|
| 92 |
+
|---|---|
|
| 93 |
+
| Total datasets in CSV | 736 |
|
| 94 |
+
| Mirrored to HF | 600 |
|
| 95 |
+
| Remaining | ~136 |
|
| 96 |
+
| Org card drafted | `org-readme/README.md` (pushed to Space repo) |
|
| 97 |
+
| Org card published | **no** (blocked on quota) |
|
| 98 |
+
| HF rate limit | 300 repo-creations / 24 h org-wide |
|
| 99 |
+
| First 429 day 2 | 2026-04-20 ~18:34 UTC |
|
| 100 |
+
| Earliest clean window | ~2026-04-21 18:30 UTC |
|