Spaces:
Paused
Paused
Lenson commited on
Commit ·
0c1bc80
1
Parent(s): 49de6ec
feat: add HF Dataset sync scripts
Browse files- HF_DATASET_SYNC.md +25 -0
- sync-to-hf.sh +25 -0
HF_DATASET_SYNC.md
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Codex Proxy HF Dataset Sync
|
| 2 |
+
|
| 3 |
+
## 设置步骤
|
| 4 |
+
|
| 5 |
+
### 1. 登录 Hugging Face
|
| 6 |
+
|
| 7 |
+
```bash
|
| 8 |
+
huggingface-cli login
|
| 9 |
+
```
|
| 10 |
+
|
| 11 |
+
### 2. 创建 Dataset (如果不存在)
|
| 12 |
+
|
| 13 |
+
在 https://huggingface.co/new 创建 `lenson78/codex-proxy-data`
|
| 14 |
+
|
| 15 |
+
### 3. 同步配置到 HF
|
| 16 |
+
|
| 17 |
+
```bash
|
| 18 |
+
HF_TOKEN=hf_xxx ./sync-to-hf.sh
|
| 19 |
+
```
|
| 20 |
+
|
| 21 |
+
或在 Space secrets 中设置 `HF_TOKEN`
|
| 22 |
+
|
| 23 |
+
## 用途
|
| 24 |
+
|
| 25 |
+
codex-proxy 的账号、cookies、配置等数据会持久化保存到 HF Dataset,避免容器重建后丢失。
|
sync-to-hf.sh
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#!/bin/bash
|
| 2 |
+
set -e
|
| 3 |
+
|
| 4 |
+
echo "========================================"
|
| 5 |
+
echo " Codex Proxy - Sync to HF Dataset"
|
| 6 |
+
echo "========================================"
|
| 7 |
+
|
| 8 |
+
HF_DATASET_NAME="${HF_DATASET_NAME:-lenson78/codex-proxy-data}"
|
| 9 |
+
HF_TOKEN="${HF_TOKEN:-}"
|
| 10 |
+
|
| 11 |
+
if [ -z "$HF_TOKEN" ]; then
|
| 12 |
+
echo "Error: HF_TOKEN not set"
|
| 13 |
+
echo "Usage: HF_TOKEN=hf_xxx ./sync-to-hf.sh"
|
| 14 |
+
exit 1
|
| 15 |
+
fi
|
| 16 |
+
|
| 17 |
+
export HF_TOKEN
|
| 18 |
+
|
| 19 |
+
echo "Uploading data/ directory..."
|
| 20 |
+
huggingface-cli upload "$HF_DATASET_NAME" data/ --repo-type dataset --quiet || true
|
| 21 |
+
|
| 22 |
+
echo "Uploading config/ directory..."
|
| 23 |
+
huggingface-cli upload "$HF_DATASET_NAME" config/ --repo-type dataset --quiet || true
|
| 24 |
+
|
| 25 |
+
echo "Done! Config synced to $HF_DATASET_NAME"
|