Ligeng-Zhu commited on
Commit
053064a
1 Parent(s): 82c9012

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # How to use?
3
+
4
+ ```bash
5
+ huggingface-cli download Ligeng-Zhu/panda70mm --local-dir panda70m --repo-type dataset --local-dir-use-symlinks False
6
+ ```
7
+
8
+ Then install dependencies
9
+
10
+ ```bash
11
+ pip install fire yt_dlp pandas
12
+ ```
13
+
14
+ Next pull the videos
15
+
16
+ ```bash
17
+ python main.py --csv=<your csv files>
18
+ ```
19
+
20
+ or split by shards to accelerate downloading
21
+
22
+ ```bash
23
+ python main.py --csv=<your csv files> --shards=0 --total=10
24
+ python main.py --csv=<your csv files> --shards=1 --total=10
25
+ ...
26
+ python main.py --csv=<your csv files> --shards=9 --total=10
27
+ ```