Update README.md
Browse files
README.md
CHANGED
@@ -43,21 +43,21 @@ Here, we explain the procedure to generate text from pretrained weights using a
|
|
43 |
Install Python 3.8 and pip.
|
44 |
|
45 |
```
|
46 |
-
|
47 |
-
|
48 |
```
|
49 |
|
50 |
Install the huggingface_hub library.
|
51 |
|
52 |
```
|
53 |
-
|
54 |
```
|
55 |
|
56 |
Run the Python interpreter and download the model files.
|
57 |
|
58 |
```
|
59 |
-
|
60 |
-
|
61 |
```
|
62 |
|
63 |
```python
|
@@ -69,24 +69,24 @@ $ python3
|
|
69 |
Clone the source code and install the necessary Python packages.
|
70 |
|
71 |
```
|
72 |
-
|
73 |
-
|
74 |
-
|
75 |
```
|
76 |
|
77 |
Install the necessary Python packages to run on the CPU.
|
78 |
|
79 |
```
|
80 |
-
|
81 |
-
|
82 |
-
|
83 |
-
|
84 |
```
|
85 |
|
86 |
Text generation using downloaded model files.
|
87 |
|
88 |
```
|
89 |
-
|
90 |
--config=configs/japanese_0.1b_v1.py \
|
91 |
--config.sampling_temperature=0.6 \
|
92 |
--config.sampling_top_k=20 \
|
|
|
43 |
Install Python 3.8 and pip.
|
44 |
|
45 |
```
|
46 |
+
sudo apt-get update
|
47 |
+
sudo apt-get install python3.8 python3-pip build-essential
|
48 |
```
|
49 |
|
50 |
Install the huggingface_hub library.
|
51 |
|
52 |
```
|
53 |
+
pip install --upgrade huggingface_hub
|
54 |
```
|
55 |
|
56 |
Run the Python interpreter and download the model files.
|
57 |
|
58 |
```
|
59 |
+
cd $HOME
|
60 |
+
python3
|
61 |
```
|
62 |
|
63 |
```python
|
|
|
69 |
Clone the source code and install the necessary Python packages.
|
70 |
|
71 |
```
|
72 |
+
git clone -b 1.0.0.RC2 https://github.com/FookieMonster/transformer-lm-japanese
|
73 |
+
cd ./transformer-lm-japanese/transformer_lm
|
74 |
+
pip install -r requirements.txt
|
75 |
```
|
76 |
|
77 |
Install the necessary Python packages to run on the CPU.
|
78 |
|
79 |
```
|
80 |
+
pip install jax[cpu]==0.3.2
|
81 |
+
pip install chex==0.1.5
|
82 |
+
pip install protobuf==3.20.3
|
83 |
+
pip install typing-extensions==3.10.0.2
|
84 |
```
|
85 |
|
86 |
Text generation using downloaded model files.
|
87 |
|
88 |
```
|
89 |
+
python3 generate_text.py --workdir=$HOME/logs/japanese_0.1b_v1 \
|
90 |
--config=configs/japanese_0.1b_v1.py \
|
91 |
--config.sampling_temperature=0.6 \
|
92 |
--config.sampling_top_k=20 \
|