Jamie@TitanML commited on
Commit
c6268eb
1 Parent(s): d96d8e3

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -2,7 +2,6 @@
2
  *.arrow filter=lfs diff=lfs merge=lfs -text
3
  *.bin filter=lfs diff=lfs merge=lfs -text
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
- *.ckpt filter=lfs diff=lfs merge=lfs -text
6
  *.ftz filter=lfs diff=lfs merge=lfs -text
7
  *.gz filter=lfs diff=lfs merge=lfs -text
8
  *.h5 filter=lfs diff=lfs merge=lfs -text
@@ -25,7 +24,6 @@
25
  *.safetensors filter=lfs diff=lfs merge=lfs -text
26
  saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
  *.tar.* filter=lfs diff=lfs merge=lfs -text
28
- *.tar filter=lfs diff=lfs merge=lfs -text
29
  *.tflite filter=lfs diff=lfs merge=lfs -text
30
  *.tgz filter=lfs diff=lfs merge=lfs -text
31
  *.wasm filter=lfs diff=lfs merge=lfs -text
 
2
  *.arrow filter=lfs diff=lfs merge=lfs -text
3
  *.bin filter=lfs diff=lfs merge=lfs -text
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
 
5
  *.ftz filter=lfs diff=lfs merge=lfs -text
6
  *.gz filter=lfs diff=lfs merge=lfs -text
7
  *.h5 filter=lfs diff=lfs merge=lfs -text
 
24
  *.safetensors filter=lfs diff=lfs merge=lfs -text
25
  saved_model/**/* filter=lfs diff=lfs merge=lfs -text
26
  *.tar.* filter=lfs diff=lfs merge=lfs -text
 
27
  *.tflite filter=lfs diff=lfs merge=lfs -text
28
  *.tgz filter=lfs diff=lfs merge=lfs -text
29
  *.wasm filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,276 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - fr
5
+ - ro
6
+ - de
7
+ - multilingual
8
+
9
+ widget:
10
+ - text: "Translate to German: My name is Arthur"
11
+ example_title: "Translation"
12
+ - text: "Please answer to the following question. Who is going to be the next Ballon d'or?"
13
+ example_title: "Question Answering"
14
+ - text: "Q: Can Geoffrey Hinton have a conversation with George Washington? Give the rationale before answering."
15
+ example_title: "Logical reasoning"
16
+ - text: "Please answer the following question. What is the boiling point of Nitrogen?"
17
+ example_title: "Scientific knowledge"
18
+ - text: "Answer the following yes/no question. Can you write a whole Haiku in a single tweet?"
19
+ example_title: "Yes/no question"
20
+ - text: "Answer the following yes/no question by reasoning step-by-step. Can you write a whole Haiku in a single tweet?"
21
+ example_title: "Reasoning task"
22
+ - text: "Q: ( False or not False or False ) is? A: Let's think step by step"
23
+ example_title: "Boolean Expressions"
24
+ - text: "The square root of x is the cube root of y. What is y to the power of 2, if x = 4?"
25
+ example_title: "Math reasoning"
26
+ - text: "Premise: At my age you will probably have learnt one lesson. Hypothesis: It's not certain how many lessons you'll learn by your thirties. Does the premise entail the hypothesis?"
27
+ example_title: "Premise and hypothesis"
28
+
29
+ tags:
30
+ - text2text-generation
31
+
32
+ datasets:
33
+ - svakulenk0/qrecc
34
+ - taskmaster2
35
+ - djaym7/wiki_dialog
36
+ - deepmind/code_contests
37
+ - lambada
38
+ - gsm8k
39
+ - aqua_rat
40
+ - esnli
41
+ - quasc
42
+ - qed
43
+
44
+
45
+ license: apache-2.0
46
+ ---
47
+
48
+ # Model Card for FLAN-T5 XL
49
+
50
+ <img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/transformers/model_doc/flan2_architecture.jpg"
51
+ alt="drawing" width="600"/>
52
+
53
+ # Table of Contents
54
+
55
+ 0. [TL;DR](#TL;DR)
56
+ 1. [Model Details](#model-details)
57
+ 2. [Usage](#usage)
58
+ 3. [Uses](#uses)
59
+ 4. [Bias, Risks, and Limitations](#bias-risks-and-limitations)
60
+ 5. [Training Details](#training-details)
61
+ 6. [Evaluation](#evaluation)
62
+ 7. [Environmental Impact](#environmental-impact)
63
+ 8. [Citation](#citation)
64
+
65
+ # TL;DR
66
+
67
+ If you already know T5, FLAN-T5 is just better at everything. For the same number of parameters, these models have been fine-tuned on more than 1000 additional tasks covering also more languages.
68
+ As mentioned in the first few lines of the abstract :
69
+ > Flan-PaLM 540B achieves state-of-the-art performance on several benchmarks, such as 75.2% on five-shot MMLU. We also publicly release Flan-T5 checkpoints,1 which achieve strong few-shot performance even compared to much larger models, such as PaLM 62B. Overall, instruction finetuning is a general method for improving the performance and usability of pretrained language models.
70
+
71
+ **Disclaimer**: Content from **this** model card has been written by the Hugging Face team, and parts of it were copy pasted from the [T5 model card](https://huggingface.co/t5-large).
72
+
73
+ # Model Details
74
+
75
+ ## Model Description
76
+
77
+
78
+ - **Model type:** Language model
79
+ - **Language(s) (NLP):** English, Spanish, Japanese, Persian, Hindi, French, Chinese, Bengali, Gujarati, German, Telugu, Italian, Arabic, Polish, Tamil, Marathi, Malayalam, Oriya, Panjabi, Portuguese, Urdu, Galician, Hebrew, Korean, Catalan, Thai, Dutch, Indonesian, Vietnamese, Bulgarian, Filipino, Central Khmer, Lao, Turkish, Russian, Croatian, Swedish, Yoruba, Kurdish, Burmese, Malay, Czech, Finnish, Somali, Tagalog, Swahili, Sinhala, Kannada, Zhuang, Igbo, Xhosa, Romanian, Haitian, Estonian, Slovak, Lithuanian, Greek, Nepali, Assamese, Norwegian
80
+ - **License:** Apache 2.0
81
+ - **Related Models:** [All FLAN-T5 Checkpoints](https://huggingface.co/models?search=flan-t5)
82
+ - **Original Checkpoints:** [All Original FLAN-T5 Checkpoints](https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints)
83
+ - **Resources for more information:**
84
+ - [Research paper](https://arxiv.org/pdf/2210.11416.pdf)
85
+ - [GitHub Repo](https://github.com/google-research/t5x)
86
+ - [Hugging Face FLAN-T5 Docs (Similar to T5) ](https://huggingface.co/docs/transformers/model_doc/t5)
87
+
88
+ # Usage
89
+
90
+ Find below some example scripts on how to use the model in `transformers`:
91
+
92
+ ## Using the Pytorch model
93
+
94
+ ### Running the model on a CPU
95
+
96
+ <details>
97
+ <summary> Click to expand </summary>
98
+
99
+ ```python
100
+
101
+ from transformers import T5Tokenizer, T5ForConditionalGeneration
102
+
103
+ tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
104
+ model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl")
105
+
106
+ input_text = "translate English to German: How old are you?"
107
+ input_ids = tokenizer(input_text, return_tensors="pt").input_ids
108
+
109
+ outputs = model.generate(input_ids)
110
+ print(tokenizer.decode(outputs[0]))
111
+ ```
112
+
113
+ </details>
114
+
115
+ ### Running the model on a GPU
116
+
117
+ <details>
118
+ <summary> Click to expand </summary>
119
+
120
+ ```python
121
+ # pip install accelerate
122
+ from transformers import T5Tokenizer, T5ForConditionalGeneration
123
+
124
+ tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
125
+ model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl", device_map="auto")
126
+
127
+ input_text = "translate English to German: How old are you?"
128
+ input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
129
+
130
+ outputs = model.generate(input_ids)
131
+ print(tokenizer.decode(outputs[0]))
132
+ ```
133
+
134
+ </details>
135
+
136
+ ### Running the model on a GPU using different precisions
137
+
138
+ #### FP16
139
+
140
+ <details>
141
+ <summary> Click to expand </summary>
142
+
143
+ ```python
144
+ # pip install accelerate
145
+ import torch
146
+ from transformers import T5Tokenizer, T5ForConditionalGeneration
147
+
148
+ tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
149
+ model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl", device_map="auto", torch_dtype=torch.float16)
150
+
151
+ input_text = "translate English to German: How old are you?"
152
+ input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
153
+
154
+ outputs = model.generate(input_ids)
155
+ print(tokenizer.decode(outputs[0]))
156
+ ```
157
+
158
+ </details>
159
+
160
+ #### INT8
161
+
162
+ <details>
163
+ <summary> Click to expand </summary>
164
+
165
+ ```python
166
+ # pip install bitsandbytes accelerate
167
+ from transformers import T5Tokenizer, T5ForConditionalGeneration
168
+
169
+ tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
170
+ model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl", device_map="auto", load_in_8bit=True)
171
+
172
+ input_text = "translate English to German: How old are you?"
173
+ input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
174
+
175
+ outputs = model.generate(input_ids)
176
+ print(tokenizer.decode(outputs[0]))
177
+ ```
178
+
179
+ </details>
180
+
181
+ # Uses
182
+
183
+ ## Direct Use and Downstream Use
184
+
185
+ The authors write in [the original paper's model card](https://arxiv.org/pdf/2210.11416.pdf) that:
186
+
187
+ > The primary use is research on language models, including: research on zero-shot NLP tasks and in-context few-shot learning NLP tasks, such as reasoning, and question answering; advancing fairness and safety research, and understanding limitations of current large language models
188
+
189
+ See the [research paper](https://arxiv.org/pdf/2210.11416.pdf) for further details.
190
+
191
+ ## Out-of-Scope Use
192
+
193
+ More information needed.
194
+
195
+ # Bias, Risks, and Limitations
196
+
197
+ The information below in this section are copied from the model's [official model card](https://arxiv.org/pdf/2210.11416.pdf):
198
+
199
+ > Language models, including Flan-T5, can potentially be used for language generation in a harmful way, according to Rae et al. (2021). Flan-T5 should not be used directly in any application, without a prior assessment of safety and fairness concerns specific to the application.
200
+
201
+ ## Ethical considerations and risks
202
+
203
+ > Flan-T5 is fine-tuned on a large corpus of text data that was not filtered for explicit content or assessed for existing biases. As a result the model itself is potentially vulnerable to generating equivalently inappropriate content or replicating inherent biases in the underlying data.
204
+
205
+ ## Known Limitations
206
+
207
+ > Flan-T5 has not been tested in real world applications.
208
+
209
+ ## Sensitive Use:
210
+
211
+ > Flan-T5 should not be applied for any unacceptable use cases, e.g., generation of abusive speech.
212
+
213
+ # Training Details
214
+
215
+ ## Training Data
216
+
217
+ The model was trained on a mixture of tasks, that includes the tasks described in the table below (from the original paper, figure 2):
218
+
219
+ ![table.png](https://s3.amazonaws.com/moonup/production/uploads/1666363265279-62441d1d9fdefb55a0b7d12c.png)
220
+
221
+
222
+ ## Training Procedure
223
+
224
+ According to the model card from the [original paper](https://arxiv.org/pdf/2210.11416.pdf):
225
+
226
+ > These models are based on pretrained T5 (Raffel et al., 2020) and fine-tuned with instructions for better zero-shot and few-shot performance. There is one fine-tuned Flan model per T5 model size.
227
+
228
+ The model has been trained on TPU v3 or TPU v4 pods, using [`t5x`](https://github.com/google-research/t5x) codebase together with [`jax`](https://github.com/google/jax).
229
+
230
+
231
+ # Evaluation
232
+
233
+ ## Testing Data, Factors & Metrics
234
+
235
+ The authors evaluated the model on various tasks covering several languages (1836 in total). See the table below for some quantitative evaluation:
236
+ ![image.png](https://s3.amazonaws.com/moonup/production/uploads/1668072995230-62441d1d9fdefb55a0b7d12c.png)
237
+ For full details, please check the [research paper](https://arxiv.org/pdf/2210.11416.pdf).
238
+
239
+ ## Results
240
+
241
+ For full results for FLAN-T5-XL, see the [research paper](https://arxiv.org/pdf/2210.11416.pdf), Table 3.
242
+
243
+ # Environmental Impact
244
+
245
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
246
+
247
+ - **Hardware Type:** Google Cloud TPU Pods - TPU v3 or TPU v4 | Number of chips ≥ 4.
248
+ - **Hours used:** More information needed
249
+ - **Cloud Provider:** GCP
250
+ - **Compute Region:** More information needed
251
+ - **Carbon Emitted:** More information needed
252
+
253
+ # Citation
254
+
255
+ **BibTeX:**
256
+
257
+ ```bibtex
258
+ @misc{https://doi.org/10.48550/arxiv.2210.11416,
259
+ doi = {10.48550/ARXIV.2210.11416},
260
+
261
+ url = {https://arxiv.org/abs/2210.11416},
262
+
263
+ author = {Chung, Hyung Won and Hou, Le and Longpre, Shayne and Zoph, Barret and Tay, Yi and Fedus, William and Li, Eric and Wang, Xuezhi and Dehghani, Mostafa and Brahma, Siddhartha and Webson, Albert and Gu, Shixiang Shane and Dai, Zhuyun and Suzgun, Mirac and Chen, Xinyun and Chowdhery, Aakanksha and Narang, Sharan and Mishra, Gaurav and Yu, Adams and Zhao, Vincent and Huang, Yanping and Dai, Andrew and Yu, Hongkun and Petrov, Slav and Chi, Ed H. and Dean, Jeff and Devlin, Jacob and Roberts, Adam and Zhou, Denny and Le, Quoc V. and Wei, Jason},
264
+
265
+ keywords = {Machine Learning (cs.LG), Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
266
+
267
+ title = {Scaling Instruction-Finetuned Language Models},
268
+
269
+ publisher = {arXiv},
270
+
271
+ year = {2022},
272
+
273
+ copyright = {Creative Commons Attribution 4.0 International}
274
+ }
275
+ ```
276
+
config.json ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "T5ForConditionalGeneration"
4
+ ],
5
+ "d_ff": 5120,
6
+ "d_kv": 64,
7
+ "d_model": 2048,
8
+ "decoder_start_token_id": 0,
9
+ "dropout_rate": 0.1,
10
+ "eos_token_id": 1,
11
+ "feed_forward_proj": "gated-gelu",
12
+ "initializer_factor": 1.0,
13
+ "is_encoder_decoder": true,
14
+ "layer_norm_epsilon": 1e-06,
15
+ "model_type": "t5",
16
+ "n_positions": 512,
17
+ "num_decoder_layers": 24,
18
+ "num_heads": 32,
19
+ "num_layers": 24,
20
+ "output_past": true,
21
+ "pad_token_id": 0,
22
+ "relative_attention_max_distance": 128,
23
+ "relative_attention_num_buckets": 32,
24
+ "task_specific_params": {
25
+ "summarization": {
26
+ "early_stopping": true,
27
+ "length_penalty": 2.0,
28
+ "max_length": 200,
29
+ "min_length": 30,
30
+ "no_repeat_ngram_size": 3,
31
+ "num_beams": 4,
32
+ "prefix": "summarize: "
33
+ },
34
+ "translation_en_to_de": {
35
+ "early_stopping": true,
36
+ "max_length": 300,
37
+ "num_beams": 4,
38
+ "prefix": "translate English to German: "
39
+ },
40
+ "translation_en_to_fr": {
41
+ "early_stopping": true,
42
+ "max_length": 300,
43
+ "num_beams": 4,
44
+ "prefix": "translate English to French: "
45
+ },
46
+ "translation_en_to_ro": {
47
+ "early_stopping": true,
48
+ "max_length": 300,
49
+ "num_beams": 4,
50
+ "prefix": "translate English to Romanian: "
51
+ }
52
+ },
53
+ "tie_word_embeddings": false,
54
+ "torch_dtype": "float32",
55
+ "transformers_version": "4.24.0.dev0",
56
+ "use_cache": true,
57
+ "vocab_size": 32128
58
+ }
ct_output_models/config.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_source_bos": false,
3
+ "add_source_eos": false,
4
+ "bos_token": "<pad>",
5
+ "decoder_start_token": "<pad>",
6
+ "eos_token": "</s>",
7
+ "layer_norm_epsilon": null,
8
+ "unk_token": "<unk>"
9
+ }
ct_output_models/model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18ecc2d8601eaa2f9d9a44e48f18693829852f15ec65b26d4466bd38056533d1
3
+ size 2855545974
ct_output_models/shared_vocabulary.json ADDED
The diff for this file is too large to render. See raw diff
 
flax_model.msgpack.index.json ADDED
@@ -0,0 +1,565 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 11399028736
4
+ },
5
+ "weight_map": {
6
+ "decoder/block/0/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
7
+ "decoder/block/0/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
8
+ "decoder/block/0/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
9
+ "decoder/block/0/layer/0/SelfAttention/relative_attention_bias/embedding": "flax_model-00001-of-00002.msgpack",
10
+ "decoder/block/0/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
11
+ "decoder/block/0/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
12
+ "decoder/block/0/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
13
+ "decoder/block/0/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
14
+ "decoder/block/0/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
15
+ "decoder/block/0/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
16
+ "decoder/block/0/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
17
+ "decoder/block/0/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
18
+ "decoder/block/0/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
19
+ "decoder/block/0/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
20
+ "decoder/block/0/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
21
+ "decoder/block/1/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
22
+ "decoder/block/1/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
23
+ "decoder/block/1/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
24
+ "decoder/block/1/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
25
+ "decoder/block/1/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
26
+ "decoder/block/1/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
27
+ "decoder/block/1/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
28
+ "decoder/block/1/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
29
+ "decoder/block/1/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
30
+ "decoder/block/1/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
31
+ "decoder/block/1/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
32
+ "decoder/block/1/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
33
+ "decoder/block/1/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
34
+ "decoder/block/1/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
35
+ "decoder/block/10/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
36
+ "decoder/block/10/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
37
+ "decoder/block/10/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
38
+ "decoder/block/10/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
39
+ "decoder/block/10/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
40
+ "decoder/block/10/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
41
+ "decoder/block/10/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
42
+ "decoder/block/10/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
43
+ "decoder/block/10/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
44
+ "decoder/block/10/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
45
+ "decoder/block/10/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
46
+ "decoder/block/10/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
47
+ "decoder/block/10/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
48
+ "decoder/block/10/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
49
+ "decoder/block/11/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
50
+ "decoder/block/11/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
51
+ "decoder/block/11/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
52
+ "decoder/block/11/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
53
+ "decoder/block/11/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
54
+ "decoder/block/11/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
55
+ "decoder/block/11/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
56
+ "decoder/block/11/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
57
+ "decoder/block/11/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
58
+ "decoder/block/11/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
59
+ "decoder/block/11/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
60
+ "decoder/block/11/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
61
+ "decoder/block/11/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
62
+ "decoder/block/11/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
63
+ "decoder/block/12/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
64
+ "decoder/block/12/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
65
+ "decoder/block/12/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
66
+ "decoder/block/12/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
67
+ "decoder/block/12/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
68
+ "decoder/block/12/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
69
+ "decoder/block/12/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
70
+ "decoder/block/12/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
71
+ "decoder/block/12/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
72
+ "decoder/block/12/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
73
+ "decoder/block/12/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
74
+ "decoder/block/12/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
75
+ "decoder/block/12/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
76
+ "decoder/block/12/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
77
+ "decoder/block/13/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
78
+ "decoder/block/13/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
79
+ "decoder/block/13/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
80
+ "decoder/block/13/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
81
+ "decoder/block/13/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
82
+ "decoder/block/13/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
83
+ "decoder/block/13/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
84
+ "decoder/block/13/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
85
+ "decoder/block/13/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
86
+ "decoder/block/13/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
87
+ "decoder/block/13/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
88
+ "decoder/block/13/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
89
+ "decoder/block/13/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
90
+ "decoder/block/13/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
91
+ "decoder/block/14/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
92
+ "decoder/block/14/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
93
+ "decoder/block/14/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
94
+ "decoder/block/14/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
95
+ "decoder/block/14/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
96
+ "decoder/block/14/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
97
+ "decoder/block/14/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
98
+ "decoder/block/14/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
99
+ "decoder/block/14/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
100
+ "decoder/block/14/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
101
+ "decoder/block/14/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
102
+ "decoder/block/14/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
103
+ "decoder/block/14/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
104
+ "decoder/block/14/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
105
+ "decoder/block/15/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
106
+ "decoder/block/15/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
107
+ "decoder/block/15/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
108
+ "decoder/block/15/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
109
+ "decoder/block/15/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
110
+ "decoder/block/15/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
111
+ "decoder/block/15/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
112
+ "decoder/block/15/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
113
+ "decoder/block/15/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
114
+ "decoder/block/15/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
115
+ "decoder/block/15/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
116
+ "decoder/block/15/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
117
+ "decoder/block/15/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
118
+ "decoder/block/15/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
119
+ "decoder/block/16/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
120
+ "decoder/block/16/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
121
+ "decoder/block/16/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
122
+ "decoder/block/16/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
123
+ "decoder/block/16/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
124
+ "decoder/block/16/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
125
+ "decoder/block/16/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
126
+ "decoder/block/16/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
127
+ "decoder/block/16/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
128
+ "decoder/block/16/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
129
+ "decoder/block/16/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
130
+ "decoder/block/16/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
131
+ "decoder/block/16/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
132
+ "decoder/block/16/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
133
+ "decoder/block/17/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
134
+ "decoder/block/17/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
135
+ "decoder/block/17/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
136
+ "decoder/block/17/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
137
+ "decoder/block/17/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
138
+ "decoder/block/17/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
139
+ "decoder/block/17/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
140
+ "decoder/block/17/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
141
+ "decoder/block/17/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
142
+ "decoder/block/17/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
143
+ "decoder/block/17/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
144
+ "decoder/block/17/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
145
+ "decoder/block/17/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
146
+ "decoder/block/17/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
147
+ "decoder/block/18/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
148
+ "decoder/block/18/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
149
+ "decoder/block/18/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
150
+ "decoder/block/18/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
151
+ "decoder/block/18/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
152
+ "decoder/block/18/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
153
+ "decoder/block/18/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
154
+ "decoder/block/18/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
155
+ "decoder/block/18/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
156
+ "decoder/block/18/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
157
+ "decoder/block/18/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
158
+ "decoder/block/18/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
159
+ "decoder/block/18/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
160
+ "decoder/block/18/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
161
+ "decoder/block/19/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
162
+ "decoder/block/19/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
163
+ "decoder/block/19/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
164
+ "decoder/block/19/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
165
+ "decoder/block/19/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
166
+ "decoder/block/19/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
167
+ "decoder/block/19/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
168
+ "decoder/block/19/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
169
+ "decoder/block/19/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
170
+ "decoder/block/19/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
171
+ "decoder/block/19/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00002-of-00002.msgpack",
172
+ "decoder/block/19/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00002-of-00002.msgpack",
173
+ "decoder/block/19/layer/2/DenseReluDense/wo/kernel": "flax_model-00002-of-00002.msgpack",
174
+ "decoder/block/19/layer/2/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
175
+ "decoder/block/2/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
176
+ "decoder/block/2/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
177
+ "decoder/block/2/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
178
+ "decoder/block/2/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
179
+ "decoder/block/2/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
180
+ "decoder/block/2/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
181
+ "decoder/block/2/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
182
+ "decoder/block/2/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
183
+ "decoder/block/2/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
184
+ "decoder/block/2/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
185
+ "decoder/block/2/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
186
+ "decoder/block/2/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
187
+ "decoder/block/2/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
188
+ "decoder/block/2/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
189
+ "decoder/block/20/layer/0/SelfAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
190
+ "decoder/block/20/layer/0/SelfAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
191
+ "decoder/block/20/layer/0/SelfAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
192
+ "decoder/block/20/layer/0/SelfAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
193
+ "decoder/block/20/layer/0/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
194
+ "decoder/block/20/layer/1/EncDecAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
195
+ "decoder/block/20/layer/1/EncDecAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
196
+ "decoder/block/20/layer/1/EncDecAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
197
+ "decoder/block/20/layer/1/EncDecAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
198
+ "decoder/block/20/layer/1/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
199
+ "decoder/block/20/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00002-of-00002.msgpack",
200
+ "decoder/block/20/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00002-of-00002.msgpack",
201
+ "decoder/block/20/layer/2/DenseReluDense/wo/kernel": "flax_model-00002-of-00002.msgpack",
202
+ "decoder/block/20/layer/2/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
203
+ "decoder/block/21/layer/0/SelfAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
204
+ "decoder/block/21/layer/0/SelfAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
205
+ "decoder/block/21/layer/0/SelfAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
206
+ "decoder/block/21/layer/0/SelfAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
207
+ "decoder/block/21/layer/0/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
208
+ "decoder/block/21/layer/1/EncDecAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
209
+ "decoder/block/21/layer/1/EncDecAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
210
+ "decoder/block/21/layer/1/EncDecAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
211
+ "decoder/block/21/layer/1/EncDecAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
212
+ "decoder/block/21/layer/1/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
213
+ "decoder/block/21/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00002-of-00002.msgpack",
214
+ "decoder/block/21/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00002-of-00002.msgpack",
215
+ "decoder/block/21/layer/2/DenseReluDense/wo/kernel": "flax_model-00002-of-00002.msgpack",
216
+ "decoder/block/21/layer/2/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
217
+ "decoder/block/22/layer/0/SelfAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
218
+ "decoder/block/22/layer/0/SelfAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
219
+ "decoder/block/22/layer/0/SelfAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
220
+ "decoder/block/22/layer/0/SelfAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
221
+ "decoder/block/22/layer/0/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
222
+ "decoder/block/22/layer/1/EncDecAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
223
+ "decoder/block/22/layer/1/EncDecAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
224
+ "decoder/block/22/layer/1/EncDecAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
225
+ "decoder/block/22/layer/1/EncDecAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
226
+ "decoder/block/22/layer/1/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
227
+ "decoder/block/22/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00002-of-00002.msgpack",
228
+ "decoder/block/22/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00002-of-00002.msgpack",
229
+ "decoder/block/22/layer/2/DenseReluDense/wo/kernel": "flax_model-00002-of-00002.msgpack",
230
+ "decoder/block/22/layer/2/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
231
+ "decoder/block/23/layer/0/SelfAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
232
+ "decoder/block/23/layer/0/SelfAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
233
+ "decoder/block/23/layer/0/SelfAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
234
+ "decoder/block/23/layer/0/SelfAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
235
+ "decoder/block/23/layer/0/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
236
+ "decoder/block/23/layer/1/EncDecAttention/k/kernel": "flax_model-00002-of-00002.msgpack",
237
+ "decoder/block/23/layer/1/EncDecAttention/o/kernel": "flax_model-00002-of-00002.msgpack",
238
+ "decoder/block/23/layer/1/EncDecAttention/q/kernel": "flax_model-00002-of-00002.msgpack",
239
+ "decoder/block/23/layer/1/EncDecAttention/v/kernel": "flax_model-00002-of-00002.msgpack",
240
+ "decoder/block/23/layer/1/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
241
+ "decoder/block/23/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00002-of-00002.msgpack",
242
+ "decoder/block/23/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00002-of-00002.msgpack",
243
+ "decoder/block/23/layer/2/DenseReluDense/wo/kernel": "flax_model-00002-of-00002.msgpack",
244
+ "decoder/block/23/layer/2/layer_norm/weight": "flax_model-00002-of-00002.msgpack",
245
+ "decoder/block/3/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
246
+ "decoder/block/3/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
247
+ "decoder/block/3/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
248
+ "decoder/block/3/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
249
+ "decoder/block/3/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
250
+ "decoder/block/3/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
251
+ "decoder/block/3/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
252
+ "decoder/block/3/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
253
+ "decoder/block/3/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
254
+ "decoder/block/3/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
255
+ "decoder/block/3/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
256
+ "decoder/block/3/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
257
+ "decoder/block/3/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
258
+ "decoder/block/3/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
259
+ "decoder/block/4/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
260
+ "decoder/block/4/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
261
+ "decoder/block/4/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
262
+ "decoder/block/4/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
263
+ "decoder/block/4/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
264
+ "decoder/block/4/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
265
+ "decoder/block/4/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
266
+ "decoder/block/4/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
267
+ "decoder/block/4/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
268
+ "decoder/block/4/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
269
+ "decoder/block/4/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
270
+ "decoder/block/4/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
271
+ "decoder/block/4/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
272
+ "decoder/block/4/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
273
+ "decoder/block/5/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
274
+ "decoder/block/5/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
275
+ "decoder/block/5/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
276
+ "decoder/block/5/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
277
+ "decoder/block/5/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
278
+ "decoder/block/5/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
279
+ "decoder/block/5/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
280
+ "decoder/block/5/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
281
+ "decoder/block/5/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
282
+ "decoder/block/5/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
283
+ "decoder/block/5/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
284
+ "decoder/block/5/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
285
+ "decoder/block/5/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
286
+ "decoder/block/5/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
287
+ "decoder/block/6/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
288
+ "decoder/block/6/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
289
+ "decoder/block/6/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
290
+ "decoder/block/6/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
291
+ "decoder/block/6/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
292
+ "decoder/block/6/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
293
+ "decoder/block/6/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
294
+ "decoder/block/6/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
295
+ "decoder/block/6/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
296
+ "decoder/block/6/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
297
+ "decoder/block/6/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
298
+ "decoder/block/6/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
299
+ "decoder/block/6/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
300
+ "decoder/block/6/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
301
+ "decoder/block/7/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
302
+ "decoder/block/7/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
303
+ "decoder/block/7/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
304
+ "decoder/block/7/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
305
+ "decoder/block/7/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
306
+ "decoder/block/7/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
307
+ "decoder/block/7/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
308
+ "decoder/block/7/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
309
+ "decoder/block/7/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
310
+ "decoder/block/7/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
311
+ "decoder/block/7/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
312
+ "decoder/block/7/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
313
+ "decoder/block/7/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
314
+ "decoder/block/7/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
315
+ "decoder/block/8/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
316
+ "decoder/block/8/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
317
+ "decoder/block/8/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
318
+ "decoder/block/8/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
319
+ "decoder/block/8/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
320
+ "decoder/block/8/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
321
+ "decoder/block/8/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
322
+ "decoder/block/8/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
323
+ "decoder/block/8/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
324
+ "decoder/block/8/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
325
+ "decoder/block/8/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
326
+ "decoder/block/8/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
327
+ "decoder/block/8/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
328
+ "decoder/block/8/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
329
+ "decoder/block/9/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
330
+ "decoder/block/9/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
331
+ "decoder/block/9/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
332
+ "decoder/block/9/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
333
+ "decoder/block/9/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
334
+ "decoder/block/9/layer/1/EncDecAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
335
+ "decoder/block/9/layer/1/EncDecAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
336
+ "decoder/block/9/layer/1/EncDecAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
337
+ "decoder/block/9/layer/1/EncDecAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
338
+ "decoder/block/9/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
339
+ "decoder/block/9/layer/2/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
340
+ "decoder/block/9/layer/2/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
341
+ "decoder/block/9/layer/2/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
342
+ "decoder/block/9/layer/2/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
343
+ "decoder/final_layer_norm/weight": "flax_model-00002-of-00002.msgpack",
344
+ "encoder/block/0/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
345
+ "encoder/block/0/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
346
+ "encoder/block/0/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
347
+ "encoder/block/0/layer/0/SelfAttention/relative_attention_bias/embedding": "flax_model-00001-of-00002.msgpack",
348
+ "encoder/block/0/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
349
+ "encoder/block/0/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
350
+ "encoder/block/0/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
351
+ "encoder/block/0/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
352
+ "encoder/block/0/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
353
+ "encoder/block/0/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
354
+ "encoder/block/1/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
355
+ "encoder/block/1/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
356
+ "encoder/block/1/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
357
+ "encoder/block/1/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
358
+ "encoder/block/1/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
359
+ "encoder/block/1/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
360
+ "encoder/block/1/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
361
+ "encoder/block/1/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
362
+ "encoder/block/1/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
363
+ "encoder/block/10/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
364
+ "encoder/block/10/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
365
+ "encoder/block/10/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
366
+ "encoder/block/10/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
367
+ "encoder/block/10/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
368
+ "encoder/block/10/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
369
+ "encoder/block/10/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
370
+ "encoder/block/10/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
371
+ "encoder/block/10/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
372
+ "encoder/block/11/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
373
+ "encoder/block/11/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
374
+ "encoder/block/11/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
375
+ "encoder/block/11/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
376
+ "encoder/block/11/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
377
+ "encoder/block/11/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
378
+ "encoder/block/11/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
379
+ "encoder/block/11/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
380
+ "encoder/block/11/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
381
+ "encoder/block/12/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
382
+ "encoder/block/12/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
383
+ "encoder/block/12/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
384
+ "encoder/block/12/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
385
+ "encoder/block/12/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
386
+ "encoder/block/12/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
387
+ "encoder/block/12/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
388
+ "encoder/block/12/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
389
+ "encoder/block/12/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
390
+ "encoder/block/13/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
391
+ "encoder/block/13/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
392
+ "encoder/block/13/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
393
+ "encoder/block/13/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
394
+ "encoder/block/13/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
395
+ "encoder/block/13/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
396
+ "encoder/block/13/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
397
+ "encoder/block/13/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
398
+ "encoder/block/13/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
399
+ "encoder/block/14/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
400
+ "encoder/block/14/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
401
+ "encoder/block/14/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
402
+ "encoder/block/14/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
403
+ "encoder/block/14/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
404
+ "encoder/block/14/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
405
+ "encoder/block/14/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
406
+ "encoder/block/14/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
407
+ "encoder/block/14/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
408
+ "encoder/block/15/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
409
+ "encoder/block/15/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
410
+ "encoder/block/15/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
411
+ "encoder/block/15/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
412
+ "encoder/block/15/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
413
+ "encoder/block/15/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
414
+ "encoder/block/15/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
415
+ "encoder/block/15/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
416
+ "encoder/block/15/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
417
+ "encoder/block/16/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
418
+ "encoder/block/16/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
419
+ "encoder/block/16/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
420
+ "encoder/block/16/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
421
+ "encoder/block/16/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
422
+ "encoder/block/16/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
423
+ "encoder/block/16/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
424
+ "encoder/block/16/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
425
+ "encoder/block/16/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
426
+ "encoder/block/17/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
427
+ "encoder/block/17/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
428
+ "encoder/block/17/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
429
+ "encoder/block/17/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
430
+ "encoder/block/17/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
431
+ "encoder/block/17/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
432
+ "encoder/block/17/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
433
+ "encoder/block/17/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
434
+ "encoder/block/17/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
435
+ "encoder/block/18/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
436
+ "encoder/block/18/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
437
+ "encoder/block/18/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
438
+ "encoder/block/18/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
439
+ "encoder/block/18/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
440
+ "encoder/block/18/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
441
+ "encoder/block/18/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
442
+ "encoder/block/18/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
443
+ "encoder/block/18/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
444
+ "encoder/block/19/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
445
+ "encoder/block/19/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
446
+ "encoder/block/19/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
447
+ "encoder/block/19/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
448
+ "encoder/block/19/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
449
+ "encoder/block/19/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
450
+ "encoder/block/19/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
451
+ "encoder/block/19/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
452
+ "encoder/block/19/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
453
+ "encoder/block/2/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
454
+ "encoder/block/2/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
455
+ "encoder/block/2/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
456
+ "encoder/block/2/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
457
+ "encoder/block/2/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
458
+ "encoder/block/2/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
459
+ "encoder/block/2/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
460
+ "encoder/block/2/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
461
+ "encoder/block/2/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
462
+ "encoder/block/20/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
463
+ "encoder/block/20/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
464
+ "encoder/block/20/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
465
+ "encoder/block/20/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
466
+ "encoder/block/20/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
467
+ "encoder/block/20/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
468
+ "encoder/block/20/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
469
+ "encoder/block/20/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
470
+ "encoder/block/20/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
471
+ "encoder/block/21/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
472
+ "encoder/block/21/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
473
+ "encoder/block/21/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
474
+ "encoder/block/21/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
475
+ "encoder/block/21/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
476
+ "encoder/block/21/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
477
+ "encoder/block/21/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
478
+ "encoder/block/21/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
479
+ "encoder/block/21/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
480
+ "encoder/block/22/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
481
+ "encoder/block/22/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
482
+ "encoder/block/22/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
483
+ "encoder/block/22/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
484
+ "encoder/block/22/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
485
+ "encoder/block/22/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
486
+ "encoder/block/22/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
487
+ "encoder/block/22/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
488
+ "encoder/block/22/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
489
+ "encoder/block/23/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
490
+ "encoder/block/23/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
491
+ "encoder/block/23/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
492
+ "encoder/block/23/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
493
+ "encoder/block/23/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
494
+ "encoder/block/23/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
495
+ "encoder/block/23/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
496
+ "encoder/block/23/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
497
+ "encoder/block/23/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
498
+ "encoder/block/3/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
499
+ "encoder/block/3/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
500
+ "encoder/block/3/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
501
+ "encoder/block/3/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
502
+ "encoder/block/3/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
503
+ "encoder/block/3/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
504
+ "encoder/block/3/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
505
+ "encoder/block/3/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
506
+ "encoder/block/3/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
507
+ "encoder/block/4/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
508
+ "encoder/block/4/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
509
+ "encoder/block/4/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
510
+ "encoder/block/4/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
511
+ "encoder/block/4/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
512
+ "encoder/block/4/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
513
+ "encoder/block/4/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
514
+ "encoder/block/4/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
515
+ "encoder/block/4/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
516
+ "encoder/block/5/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
517
+ "encoder/block/5/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
518
+ "encoder/block/5/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
519
+ "encoder/block/5/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
520
+ "encoder/block/5/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
521
+ "encoder/block/5/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
522
+ "encoder/block/5/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
523
+ "encoder/block/5/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
524
+ "encoder/block/5/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
525
+ "encoder/block/6/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
526
+ "encoder/block/6/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
527
+ "encoder/block/6/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
528
+ "encoder/block/6/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
529
+ "encoder/block/6/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
530
+ "encoder/block/6/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
531
+ "encoder/block/6/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
532
+ "encoder/block/6/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
533
+ "encoder/block/6/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
534
+ "encoder/block/7/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
535
+ "encoder/block/7/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
536
+ "encoder/block/7/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
537
+ "encoder/block/7/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
538
+ "encoder/block/7/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
539
+ "encoder/block/7/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
540
+ "encoder/block/7/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
541
+ "encoder/block/7/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
542
+ "encoder/block/7/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
543
+ "encoder/block/8/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
544
+ "encoder/block/8/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
545
+ "encoder/block/8/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
546
+ "encoder/block/8/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
547
+ "encoder/block/8/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
548
+ "encoder/block/8/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
549
+ "encoder/block/8/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
550
+ "encoder/block/8/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
551
+ "encoder/block/8/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
552
+ "encoder/block/9/layer/0/SelfAttention/k/kernel": "flax_model-00001-of-00002.msgpack",
553
+ "encoder/block/9/layer/0/SelfAttention/o/kernel": "flax_model-00001-of-00002.msgpack",
554
+ "encoder/block/9/layer/0/SelfAttention/q/kernel": "flax_model-00001-of-00002.msgpack",
555
+ "encoder/block/9/layer/0/SelfAttention/v/kernel": "flax_model-00001-of-00002.msgpack",
556
+ "encoder/block/9/layer/0/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
557
+ "encoder/block/9/layer/1/DenseReluDense/wi_0/kernel": "flax_model-00001-of-00002.msgpack",
558
+ "encoder/block/9/layer/1/DenseReluDense/wi_1/kernel": "flax_model-00001-of-00002.msgpack",
559
+ "encoder/block/9/layer/1/DenseReluDense/wo/kernel": "flax_model-00001-of-00002.msgpack",
560
+ "encoder/block/9/layer/1/layer_norm/weight": "flax_model-00001-of-00002.msgpack",
561
+ "encoder/final_layer_norm/weight": "flax_model-00001-of-00002.msgpack",
562
+ "lm_head/kernel": "flax_model-00002-of-00002.msgpack",
563
+ "shared/embedding": "flax_model-00001-of-00002.msgpack"
564
+ }
565
+ }
generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 0,
4
+ "eos_token_id": 1,
5
+ "pad_token_id": 0,
6
+ "transformers_version": "4.27.0.dev0"
7
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<extra_id_0>",
4
+ "<extra_id_1>",
5
+ "<extra_id_2>",
6
+ "<extra_id_3>",
7
+ "<extra_id_4>",
8
+ "<extra_id_5>",
9
+ "<extra_id_6>",
10
+ "<extra_id_7>",
11
+ "<extra_id_8>",
12
+ "<extra_id_9>",
13
+ "<extra_id_10>",
14
+ "<extra_id_11>",
15
+ "<extra_id_12>",
16
+ "<extra_id_13>",
17
+ "<extra_id_14>",
18
+ "<extra_id_15>",
19
+ "<extra_id_16>",
20
+ "<extra_id_17>",
21
+ "<extra_id_18>",
22
+ "<extra_id_19>",
23
+ "<extra_id_20>",
24
+ "<extra_id_21>",
25
+ "<extra_id_22>",
26
+ "<extra_id_23>",
27
+ "<extra_id_24>",
28
+ "<extra_id_25>",
29
+ "<extra_id_26>",
30
+ "<extra_id_27>",
31
+ "<extra_id_28>",
32
+ "<extra_id_29>",
33
+ "<extra_id_30>",
34
+ "<extra_id_31>",
35
+ "<extra_id_32>",
36
+ "<extra_id_33>",
37
+ "<extra_id_34>",
38
+ "<extra_id_35>",
39
+ "<extra_id_36>",
40
+ "<extra_id_37>",
41
+ "<extra_id_38>",
42
+ "<extra_id_39>",
43
+ "<extra_id_40>",
44
+ "<extra_id_41>",
45
+ "<extra_id_42>",
46
+ "<extra_id_43>",
47
+ "<extra_id_44>",
48
+ "<extra_id_45>",
49
+ "<extra_id_46>",
50
+ "<extra_id_47>",
51
+ "<extra_id_48>",
52
+ "<extra_id_49>",
53
+ "<extra_id_50>",
54
+ "<extra_id_51>",
55
+ "<extra_id_52>",
56
+ "<extra_id_53>",
57
+ "<extra_id_54>",
58
+ "<extra_id_55>",
59
+ "<extra_id_56>",
60
+ "<extra_id_57>",
61
+ "<extra_id_58>",
62
+ "<extra_id_59>",
63
+ "<extra_id_60>",
64
+ "<extra_id_61>",
65
+ "<extra_id_62>",
66
+ "<extra_id_63>",
67
+ "<extra_id_64>",
68
+ "<extra_id_65>",
69
+ "<extra_id_66>",
70
+ "<extra_id_67>",
71
+ "<extra_id_68>",
72
+ "<extra_id_69>",
73
+ "<extra_id_70>",
74
+ "<extra_id_71>",
75
+ "<extra_id_72>",
76
+ "<extra_id_73>",
77
+ "<extra_id_74>",
78
+ "<extra_id_75>",
79
+ "<extra_id_76>",
80
+ "<extra_id_77>",
81
+ "<extra_id_78>",
82
+ "<extra_id_79>",
83
+ "<extra_id_80>",
84
+ "<extra_id_81>",
85
+ "<extra_id_82>",
86
+ "<extra_id_83>",
87
+ "<extra_id_84>",
88
+ "<extra_id_85>",
89
+ "<extra_id_86>",
90
+ "<extra_id_87>",
91
+ "<extra_id_88>",
92
+ "<extra_id_89>",
93
+ "<extra_id_90>",
94
+ "<extra_id_91>",
95
+ "<extra_id_92>",
96
+ "<extra_id_93>",
97
+ "<extra_id_94>",
98
+ "<extra_id_95>",
99
+ "<extra_id_96>",
100
+ "<extra_id_97>",
101
+ "<extra_id_98>",
102
+ "<extra_id_99>"
103
+ ],
104
+ "eos_token": "</s>",
105
+ "pad_token": "<pad>",
106
+ "unk_token": "<unk>"
107
+ }
spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
3
+ size 791656
tf_model.h5.index.json ADDED
@@ -0,0 +1,565 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 11399028736
4
+ },
5
+ "weight_map": {
6
+ "shared/shared/embeddings:0": "tf_model-00001-of-00002.h5",
7
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
8
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
9
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
10
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/SelfAttention/relative_attention_bias/embeddings:0": "tf_model-00001-of-00002.h5",
11
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
12
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
13
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
14
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
15
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
16
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
17
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
18
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
19
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
20
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
21
+ "tft5_for_conditional_generation/decoder/block_._0/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
22
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
23
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
24
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
25
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
26
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
27
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
28
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
29
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
30
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
31
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
32
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
33
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
34
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
35
+ "tft5_for_conditional_generation/decoder/block_._1/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
36
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
37
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
38
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
39
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
40
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
41
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
42
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
43
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
44
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
45
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
46
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
47
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
48
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
49
+ "tft5_for_conditional_generation/decoder/block_._10/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
50
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
51
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
52
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
53
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
54
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
55
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
56
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
57
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
58
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
59
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
60
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
61
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
62
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
63
+ "tft5_for_conditional_generation/decoder/block_._11/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
64
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
65
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
66
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
67
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
68
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
69
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
70
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
71
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
72
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
73
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
74
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
75
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
76
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
77
+ "tft5_for_conditional_generation/decoder/block_._12/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
78
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
79
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
80
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
81
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
82
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
83
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
84
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
85
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
86
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
87
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
88
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
89
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
90
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
91
+ "tft5_for_conditional_generation/decoder/block_._13/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
92
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
93
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
94
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
95
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
96
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
97
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
98
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
99
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
100
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
101
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
102
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
103
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
104
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
105
+ "tft5_for_conditional_generation/decoder/block_._14/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
106
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
107
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
108
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
109
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
110
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
111
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
112
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
113
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
114
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
115
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
116
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
117
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
118
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
119
+ "tft5_for_conditional_generation/decoder/block_._15/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
120
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
121
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
122
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
123
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
124
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
125
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
126
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
127
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
128
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
129
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
130
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
131
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
132
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
133
+ "tft5_for_conditional_generation/decoder/block_._16/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
134
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
135
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
136
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
137
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
138
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
139
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
140
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
141
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
142
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
143
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
144
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
145
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
146
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
147
+ "tft5_for_conditional_generation/decoder/block_._17/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
148
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
149
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
150
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
151
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
152
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
153
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
154
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
155
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
156
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
157
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
158
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
159
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
160
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
161
+ "tft5_for_conditional_generation/decoder/block_._18/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
162
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
163
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
164
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
165
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
166
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
167
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
168
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
169
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
170
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
171
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
172
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00002-of-00002.h5",
173
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00002-of-00002.h5",
174
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00002-of-00002.h5",
175
+ "tft5_for_conditional_generation/decoder/block_._19/layer_._2/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
176
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
177
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
178
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
179
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
180
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
181
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
182
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
183
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
184
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
185
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
186
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
187
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
188
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
189
+ "tft5_for_conditional_generation/decoder/block_._2/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
190
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._0/SelfAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
191
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._0/SelfAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
192
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._0/SelfAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
193
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._0/SelfAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
194
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._0/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
195
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
196
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
197
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
198
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
199
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._1/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
200
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00002-of-00002.h5",
201
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00002-of-00002.h5",
202
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00002-of-00002.h5",
203
+ "tft5_for_conditional_generation/decoder/block_._20/layer_._2/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
204
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._0/SelfAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
205
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._0/SelfAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
206
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._0/SelfAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
207
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._0/SelfAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
208
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._0/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
209
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
210
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
211
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
212
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
213
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._1/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
214
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00002-of-00002.h5",
215
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00002-of-00002.h5",
216
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00002-of-00002.h5",
217
+ "tft5_for_conditional_generation/decoder/block_._21/layer_._2/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
218
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._0/SelfAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
219
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._0/SelfAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
220
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._0/SelfAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
221
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._0/SelfAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
222
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._0/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
223
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
224
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
225
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
226
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
227
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._1/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
228
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00002-of-00002.h5",
229
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00002-of-00002.h5",
230
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00002-of-00002.h5",
231
+ "tft5_for_conditional_generation/decoder/block_._22/layer_._2/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
232
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._0/SelfAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
233
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._0/SelfAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
234
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._0/SelfAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
235
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._0/SelfAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
236
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._0/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
237
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00002-of-00002.h5",
238
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00002-of-00002.h5",
239
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00002-of-00002.h5",
240
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00002-of-00002.h5",
241
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._1/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
242
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00002-of-00002.h5",
243
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00002-of-00002.h5",
244
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00002-of-00002.h5",
245
+ "tft5_for_conditional_generation/decoder/block_._23/layer_._2/layer_norm/weight:0": "tf_model-00002-of-00002.h5",
246
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
247
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
248
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
249
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
250
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
251
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
252
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
253
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
254
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
255
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
256
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
257
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
258
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
259
+ "tft5_for_conditional_generation/decoder/block_._3/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
260
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
261
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
262
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
263
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
264
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
265
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
266
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
267
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
268
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
269
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
270
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
271
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
272
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
273
+ "tft5_for_conditional_generation/decoder/block_._4/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
274
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
275
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
276
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
277
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
278
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
279
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
280
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
281
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
282
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
283
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
284
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
285
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
286
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
287
+ "tft5_for_conditional_generation/decoder/block_._5/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
288
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
289
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
290
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
291
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
292
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
293
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
294
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
295
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
296
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
297
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
298
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
299
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
300
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
301
+ "tft5_for_conditional_generation/decoder/block_._6/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
302
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
303
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
304
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
305
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
306
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
307
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
308
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
309
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
310
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
311
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
312
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
313
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
314
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
315
+ "tft5_for_conditional_generation/decoder/block_._7/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
316
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
317
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
318
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
319
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
320
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
321
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
322
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
323
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
324
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
325
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
326
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
327
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
328
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
329
+ "tft5_for_conditional_generation/decoder/block_._8/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
330
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
331
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
332
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
333
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
334
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
335
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._1/EncDecAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
336
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._1/EncDecAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
337
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._1/EncDecAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
338
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._1/EncDecAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
339
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
340
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._2/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
341
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._2/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
342
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._2/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
343
+ "tft5_for_conditional_generation/decoder/block_._9/layer_._2/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
344
+ "tft5_for_conditional_generation/decoder/final_layer_norm/weight:0": "tf_model-00002-of-00002.h5",
345
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
346
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
347
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
348
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/SelfAttention/relative_attention_bias/embeddings:0": "tf_model-00001-of-00002.h5",
349
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
350
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
351
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
352
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
353
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
354
+ "tft5_for_conditional_generation/encoder/block_._0/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
355
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
356
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
357
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
358
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
359
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
360
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
361
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
362
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
363
+ "tft5_for_conditional_generation/encoder/block_._1/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
364
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
365
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
366
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
367
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
368
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
369
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
370
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
371
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
372
+ "tft5_for_conditional_generation/encoder/block_._10/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
373
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
374
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
375
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
376
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
377
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
378
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
379
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
380
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
381
+ "tft5_for_conditional_generation/encoder/block_._11/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
382
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
383
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
384
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
385
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
386
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
387
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
388
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
389
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
390
+ "tft5_for_conditional_generation/encoder/block_._12/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
391
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
392
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
393
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
394
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
395
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
396
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
397
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
398
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
399
+ "tft5_for_conditional_generation/encoder/block_._13/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
400
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
401
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
402
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
403
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
404
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
405
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
406
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
407
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
408
+ "tft5_for_conditional_generation/encoder/block_._14/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
409
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
410
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
411
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
412
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
413
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
414
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
415
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
416
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
417
+ "tft5_for_conditional_generation/encoder/block_._15/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
418
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
419
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
420
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
421
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
422
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
423
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
424
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
425
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
426
+ "tft5_for_conditional_generation/encoder/block_._16/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
427
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
428
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
429
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
430
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
431
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
432
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
433
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
434
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
435
+ "tft5_for_conditional_generation/encoder/block_._17/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
436
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
437
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
438
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
439
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
440
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
441
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
442
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
443
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
444
+ "tft5_for_conditional_generation/encoder/block_._18/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
445
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
446
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
447
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
448
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
449
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
450
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
451
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
452
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
453
+ "tft5_for_conditional_generation/encoder/block_._19/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
454
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
455
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
456
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
457
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
458
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
459
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
460
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
461
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
462
+ "tft5_for_conditional_generation/encoder/block_._2/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
463
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
464
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
465
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
466
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
467
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
468
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
469
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
470
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
471
+ "tft5_for_conditional_generation/encoder/block_._20/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
472
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
473
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
474
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
475
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
476
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
477
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
478
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
479
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
480
+ "tft5_for_conditional_generation/encoder/block_._21/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
481
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
482
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
483
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
484
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
485
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
486
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
487
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
488
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
489
+ "tft5_for_conditional_generation/encoder/block_._22/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
490
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
491
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
492
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
493
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
494
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
495
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
496
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
497
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
498
+ "tft5_for_conditional_generation/encoder/block_._23/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
499
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
500
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
501
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
502
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
503
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
504
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
505
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
506
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
507
+ "tft5_for_conditional_generation/encoder/block_._3/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
508
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
509
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
510
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
511
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
512
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
513
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
514
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
515
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
516
+ "tft5_for_conditional_generation/encoder/block_._4/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
517
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
518
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
519
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
520
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
521
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
522
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
523
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
524
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
525
+ "tft5_for_conditional_generation/encoder/block_._5/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
526
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
527
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
528
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
529
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
530
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
531
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
532
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
533
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
534
+ "tft5_for_conditional_generation/encoder/block_._6/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
535
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
536
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
537
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
538
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
539
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
540
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
541
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
542
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
543
+ "tft5_for_conditional_generation/encoder/block_._7/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
544
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
545
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
546
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
547
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
548
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
549
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
550
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
551
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
552
+ "tft5_for_conditional_generation/encoder/block_._8/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
553
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._0/SelfAttention/k/kernel:0": "tf_model-00001-of-00002.h5",
554
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._0/SelfAttention/o/kernel:0": "tf_model-00001-of-00002.h5",
555
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._0/SelfAttention/q/kernel:0": "tf_model-00001-of-00002.h5",
556
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._0/SelfAttention/v/kernel:0": "tf_model-00001-of-00002.h5",
557
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._0/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
558
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._1/DenseReluDense/wi_0/kernel:0": "tf_model-00001-of-00002.h5",
559
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._1/DenseReluDense/wi_1/kernel:0": "tf_model-00001-of-00002.h5",
560
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._1/DenseReluDense/wo/kernel:0": "tf_model-00001-of-00002.h5",
561
+ "tft5_for_conditional_generation/encoder/block_._9/layer_._1/layer_norm/weight:0": "tf_model-00001-of-00002.h5",
562
+ "tft5_for_conditional_generation/encoder/final_layer_norm/weight:0": "tf_model-00001-of-00002.h5",
563
+ "tft5_for_conditional_generation/lm_head/kernel:0": "tf_model-00002-of-00002.h5"
564
+ }
565
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<extra_id_0>",
4
+ "<extra_id_1>",
5
+ "<extra_id_2>",
6
+ "<extra_id_3>",
7
+ "<extra_id_4>",
8
+ "<extra_id_5>",
9
+ "<extra_id_6>",
10
+ "<extra_id_7>",
11
+ "<extra_id_8>",
12
+ "<extra_id_9>",
13
+ "<extra_id_10>",
14
+ "<extra_id_11>",
15
+ "<extra_id_12>",
16
+ "<extra_id_13>",
17
+ "<extra_id_14>",
18
+ "<extra_id_15>",
19
+ "<extra_id_16>",
20
+ "<extra_id_17>",
21
+ "<extra_id_18>",
22
+ "<extra_id_19>",
23
+ "<extra_id_20>",
24
+ "<extra_id_21>",
25
+ "<extra_id_22>",
26
+ "<extra_id_23>",
27
+ "<extra_id_24>",
28
+ "<extra_id_25>",
29
+ "<extra_id_26>",
30
+ "<extra_id_27>",
31
+ "<extra_id_28>",
32
+ "<extra_id_29>",
33
+ "<extra_id_30>",
34
+ "<extra_id_31>",
35
+ "<extra_id_32>",
36
+ "<extra_id_33>",
37
+ "<extra_id_34>",
38
+ "<extra_id_35>",
39
+ "<extra_id_36>",
40
+ "<extra_id_37>",
41
+ "<extra_id_38>",
42
+ "<extra_id_39>",
43
+ "<extra_id_40>",
44
+ "<extra_id_41>",
45
+ "<extra_id_42>",
46
+ "<extra_id_43>",
47
+ "<extra_id_44>",
48
+ "<extra_id_45>",
49
+ "<extra_id_46>",
50
+ "<extra_id_47>",
51
+ "<extra_id_48>",
52
+ "<extra_id_49>",
53
+ "<extra_id_50>",
54
+ "<extra_id_51>",
55
+ "<extra_id_52>",
56
+ "<extra_id_53>",
57
+ "<extra_id_54>",
58
+ "<extra_id_55>",
59
+ "<extra_id_56>",
60
+ "<extra_id_57>",
61
+ "<extra_id_58>",
62
+ "<extra_id_59>",
63
+ "<extra_id_60>",
64
+ "<extra_id_61>",
65
+ "<extra_id_62>",
66
+ "<extra_id_63>",
67
+ "<extra_id_64>",
68
+ "<extra_id_65>",
69
+ "<extra_id_66>",
70
+ "<extra_id_67>",
71
+ "<extra_id_68>",
72
+ "<extra_id_69>",
73
+ "<extra_id_70>",
74
+ "<extra_id_71>",
75
+ "<extra_id_72>",
76
+ "<extra_id_73>",
77
+ "<extra_id_74>",
78
+ "<extra_id_75>",
79
+ "<extra_id_76>",
80
+ "<extra_id_77>",
81
+ "<extra_id_78>",
82
+ "<extra_id_79>",
83
+ "<extra_id_80>",
84
+ "<extra_id_81>",
85
+ "<extra_id_82>",
86
+ "<extra_id_83>",
87
+ "<extra_id_84>",
88
+ "<extra_id_85>",
89
+ "<extra_id_86>",
90
+ "<extra_id_87>",
91
+ "<extra_id_88>",
92
+ "<extra_id_89>",
93
+ "<extra_id_90>",
94
+ "<extra_id_91>",
95
+ "<extra_id_92>",
96
+ "<extra_id_93>",
97
+ "<extra_id_94>",
98
+ "<extra_id_95>",
99
+ "<extra_id_96>",
100
+ "<extra_id_97>",
101
+ "<extra_id_98>",
102
+ "<extra_id_99>"
103
+ ],
104
+ "eos_token": "</s>",
105
+ "extra_ids": 100,
106
+ "model_max_length": 512,
107
+ "name_or_path": "google/t5-v1_1-small",
108
+ "pad_token": "<pad>",
109
+ "sp_model_kwargs": {},
110
+ "special_tokens_map_file": "/home/arthur_huggingface_co/.cache/huggingface/hub/models--google--t5-v1_1-small/snapshots/fb7e6cba609f7bab11c614294bc04f82f613c7b1/special_tokens_map.json",
111
+ "tokenizer_class": "T5Tokenizer",
112
+ "unk_token": "<unk>"
113
+ }