\u001b[0;34m()\u001b[0m\n\u001b[1;32m 1\u001b[0m vectorized_train_datasets[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtrain\u001b[39m\u001b[38;5;124m\"\u001b[39m] \u001b[38;5;241m=\u001b[39m vectorized_train_datasets[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtrain\u001b[39m\u001b[38;5;124m\"\u001b[39m]\u001b[38;5;241m.\u001b[39mfilter(\n\u001b[0;32m----> 2\u001b[0m \u001b[43mis_audio_in_length_range\u001b[49m,\n\u001b[1;32m 3\u001b[0m input_columns\u001b[38;5;241m=\u001b[39m[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124minput_length\u001b[39m\u001b[38;5;124m\"\u001b[39m],\n\u001b[1;32m 4\u001b[0m batched\u001b[38;5;241m=\u001b[39m\u001b[38;5;28;01mTrue\u001b[39;00m,\n\u001b[1;32m 5\u001b[0m batch_size\u001b[38;5;241m=\u001b[39m\u001b[38;5;241m100\u001b[39m\n\u001b[1;32m 6\u001b[0m )\n",
"\u001b[0;31mNameError\u001b[0m: name 'is_audio_in_length_range' is not defined"
]
}
],
"source": [
"vectorized_train_datasets[\"train\"] = vectorized_train_datasets[\"train\"].filter(\n",
" is_audio_in_length_range,\n",
" input_columns=[\"input_length\"],\n",
" batched=True,\n",
" batch_size=100\n",
")"
]
},
{
"cell_type": "markdown",
"id": "263a5a58-0239-4a25-b0df-c625fc9c5810",
"metadata": {},
"source": [
"## Training and Evaluation"
]
},
{
"cell_type": "markdown",
"id": "a693e768-c5a6-453f-89a1-b601dcf7daf7",
"metadata": {},
"source": [
"Now that we've prepared our data, we're ready to dive into the training pipeline. \n",
"The [π€ Trainer](https://huggingface.co/transformers/master/main_classes/trainer.html?highlight=trainer)\n",
"will do much of the heavy lifting for us. All we have to do is:\n",
"\n",
"- Define a data collator: the data collator takes our pre-processed data and prepares PyTorch tensors ready for the model.\n",
"\n",
"- Evaluation metrics: during evaluation, we want to evaluate the model using the [word error rate (WER)](https://huggingface.co/metrics/wer) metric. We need to define a `compute_metrics` function that handles this computation.\n",
"\n",
"- Load a pre-trained checkpoint: we need to load a pre-trained checkpoint and configure it correctly for training.\n",
"\n",
"- Define the training configuration: this will be used by the π€ Trainer to define the training schedule."
]
},
{
"cell_type": "markdown",
"id": "8d230e6d-624c-400a-bbf5-fa660881df25",
"metadata": {},
"source": [
"### Define a Data Collator"
]
},
{
"cell_type": "markdown",
"id": "04def221-0637-4a69-b242-d3f0c1d0ee78",
"metadata": {},
"source": [
"The data collator for a sequence-to-sequence speech model is unique in the sense that it \n",
"treats the `input_features` and `labels` independently: the `input_features` must be \n",
"handled by the feature extractor and the `labels` by the tokenizer.\n",
"\n",
"The `input_features` are already padded to 30s and converted to a log-Mel spectrogram \n",
"of fixed dimension by action of the feature extractor, so all we have to do is convert the `input_features`\n",
"to batched PyTorch tensors. We do this using the feature extractor's `.pad` method with `return_tensors=pt`.\n",
"\n",
"The `labels` on the other hand are un-padded. We first pad the sequences\n",
"to the maximum length in the batch using the tokenizer's `.pad` method. The padding tokens \n",
"are then replaced by `-100` so that these tokens are **not** taken into account when \n",
"computing the loss. We then cut the BOS token from the start of the label sequence as we \n",
"append it later during training.\n",
"\n",
"We can leverage the `WhisperProcessor` we defined earlier to perform both the \n",
"feature extractor and the tokenizer operations:"
]
},
{
"cell_type": "code",
"execution_count": 15,
"id": "8326221e-ec13-4731-bb4e-51e5fc1486c5",
"metadata": {},
"outputs": [],
"source": [
"import torch\n",
"\n",
"from dataclasses import dataclass\n",
"from typing import Any, Dict, List, Union\n",
"\n",
"@dataclass\n",
"class DataCollatorSpeechSeq2SeqWithPadding:\n",
" processor: Any\n",
"\n",
" def __call__(self, features: List[Dict[str, Union[List[int], torch.Tensor]]]) -> Dict[str, torch.Tensor]:\n",
" # split inputs and labels since they have to be of different lengths and need different padding methods\n",
" # first treat the audio inputs by simply returning torch tensors\n",
" input_features = [{\"input_features\": feature[\"input_features\"]} for feature in features]\n",
" batch = self.processor.feature_extractor.pad(input_features, return_tensors=\"pt\")\n",
"\n",
" # get the tokenized label sequences\n",
" label_features = [{\"input_ids\": feature[\"labels\"]} for feature in features]\n",
" # pad the labels to max length\n",
" labels_batch = self.processor.tokenizer.pad(label_features, return_tensors=\"pt\")\n",
"\n",
" # replace padding with -100 to ignore loss correctly\n",
" labels = labels_batch[\"input_ids\"].masked_fill(labels_batch.attention_mask.ne(1), -100)\n",
"\n",
" # if bos token is appended in previous tokenization step,\n",
" # cut bos token here as it's append later anyways\n",
" if (labels[:, 0] == self.processor.tokenizer.bos_token_id).all().cpu().item():\n",
" labels = labels[:, 1:]\n",
"\n",
" batch[\"labels\"] = labels\n",
"\n",
" return batch"
]
},
{
"cell_type": "markdown",
"id": "3cae7dbf-8a50-456e-a3a8-7fd005390f86",
"metadata": {},
"source": [
"Let's initialise the data collator we've just defined:"
]
},
{
"cell_type": "code",
"execution_count": 16,
"id": "fc834702-c0d3-4a96-b101-7b87be32bf42",
"metadata": {},
"outputs": [],
"source": [
"data_collator = DataCollatorSpeechSeq2SeqWithPadding(processor=processor)"
]
},
{
"cell_type": "markdown",
"id": "d62bb2ab-750a-45e7-82e9-61d6f4805698",
"metadata": {},
"source": [
"### Evaluation Metrics"
]
},
{
"cell_type": "markdown",
"id": "66fee1a7-a44c-461e-b047-c3917221572e",
"metadata": {},
"source": [
"We'll use the word error rate (WER) metric, the 'de-facto' metric for assessing \n",
"ASR systems. For more information, refer to the WER [docs](https://huggingface.co/metrics/wer). We'll load the WER metric from π€ Evaluate:"
]
},
{
"cell_type": "code",
"execution_count": 17,
"id": "b22b4011-f31f-4b57-b684-c52332f92890",
"metadata": {},
"outputs": [],
"source": [
"import evaluate\n",
"\n",
"#metric = evaluate.load(\"wer\")\n",
"metric = evaluate.load(\"cer\")"
]
},
{
"cell_type": "markdown",
"id": "509f96d7-3f11-4f37-add9-f74a0c44f3fc",
"metadata": {},
"source": [
"We then simply have to define a function that takes our model \n",
"predictions and returns the WER metric. This function, called\n",
"`compute_metrics`, first replaces `-100` with the `pad_token_id`\n",
"in the `label_ids` (undoing the step we applied in the \n",
"data collator to ignore padded tokens correctly in the loss).\n",
"It then decodes the predicted and label ids to strings. Finally,\n",
"it computes the WER between the predictions and reference labels. \n",
"Here, we have the option of evaluating with the 'normalised' transcriptions \n",
"and predictions. We recommend you set this to `True` to benefit from the WER \n",
"improvement obtained by normalising the transcriptions."
]
},
{
"cell_type": "code",
"execution_count": 18,
"id": "a11d1bfc-9e28-460f-a287-72d8f7bc1acb",
"metadata": {},
"outputs": [],
"source": [
"#Β evaluate with the 'normalised' WER\n",
"do_normalize_eval = True\n",
"\n",
"def compute_metrics(pred):\n",
" pred_ids = pred.predictions\n",
" label_ids = pred.label_ids\n",
"\n",
" # replace -100 with the pad_token_id\n",
" label_ids[label_ids == -100] = processor.tokenizer.pad_token_id\n",
"\n",
" # we do not want to group tokens when computing the metrics\n",
" pred_str = processor.tokenizer.batch_decode(pred_ids, skip_special_tokens=True)\n",
" label_str = processor.tokenizer.batch_decode(label_ids, skip_special_tokens=True)\n",
"\n",
" if do_normalize_eval:\n",
" pred_str = [normalizer(pred) for pred in pred_str]\n",
" label_str = [normalizer(label) for label in label_str]\n",
" # filtering step to only evaluate the samples that correspond to non-zero references:\n",
" pred_str = [pred_str[i] for i in range(len(pred_str)) if len(label_str[i]) > 0]\n",
" label_str = [label_str[i] for i in range(len(label_str)) if len(label_str[i]) > 0]\n",
"\n",
" cer = 100 * metric.compute(predictions=pred_str, references=label_str)\n",
"\n",
" return {\"cer\": cer}"
]
},
{
"cell_type": "markdown",
"id": "daf2a825-6d9f-4a23-b145-c37c0039075b",
"metadata": {},
"source": [
"###Β Load a Pre-Trained Checkpoint"
]
},
{
"cell_type": "markdown",
"id": "437a97fa-4864-476b-8abc-f28b8166cfa5",
"metadata": {},
"source": [
"Now let's load the pre-trained Whisper `small` checkpoint. Again, this \n",
"is trivial through use of π€ Transformers!"
]
},
{
"cell_type": "code",
"execution_count": 19,
"id": "5a10cc4b-07ec-4ebd-ac1d-7c601023594f",
"metadata": {},
"outputs": [],
"source": [
"from transformers import WhisperForConditionalGeneration\n",
"\n",
"model = WhisperForConditionalGeneration.from_pretrained(\"openai/whisper-small\")"
]
},
{
"cell_type": "markdown",
"id": "a15ead5f-2277-4a39-937b-585c2497b2df",
"metadata": {},
"source": [
"Override generation arguments - no tokens are forced as decoder outputs (see [`forced_decoder_ids`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.forced_decoder_ids)), no tokens are suppressed during generation (see [`suppress_tokens`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.suppress_tokens)). Set `use_cache` to False since we're using gradient checkpointing, and the two are incompatible:"
]
},
{
"cell_type": "code",
"execution_count": 20,
"id": "62038ba3-88ed-4fce-84db-338f50dcd04f",
"metadata": {},
"outputs": [],
"source": [
"model.config.forced_decoder_ids = None\n",
"model.config.suppress_tokens = []\n",
"model.config.use_cache = False"
]
},
{
"cell_type": "markdown",
"id": "2178dea4-80ca-47b6-b6ea-ba1915c90c06",
"metadata": {},
"source": [
"### Define the Training Configuration"
]
},
{
"cell_type": "markdown",
"id": "c21af1e9-0188-4134-ac82-defc7bdcc436",
"metadata": {},
"source": [
"In the final step, we define all the parameters related to training. Here, you can set the `max_steps` to train for longer. For more detail on the training arguments, refer to the Seq2SeqTrainingArguments [docs](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments)."
]
},
{
"cell_type": "code",
"execution_count": 21,
"id": "0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a",
"metadata": {},
"outputs": [],
"source": [
"from transformers import Seq2SeqTrainingArguments\n",
"\n",
"training_args = Seq2SeqTrainingArguments(\n",
" output_dir=\"./\",\n",
" per_device_train_batch_size=4,\n",
" gradient_accumulation_steps=1, # increase by 2x for every 2x decrease in batch size\n",
" learning_rate=1e-5,\n",
" warmup_steps=500,\n",
" max_steps=5000,\n",
" gradient_checkpointing=True,\n",
" fp16=True,\n",
" evaluation_strategy=\"steps\",\n",
" per_device_eval_batch_size=8,\n",
" predict_with_generate=True,\n",
" generation_max_length=225,\n",
" save_steps=1000,\n",
" eval_steps=1000,\n",
" logging_steps=25,\n",
" report_to=[\"tensorboard\"],\n",
" load_best_model_at_end=True,\n",
" metric_for_best_model=\"cer\",\n",
" greater_is_better=False,\n",
" push_to_hub=True,\n",
")"
]
},
{
"cell_type": "markdown",
"id": "b3a944d8-3112-4552-82a0-be25988b3857",
"metadata": {},
"source": [
"**Note**: if one does not want to upload the model checkpoints to the Hub, \n",
"set `push_to_hub=False`."
]
},
{
"cell_type": "markdown",
"id": "393c883e-3e50-492c-bd58-f51dbf15ee56",
"metadata": {},
"source": [
"We then define a custom [Callback](https://huggingface.co/docs/transformers/main_classes/callback) that is called by the π€ Trainer on the end of each epoch. The Callback reinitialises and reshuffles the streaming dataset at the beginning of each new epoch - this gives different shuffling across our subsets for every epoch."
]
},
{
"cell_type": "code",
"execution_count": 22,
"id": "3ac16b62-b3c0-4c68-8f3d-9ecf471534b2",
"metadata": {},
"outputs": [],
"source": [
"from transformers import TrainerCallback\n",
"from transformers.trainer_pt_utils import IterableDatasetShard\n",
"from torch.utils.data import IterableDataset\n",
"\n",
"# trainer callback to reinitialise and reshuffle the streamable datasets at the beginning of each epoch\n",
"class ShuffleCallback(TrainerCallback):\n",
" def on_epoch_begin(self, args, state, control, train_dataloader, **kwargs):\n",
" if isinstance(train_dataloader.dataset, IterableDatasetShard):\n",
" pass # set_epoch() is handled by the Trainer\n",
" elif isinstance(train_dataloader.dataset, IterableDataset):\n",
" train_dataloader.dataset.set_epoch(train_dataloader.dataset._epoch + 1)"
]
},
{
"cell_type": "markdown",
"id": "bac29114-d226-4f54-97cf-8718c9f94e1e",
"metadata": {},
"source": [
"We can forward the training arguments to the π€ Trainer along with our model,\n",
"dataset, data collator, `compute_metrics` function and custom callback:"
]
},
{
"cell_type": "code",
"execution_count": 23,
"id": "d546d7fe-0543-479a-b708-2ebabec19493",
"metadata": {},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"/home/lorenzoncina/Documents/WIPO/code/whisper_finetune/whisper-small-ja/./ is already a clone of https://huggingface.co/lorenzoncina/whisper-small-ja. Make sure you pull the latest changes with `repo.git_pull()`.\n",
"max_steps is given, it will override any value given in num_train_epochs\n",
"Using cuda_amp half precision backend\n"
]
}
],
"source": [
"from transformers import Seq2SeqTrainer\n",
"\n",
"trainer = Seq2SeqTrainer(\n",
" args=training_args,\n",
" model=model,\n",
" train_dataset=vectorized_train_datasets[\"train\"],\n",
" eval_dataset=vectorized_eval_datasets[\"test\"],\n",
" data_collator=data_collator,\n",
" compute_metrics=compute_metrics,\n",
" tokenizer=processor,\n",
" callbacks=[ShuffleCallback()],\n",
")"
]
},
{
"cell_type": "markdown",
"id": "67ab88c3-7091-4e51-8ad5-f5cacbe18449",
"metadata": {},
"source": [
"We'll save the model and processor to the output directory before training:"
]
},
{
"cell_type": "code",
"execution_count": 24,
"id": "a1ccb9ed-cbc8-4419-91c0-651e9424b672",
"metadata": {},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"Configuration saved in ./config.json\n",
"Model weights saved in ./pytorch_model.bin\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n"
]
}
],
"source": [
"model.save_pretrained(training_args.output_dir)\n",
"processor.save_pretrained(training_args.output_dir)"
]
},
{
"cell_type": "markdown",
"id": "7f404cf9-4345-468c-8196-4bd101d9bd51",
"metadata": {},
"source": [
"### Training"
]
},
{
"cell_type": "markdown",
"id": "5e8b8d56-5a70-4f68-bd2e-f0752d0bd112",
"metadata": {},
"source": [
"Training will take approximately 5-10 hours depending on your GPU. The peak GPU memory for the given training configuration is approximately 36GB. \n",
"Depending on your GPU, it is possible that you will encounter a CUDA `\"out-of-memory\"` error when you launch training. \n",
"In this case, you can reduce the `per_device_train_batch_size` incrementally by factors of 2 \n",
"and employ [`gradient_accumulation_steps`](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments.gradient_accumulation_steps)\n",
"to compensate.\n",
"\n",
"To launch training, simply execute:"
]
},
{
"cell_type": "code",
"execution_count": 25,
"id": "ee8b7b8e-1c9a-4d77-9137-1778a629e6de",
"metadata": {
"scrolled": true
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"The following columns in the training set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
"/home/lorenzoncina/miniconda3/envs/whisper_sprint/lib/python3.10/site-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n",
" warnings.warn(\n",
"***** Running training *****\n",
" Num examples = 11982\n",
" Num Epochs = 2\n",
" Instantaneous batch size per device = 4\n",
" Total train batch size (w. parallel, distributed & accumulation) = 4\n",
" Gradient Accumulation steps = 1\n",
" Total optimization steps = 5000\n",
" Number of trainable parameters = 241734912\n"
]
},
{
"data": {
"text/html": [
"\n",
" \n",
" \n",
" \n",
" [5000/5000 6:05:36, Epoch 1/2]\n",
" \n",
" \n",
" \n",
" \n",
" Step | \n",
" Training Loss | \n",
" Validation Loss | \n",
" Cer | \n",
" \n",
" \n",
" \n",
" \n",
" 1000 | \n",
" 0.068200 | \n",
" 0.609830 | \n",
" 19.913343 | \n",
" \n",
" \n",
" 2000 | \n",
" 0.022900 | \n",
" 0.550079 | \n",
" 18.191102 | \n",
" \n",
" \n",
" 3000 | \n",
" 0.045700 | \n",
" 0.574486 | \n",
" 19.317449 | \n",
" \n",
" \n",
" 4000 | \n",
" 0.012300 | \n",
" 0.531459 | \n",
" 18.254558 | \n",
" \n",
" \n",
" 5000 | \n",
" 0.023800 | \n",
" 0.559558 | \n",
" 17.726087 | \n",
" \n",
" \n",
" "
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"***** Running Evaluation *****\n",
" Num examples: Unknown\n",
" Batch size = 8\n",
"Reading metadata...: 4604it [00:00, 7716.36it/s]\n",
"The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"/home/lorenzoncina/miniconda3/envs/whisper_sprint/lib/python3.10/site-packages/transformers/generation/utils.py:1147: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation)\n",
" warnings.warn(\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Saving model checkpoint to ./checkpoint-1000\n",
"Configuration saved in ./checkpoint-1000/config.json\n",
"Model weights saved in ./checkpoint-1000/pytorch_model.bin\n",
"Feature extractor saved in ./checkpoint-1000/preprocessor_config.json\n",
"tokenizer config file saved in ./checkpoint-1000/tokenizer_config.json\n",
"Special tokens file saved in ./checkpoint-1000/special_tokens_map.json\n",
"added tokens file saved in ./checkpoint-1000/added_tokens.json\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"***** Running Evaluation *****\n",
" Num examples: Unknown\n",
" Batch size = 8\n",
"Reading metadata...: 4604it [00:00, 7898.51it/s]\n",
"The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Saving model checkpoint to ./checkpoint-2000\n",
"Configuration saved in ./checkpoint-2000/config.json\n",
"Model weights saved in ./checkpoint-2000/pytorch_model.bin\n",
"Feature extractor saved in ./checkpoint-2000/preprocessor_config.json\n",
"tokenizer config file saved in ./checkpoint-2000/tokenizer_config.json\n",
"Special tokens file saved in ./checkpoint-2000/special_tokens_map.json\n",
"added tokens file saved in ./checkpoint-2000/added_tokens.json\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"***** Running Evaluation *****\n",
" Num examples: Unknown\n",
" Batch size = 8\n",
"Reading metadata...: 4604it [00:00, 10158.58it/s]\n",
"The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Saving model checkpoint to ./checkpoint-3000\n",
"Configuration saved in ./checkpoint-3000/config.json\n",
"Model weights saved in ./checkpoint-3000/pytorch_model.bin\n",
"Feature extractor saved in ./checkpoint-3000/preprocessor_config.json\n",
"tokenizer config file saved in ./checkpoint-3000/tokenizer_config.json\n",
"Special tokens file saved in ./checkpoint-3000/special_tokens_map.json\n",
"added tokens file saved in ./checkpoint-3000/added_tokens.json\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"***** Running Evaluation *****\n",
" Num examples: Unknown\n",
" Batch size = 8\n",
"Reading metadata...: 4604it [00:00, 6404.46it/s]\n",
"The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Saving model checkpoint to ./checkpoint-4000\n",
"Configuration saved in ./checkpoint-4000/config.json\n",
"Model weights saved in ./checkpoint-4000/pytorch_model.bin\n",
"Feature extractor saved in ./checkpoint-4000/preprocessor_config.json\n",
"tokenizer config file saved in ./checkpoint-4000/tokenizer_config.json\n",
"Special tokens file saved in ./checkpoint-4000/special_tokens_map.json\n",
"added tokens file saved in ./checkpoint-4000/added_tokens.json\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"***** Running Evaluation *****\n",
" Num examples: Unknown\n",
" Batch size = 8\n",
"Reading metadata...: 4604it [00:00, 7341.16it/s]\n",
"The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Generate config GenerationConfig {\n",
" \"begin_suppress_tokens\": [\n",
" 220,\n",
" 50257\n",
" ],\n",
" \"bos_token_id\": 50257,\n",
" \"decoder_start_token_id\": 50258,\n",
" \"eos_token_id\": 50257,\n",
" \"max_length\": 448,\n",
" \"pad_token_id\": 50257,\n",
" \"suppress_tokens\": [],\n",
" \"transformers_version\": \"4.26.0.dev0\",\n",
" \"use_cache\": false\n",
"}\n",
"\n",
"Saving model checkpoint to ./checkpoint-5000\n",
"Configuration saved in ./checkpoint-5000/config.json\n",
"Model weights saved in ./checkpoint-5000/pytorch_model.bin\n",
"Feature extractor saved in ./checkpoint-5000/preprocessor_config.json\n",
"tokenizer config file saved in ./checkpoint-5000/tokenizer_config.json\n",
"Special tokens file saved in ./checkpoint-5000/special_tokens_map.json\n",
"added tokens file saved in ./checkpoint-5000/added_tokens.json\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"\n",
"\n",
"Training completed. Do not forget to share your model on huggingface.co/models =)\n",
"\n",
"\n",
"Loading best model from ./checkpoint-5000 (score: 17.72608743071874).\n"
]
},
{
"data": {
"text/plain": [
"TrainOutput(global_step=5000, training_loss=0.08154704121649266, metrics={'train_runtime': 21939.4127, 'train_samples_per_second': 0.912, 'train_steps_per_second': 0.228, 'total_flos': 5.77113083559936e+18, 'train_loss': 0.08154704121649266, 'epoch': 1.67})"
]
},
"execution_count": 25,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"\n",
"trainer.train()"
]
},
{
"cell_type": "markdown",
"id": "747c6a6e",
"metadata": {
"pycharm": {
"name": "#%% md\n"
}
},
"source": [
"(note that training may take some time to commence as we load the first training data samples with streaming mode)"
]
},
{
"cell_type": "markdown",
"id": "810ced54-7187-4a06-b2fe-ba6dcca94dc3",
"metadata": {},
"source": [
"We can label our checkpoint with the `whisper-event` tag on push by setting the appropriate key-word arguments (kwargs):"
]
},
{
"cell_type": "code",
"execution_count": 26,
"id": "6dd0e310-9b07-4133-ac14-2ed2d7524e22",
"metadata": {},
"outputs": [],
"source": [
"kwargs = {\n",
" \"dataset_tags\": \"mozilla-foundation/common_voice_11_0\",\n",
" \"dataset\": \"Common Voice 11.0\", # a 'pretty' name for the training dataset\n",
" \"language\": \"ja\",\n",
" \"model_name\": \"Whisper Small JA - Lorenzo Concina\", # a 'pretty' name for your model\n",
" \"finetuned_from\": \"SVJ Japanese dataset\",\n",
" \"tasks\": \"automatic-speech-recognition\",\n",
" \"tags\": \"whisper-event\",\n",
"}"
]
},
{
"cell_type": "markdown",
"id": "090d676a-f944-4297-a938-a40eda0b2b68",
"metadata": {},
"source": [
"The training results can now be uploaded to the Hub. To do so, execute the `push_to_hub` command:"
]
},
{
"cell_type": "code",
"execution_count": 27,
"id": "95737cda-c5dd-4887-a4d0-dfcb0d61d977",
"metadata": {},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"Saving model checkpoint to ./\n",
"Configuration saved in ./config.json\n",
"Model weights saved in ./pytorch_model.bin\n",
"Feature extractor saved in ./preprocessor_config.json\n",
"tokenizer config file saved in ./tokenizer_config.json\n",
"Special tokens file saved in ./special_tokens_map.json\n",
"added tokens file saved in ./added_tokens.json\n",
"Several commits (2) will be pushed upstream.\n",
"The progress bars may be unreliable.\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "827b4959bd524870a20e7e3fb4bfeb49",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"Upload file pytorch_model.bin: 0%| | 32.0k/922M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "50bb84ddede74e14b9ec803603efeea7",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"Upload file runs/Jan09_16-05-34_lorenzoncina-Nitro-AN517-41/events.out.tfevents.1673276761.lorenzoncina-Nitro-β¦"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"remote: Scanning LFS files for validity, may be slow... \n",
"remote: LFS file scan complete. \n",
"To https://huggingface.co/lorenzoncina/whisper-small-ja\n",
" dc67364..b6f7ab8 main -> main\n",
"\n",
"Dropping the following result as it does not have all the necessary fields:\n",
"{'task': {'name': 'Automatic Speech Recognition', 'type': 'automatic-speech-recognition'}, 'dataset': {'name': 'Common Voice 11.0', 'type': 'mozilla-foundation/common_voice_11_0', 'config': 'ja', 'split': 'test', 'args': 'ja'}}\n",
"To https://huggingface.co/lorenzoncina/whisper-small-ja\n",
" b6f7ab8..ce27e8f main -> main\n",
"\n"
]
},
{
"data": {
"text/plain": [
"'https://huggingface.co/lorenzoncina/whisper-small-ja/commit/b6f7ab8c1b9c273d8fc7b2682deb4271e1fe6e64'"
]
},
"execution_count": 27,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"trainer.push_to_hub(**kwargs)"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "b665c689",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.8"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
|