\u001b[0;34m()\u001b[0m\n\u001b[1;32m 1\u001b[0m vectorized_train_datasets[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtrain\u001b[39m\u001b[38;5;124m\"\u001b[39m] \u001b[38;5;241m=\u001b[39m vectorized_train_datasets[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtrain\u001b[39m\u001b[38;5;124m\"\u001b[39m]\u001b[38;5;241m.\u001b[39mfilter(\n\u001b[0;32m----> 2\u001b[0m \u001b[43mis_audio_in_length_range\u001b[49m,\n\u001b[1;32m 3\u001b[0m input_columns\u001b[38;5;241m=\u001b[39m[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124minput_length\u001b[39m\u001b[38;5;124m\"\u001b[39m],\n\u001b[1;32m 4\u001b[0m batched\u001b[38;5;241m=\u001b[39m\u001b[38;5;28;01mTrue\u001b[39;00m,\n\u001b[1;32m 5\u001b[0m batch_size\u001b[38;5;241m=\u001b[39m\u001b[38;5;241m100\u001b[39m\n\u001b[1;32m 6\u001b[0m )\n",
+ "\u001b[0;31mNameError\u001b[0m: name 'is_audio_in_length_range' is not defined"
+ ]
+ }
+ ],
+ "source": [
+ "vectorized_train_datasets[\"train\"] = vectorized_train_datasets[\"train\"].filter(\n",
+ " is_audio_in_length_range,\n",
+ " input_columns=[\"input_length\"],\n",
+ " batched=True,\n",
+ " batch_size=100\n",
+ ")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "263a5a58-0239-4a25-b0df-c625fc9c5810",
+ "metadata": {},
+ "source": [
+ "## Training and Evaluation"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "a693e768-c5a6-453f-89a1-b601dcf7daf7",
+ "metadata": {},
+ "source": [
+ "Now that we've prepared our data, we're ready to dive into the training pipeline. \n",
+ "The [π€ Trainer](https://huggingface.co/transformers/master/main_classes/trainer.html?highlight=trainer)\n",
+ "will do much of the heavy lifting for us. All we have to do is:\n",
+ "\n",
+ "- Define a data collator: the data collator takes our pre-processed data and prepares PyTorch tensors ready for the model.\n",
+ "\n",
+ "- Evaluation metrics: during evaluation, we want to evaluate the model using the [word error rate (WER)](https://huggingface.co/metrics/wer) metric. We need to define a `compute_metrics` function that handles this computation.\n",
+ "\n",
+ "- Load a pre-trained checkpoint: we need to load a pre-trained checkpoint and configure it correctly for training.\n",
+ "\n",
+ "- Define the training configuration: this will be used by the π€ Trainer to define the training schedule."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "8d230e6d-624c-400a-bbf5-fa660881df25",
+ "metadata": {},
+ "source": [
+ "### Define a Data Collator"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "04def221-0637-4a69-b242-d3f0c1d0ee78",
+ "metadata": {},
+ "source": [
+ "The data collator for a sequence-to-sequence speech model is unique in the sense that it \n",
+ "treats the `input_features` and `labels` independently: the `input_features` must be \n",
+ "handled by the feature extractor and the `labels` by the tokenizer.\n",
+ "\n",
+ "The `input_features` are already padded to 30s and converted to a log-Mel spectrogram \n",
+ "of fixed dimension by action of the feature extractor, so all we have to do is convert the `input_features`\n",
+ "to batched PyTorch tensors. We do this using the feature extractor's `.pad` method with `return_tensors=pt`.\n",
+ "\n",
+ "The `labels` on the other hand are un-padded. We first pad the sequences\n",
+ "to the maximum length in the batch using the tokenizer's `.pad` method. The padding tokens \n",
+ "are then replaced by `-100` so that these tokens are **not** taken into account when \n",
+ "computing the loss. We then cut the BOS token from the start of the label sequence as we \n",
+ "append it later during training.\n",
+ "\n",
+ "We can leverage the `WhisperProcessor` we defined earlier to perform both the \n",
+ "feature extractor and the tokenizer operations:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 15,
+ "id": "8326221e-ec13-4731-bb4e-51e5fc1486c5",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "import torch\n",
+ "\n",
+ "from dataclasses import dataclass\n",
+ "from typing import Any, Dict, List, Union\n",
+ "\n",
+ "@dataclass\n",
+ "class DataCollatorSpeechSeq2SeqWithPadding:\n",
+ " processor: Any\n",
+ "\n",
+ " def __call__(self, features: List[Dict[str, Union[List[int], torch.Tensor]]]) -> Dict[str, torch.Tensor]:\n",
+ " # split inputs and labels since they have to be of different lengths and need different padding methods\n",
+ " # first treat the audio inputs by simply returning torch tensors\n",
+ " input_features = [{\"input_features\": feature[\"input_features\"]} for feature in features]\n",
+ " batch = self.processor.feature_extractor.pad(input_features, return_tensors=\"pt\")\n",
+ "\n",
+ " # get the tokenized label sequences\n",
+ " label_features = [{\"input_ids\": feature[\"labels\"]} for feature in features]\n",
+ " # pad the labels to max length\n",
+ " labels_batch = self.processor.tokenizer.pad(label_features, return_tensors=\"pt\")\n",
+ "\n",
+ " # replace padding with -100 to ignore loss correctly\n",
+ " labels = labels_batch[\"input_ids\"].masked_fill(labels_batch.attention_mask.ne(1), -100)\n",
+ "\n",
+ " # if bos token is appended in previous tokenization step,\n",
+ " # cut bos token here as it's append later anyways\n",
+ " if (labels[:, 0] == self.processor.tokenizer.bos_token_id).all().cpu().item():\n",
+ " labels = labels[:, 1:]\n",
+ "\n",
+ " batch[\"labels\"] = labels\n",
+ "\n",
+ " return batch"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "3cae7dbf-8a50-456e-a3a8-7fd005390f86",
+ "metadata": {},
+ "source": [
+ "Let's initialise the data collator we've just defined:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 16,
+ "id": "fc834702-c0d3-4a96-b101-7b87be32bf42",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "data_collator = DataCollatorSpeechSeq2SeqWithPadding(processor=processor)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "d62bb2ab-750a-45e7-82e9-61d6f4805698",
+ "metadata": {},
+ "source": [
+ "### Evaluation Metrics"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "66fee1a7-a44c-461e-b047-c3917221572e",
+ "metadata": {},
+ "source": [
+ "We'll use the word error rate (WER) metric, the 'de-facto' metric for assessing \n",
+ "ASR systems. For more information, refer to the WER [docs](https://huggingface.co/metrics/wer). We'll load the WER metric from π€ Evaluate:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 17,
+ "id": "b22b4011-f31f-4b57-b684-c52332f92890",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "import evaluate\n",
+ "\n",
+ "#metric = evaluate.load(\"wer\")\n",
+ "metric = evaluate.load(\"cer\")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "509f96d7-3f11-4f37-add9-f74a0c44f3fc",
+ "metadata": {},
+ "source": [
+ "We then simply have to define a function that takes our model \n",
+ "predictions and returns the WER metric. This function, called\n",
+ "`compute_metrics`, first replaces `-100` with the `pad_token_id`\n",
+ "in the `label_ids` (undoing the step we applied in the \n",
+ "data collator to ignore padded tokens correctly in the loss).\n",
+ "It then decodes the predicted and label ids to strings. Finally,\n",
+ "it computes the WER between the predictions and reference labels. \n",
+ "Here, we have the option of evaluating with the 'normalised' transcriptions \n",
+ "and predictions. We recommend you set this to `True` to benefit from the WER \n",
+ "improvement obtained by normalising the transcriptions."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 18,
+ "id": "a11d1bfc-9e28-460f-a287-72d8f7bc1acb",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "#Β evaluate with the 'normalised' WER\n",
+ "do_normalize_eval = True\n",
+ "\n",
+ "def compute_metrics(pred):\n",
+ " pred_ids = pred.predictions\n",
+ " label_ids = pred.label_ids\n",
+ "\n",
+ " # replace -100 with the pad_token_id\n",
+ " label_ids[label_ids == -100] = processor.tokenizer.pad_token_id\n",
+ "\n",
+ " # we do not want to group tokens when computing the metrics\n",
+ " pred_str = processor.tokenizer.batch_decode(pred_ids, skip_special_tokens=True)\n",
+ " label_str = processor.tokenizer.batch_decode(label_ids, skip_special_tokens=True)\n",
+ "\n",
+ " if do_normalize_eval:\n",
+ " pred_str = [normalizer(pred) for pred in pred_str]\n",
+ " label_str = [normalizer(label) for label in label_str]\n",
+ " # filtering step to only evaluate the samples that correspond to non-zero references:\n",
+ " pred_str = [pred_str[i] for i in range(len(pred_str)) if len(label_str[i]) > 0]\n",
+ " label_str = [label_str[i] for i in range(len(label_str)) if len(label_str[i]) > 0]\n",
+ "\n",
+ " cer = 100 * metric.compute(predictions=pred_str, references=label_str)\n",
+ "\n",
+ " return {\"cer\": cer}"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "daf2a825-6d9f-4a23-b145-c37c0039075b",
+ "metadata": {},
+ "source": [
+ "###Β Load a Pre-Trained Checkpoint"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "437a97fa-4864-476b-8abc-f28b8166cfa5",
+ "metadata": {},
+ "source": [
+ "Now let's load the pre-trained Whisper `small` checkpoint. Again, this \n",
+ "is trivial through use of π€ Transformers!"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 19,
+ "id": "5a10cc4b-07ec-4ebd-ac1d-7c601023594f",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "from transformers import WhisperForConditionalGeneration\n",
+ "\n",
+ "model = WhisperForConditionalGeneration.from_pretrained(\"openai/whisper-small\")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "a15ead5f-2277-4a39-937b-585c2497b2df",
+ "metadata": {},
+ "source": [
+ "Override generation arguments - no tokens are forced as decoder outputs (see [`forced_decoder_ids`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.forced_decoder_ids)), no tokens are suppressed during generation (see [`suppress_tokens`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.suppress_tokens)). Set `use_cache` to False since we're using gradient checkpointing, and the two are incompatible:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 20,
+ "id": "62038ba3-88ed-4fce-84db-338f50dcd04f",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "model.config.forced_decoder_ids = None\n",
+ "model.config.suppress_tokens = []\n",
+ "model.config.use_cache = False"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "2178dea4-80ca-47b6-b6ea-ba1915c90c06",
+ "metadata": {},
+ "source": [
+ "### Define the Training Configuration"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "c21af1e9-0188-4134-ac82-defc7bdcc436",
+ "metadata": {},
+ "source": [
+ "In the final step, we define all the parameters related to training. Here, you can set the `max_steps` to train for longer. For more detail on the training arguments, refer to the Seq2SeqTrainingArguments [docs](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments)."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 21,
+ "id": "0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "from transformers import Seq2SeqTrainingArguments\n",
+ "\n",
+ "training_args = Seq2SeqTrainingArguments(\n",
+ " output_dir=\"./\",\n",
+ " per_device_train_batch_size=4,\n",
+ " gradient_accumulation_steps=1, # increase by 2x for every 2x decrease in batch size\n",
+ " learning_rate=1e-5,\n",
+ " warmup_steps=500,\n",
+ " max_steps=5000,\n",
+ " gradient_checkpointing=True,\n",
+ " fp16=True,\n",
+ " evaluation_strategy=\"steps\",\n",
+ " per_device_eval_batch_size=8,\n",
+ " predict_with_generate=True,\n",
+ " generation_max_length=225,\n",
+ " save_steps=1000,\n",
+ " eval_steps=1000,\n",
+ " logging_steps=25,\n",
+ " report_to=[\"tensorboard\"],\n",
+ " load_best_model_at_end=True,\n",
+ " metric_for_best_model=\"cer\",\n",
+ " greater_is_better=False,\n",
+ " push_to_hub=True,\n",
+ ")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "b3a944d8-3112-4552-82a0-be25988b3857",
+ "metadata": {},
+ "source": [
+ "**Note**: if one does not want to upload the model checkpoints to the Hub, \n",
+ "set `push_to_hub=False`."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "393c883e-3e50-492c-bd58-f51dbf15ee56",
+ "metadata": {},
+ "source": [
+ "We then define a custom [Callback](https://huggingface.co/docs/transformers/main_classes/callback) that is called by the π€ Trainer on the end of each epoch. The Callback reinitialises and reshuffles the streaming dataset at the beginning of each new epoch - this gives different shuffling across our subsets for every epoch."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 22,
+ "id": "3ac16b62-b3c0-4c68-8f3d-9ecf471534b2",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "from transformers import TrainerCallback\n",
+ "from transformers.trainer_pt_utils import IterableDatasetShard\n",
+ "from torch.utils.data import IterableDataset\n",
+ "\n",
+ "# trainer callback to reinitialise and reshuffle the streamable datasets at the beginning of each epoch\n",
+ "class ShuffleCallback(TrainerCallback):\n",
+ " def on_epoch_begin(self, args, state, control, train_dataloader, **kwargs):\n",
+ " if isinstance(train_dataloader.dataset, IterableDatasetShard):\n",
+ " pass # set_epoch() is handled by the Trainer\n",
+ " elif isinstance(train_dataloader.dataset, IterableDataset):\n",
+ " train_dataloader.dataset.set_epoch(train_dataloader.dataset._epoch + 1)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "bac29114-d226-4f54-97cf-8718c9f94e1e",
+ "metadata": {},
+ "source": [
+ "We can forward the training arguments to the π€ Trainer along with our model,\n",
+ "dataset, data collator, `compute_metrics` function and custom callback:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 23,
+ "id": "d546d7fe-0543-479a-b708-2ebabec19493",
+ "metadata": {},
+ "outputs": [
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "/home/lorenzoncina/Documents/WIPO/code/whisper_finetune/whisper-small-ja/./ is already a clone of https://huggingface.co/lorenzoncina/whisper-small-ja. Make sure you pull the latest changes with `repo.git_pull()`.\n",
+ "max_steps is given, it will override any value given in num_train_epochs\n",
+ "Using cuda_amp half precision backend\n"
+ ]
+ }
+ ],
+ "source": [
+ "from transformers import Seq2SeqTrainer\n",
+ "\n",
+ "trainer = Seq2SeqTrainer(\n",
+ " args=training_args,\n",
+ " model=model,\n",
+ " train_dataset=vectorized_train_datasets[\"train\"],\n",
+ " eval_dataset=vectorized_eval_datasets[\"test\"],\n",
+ " data_collator=data_collator,\n",
+ " compute_metrics=compute_metrics,\n",
+ " tokenizer=processor,\n",
+ " callbacks=[ShuffleCallback()],\n",
+ ")"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "67ab88c3-7091-4e51-8ad5-f5cacbe18449",
+ "metadata": {},
+ "source": [
+ "We'll save the model and processor to the output directory before training:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 24,
+ "id": "a1ccb9ed-cbc8-4419-91c0-651e9424b672",
+ "metadata": {},
+ "outputs": [
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Configuration saved in ./config.json\n",
+ "Model weights saved in ./pytorch_model.bin\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n"
+ ]
+ }
+ ],
+ "source": [
+ "model.save_pretrained(training_args.output_dir)\n",
+ "processor.save_pretrained(training_args.output_dir)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "7f404cf9-4345-468c-8196-4bd101d9bd51",
+ "metadata": {},
+ "source": [
+ "### Training"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "5e8b8d56-5a70-4f68-bd2e-f0752d0bd112",
+ "metadata": {},
+ "source": [
+ "Training will take approximately 5-10 hours depending on your GPU. The peak GPU memory for the given training configuration is approximately 36GB. \n",
+ "Depending on your GPU, it is possible that you will encounter a CUDA `\"out-of-memory\"` error when you launch training. \n",
+ "In this case, you can reduce the `per_device_train_batch_size` incrementally by factors of 2 \n",
+ "and employ [`gradient_accumulation_steps`](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments.gradient_accumulation_steps)\n",
+ "to compensate.\n",
+ "\n",
+ "To launch training, simply execute:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 25,
+ "id": "ee8b7b8e-1c9a-4d77-9137-1778a629e6de",
+ "metadata": {
+ "scrolled": true
+ },
+ "outputs": [
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "The following columns in the training set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
+ "/home/lorenzoncina/miniconda3/envs/whisper_sprint/lib/python3.10/site-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n",
+ " warnings.warn(\n",
+ "***** Running training *****\n",
+ " Num examples = 11982\n",
+ " Num Epochs = 2\n",
+ " Instantaneous batch size per device = 4\n",
+ " Total train batch size (w. parallel, distributed & accumulation) = 4\n",
+ " Gradient Accumulation steps = 1\n",
+ " Total optimization steps = 5000\n",
+ " Number of trainable parameters = 241734912\n"
+ ]
+ },
+ {
+ "data": {
+ "text/html": [
+ "\n",
+ " \n",
+ " \n",
+ " \n",
+ " [5000/5000 6:05:36, Epoch 1/2]\n",
+ " \n",
+ " \n",
+ " \n",
+ " \n",
+ " Step | \n",
+ " Training Loss | \n",
+ " Validation Loss | \n",
+ " Cer | \n",
+ " \n",
+ " \n",
+ " \n",
+ " \n",
+ " 1000 | \n",
+ " 0.068200 | \n",
+ " 0.609830 | \n",
+ " 19.913343 | \n",
+ " \n",
+ " \n",
+ " 2000 | \n",
+ " 0.022900 | \n",
+ " 0.550079 | \n",
+ " 18.191102 | \n",
+ " \n",
+ " \n",
+ " 3000 | \n",
+ " 0.045700 | \n",
+ " 0.574486 | \n",
+ " 19.317449 | \n",
+ " \n",
+ " \n",
+ " 4000 | \n",
+ " 0.012300 | \n",
+ " 0.531459 | \n",
+ " 18.254558 | \n",
+ " \n",
+ " \n",
+ " 5000 | \n",
+ " 0.023800 | \n",
+ " 0.559558 | \n",
+ " 17.726087 | \n",
+ " \n",
+ " \n",
+ " "
+ ],
+ "text/plain": [
+ ""
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "***** Running Evaluation *****\n",
+ " Num examples: Unknown\n",
+ " Batch size = 8\n",
+ "Reading metadata...: 4604it [00:00, 7716.36it/s]\n",
+ "The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "/home/lorenzoncina/miniconda3/envs/whisper_sprint/lib/python3.10/site-packages/transformers/generation/utils.py:1147: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation)\n",
+ " warnings.warn(\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Saving model checkpoint to ./checkpoint-1000\n",
+ "Configuration saved in ./checkpoint-1000/config.json\n",
+ "Model weights saved in ./checkpoint-1000/pytorch_model.bin\n",
+ "Feature extractor saved in ./checkpoint-1000/preprocessor_config.json\n",
+ "tokenizer config file saved in ./checkpoint-1000/tokenizer_config.json\n",
+ "Special tokens file saved in ./checkpoint-1000/special_tokens_map.json\n",
+ "added tokens file saved in ./checkpoint-1000/added_tokens.json\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "***** Running Evaluation *****\n",
+ " Num examples: Unknown\n",
+ " Batch size = 8\n",
+ "Reading metadata...: 4604it [00:00, 7898.51it/s]\n",
+ "The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Saving model checkpoint to ./checkpoint-2000\n",
+ "Configuration saved in ./checkpoint-2000/config.json\n",
+ "Model weights saved in ./checkpoint-2000/pytorch_model.bin\n",
+ "Feature extractor saved in ./checkpoint-2000/preprocessor_config.json\n",
+ "tokenizer config file saved in ./checkpoint-2000/tokenizer_config.json\n",
+ "Special tokens file saved in ./checkpoint-2000/special_tokens_map.json\n",
+ "added tokens file saved in ./checkpoint-2000/added_tokens.json\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "***** Running Evaluation *****\n",
+ " Num examples: Unknown\n",
+ " Batch size = 8\n",
+ "Reading metadata...: 4604it [00:00, 10158.58it/s]\n",
+ "The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Saving model checkpoint to ./checkpoint-3000\n",
+ "Configuration saved in ./checkpoint-3000/config.json\n",
+ "Model weights saved in ./checkpoint-3000/pytorch_model.bin\n",
+ "Feature extractor saved in ./checkpoint-3000/preprocessor_config.json\n",
+ "tokenizer config file saved in ./checkpoint-3000/tokenizer_config.json\n",
+ "Special tokens file saved in ./checkpoint-3000/special_tokens_map.json\n",
+ "added tokens file saved in ./checkpoint-3000/added_tokens.json\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "***** Running Evaluation *****\n",
+ " Num examples: Unknown\n",
+ " Batch size = 8\n",
+ "Reading metadata...: 4604it [00:00, 6404.46it/s]\n",
+ "The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Saving model checkpoint to ./checkpoint-4000\n",
+ "Configuration saved in ./checkpoint-4000/config.json\n",
+ "Model weights saved in ./checkpoint-4000/pytorch_model.bin\n",
+ "Feature extractor saved in ./checkpoint-4000/preprocessor_config.json\n",
+ "tokenizer config file saved in ./checkpoint-4000/tokenizer_config.json\n",
+ "Special tokens file saved in ./checkpoint-4000/special_tokens_map.json\n",
+ "added tokens file saved in ./checkpoint-4000/added_tokens.json\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "***** Running Evaluation *****\n",
+ " Num examples: Unknown\n",
+ " Batch size = 8\n",
+ "Reading metadata...: 4604it [00:00, 7341.16it/s]\n",
+ "The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`, you can safely ignore this message.\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n"
+ ]
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Generate config GenerationConfig {\n",
+ " \"begin_suppress_tokens\": [\n",
+ " 220,\n",
+ " 50257\n",
+ " ],\n",
+ " \"bos_token_id\": 50257,\n",
+ " \"decoder_start_token_id\": 50258,\n",
+ " \"eos_token_id\": 50257,\n",
+ " \"max_length\": 448,\n",
+ " \"pad_token_id\": 50257,\n",
+ " \"suppress_tokens\": [],\n",
+ " \"transformers_version\": \"4.26.0.dev0\",\n",
+ " \"use_cache\": false\n",
+ "}\n",
+ "\n",
+ "Saving model checkpoint to ./checkpoint-5000\n",
+ "Configuration saved in ./checkpoint-5000/config.json\n",
+ "Model weights saved in ./checkpoint-5000/pytorch_model.bin\n",
+ "Feature extractor saved in ./checkpoint-5000/preprocessor_config.json\n",
+ "tokenizer config file saved in ./checkpoint-5000/tokenizer_config.json\n",
+ "Special tokens file saved in ./checkpoint-5000/special_tokens_map.json\n",
+ "added tokens file saved in ./checkpoint-5000/added_tokens.json\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "\n",
+ "\n",
+ "Training completed. Do not forget to share your model on huggingface.co/models =)\n",
+ "\n",
+ "\n",
+ "Loading best model from ./checkpoint-5000 (score: 17.72608743071874).\n"
+ ]
+ },
+ {
+ "data": {
+ "text/plain": [
+ "TrainOutput(global_step=5000, training_loss=0.08154704121649266, metrics={'train_runtime': 21939.4127, 'train_samples_per_second': 0.912, 'train_steps_per_second': 0.228, 'total_flos': 5.77113083559936e+18, 'train_loss': 0.08154704121649266, 'epoch': 1.67})"
+ ]
+ },
+ "execution_count": 25,
+ "metadata": {},
+ "output_type": "execute_result"
+ }
+ ],
+ "source": [
+ "\n",
+ "trainer.train()"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "747c6a6e",
+ "metadata": {
+ "pycharm": {
+ "name": "#%% md\n"
+ }
+ },
+ "source": [
+ "(note that training may take some time to commence as we load the first training data samples with streaming mode)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "810ced54-7187-4a06-b2fe-ba6dcca94dc3",
+ "metadata": {},
+ "source": [
+ "We can label our checkpoint with the `whisper-event` tag on push by setting the appropriate key-word arguments (kwargs):"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 26,
+ "id": "6dd0e310-9b07-4133-ac14-2ed2d7524e22",
+ "metadata": {},
+ "outputs": [],
+ "source": [
+ "kwargs = {\n",
+ " \"dataset_tags\": \"mozilla-foundation/common_voice_11_0\",\n",
+ " \"dataset\": \"Common Voice 11.0\", # a 'pretty' name for the training dataset\n",
+ " \"language\": \"ja\",\n",
+ " \"model_name\": \"Whisper Small JA - Lorenzo Concina\", # a 'pretty' name for your model\n",
+ " \"finetuned_from\": \"SVJ Japanese dataset\",\n",
+ " \"tasks\": \"automatic-speech-recognition\",\n",
+ " \"tags\": \"whisper-event\",\n",
+ "}"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "090d676a-f944-4297-a938-a40eda0b2b68",
+ "metadata": {},
+ "source": [
+ "The training results can now be uploaded to the Hub. To do so, execute the `push_to_hub` command:"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 27,
+ "id": "95737cda-c5dd-4887-a4d0-dfcb0d61d977",
+ "metadata": {},
+ "outputs": [
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "Saving model checkpoint to ./\n",
+ "Configuration saved in ./config.json\n",
+ "Model weights saved in ./pytorch_model.bin\n",
+ "Feature extractor saved in ./preprocessor_config.json\n",
+ "tokenizer config file saved in ./tokenizer_config.json\n",
+ "Special tokens file saved in ./special_tokens_map.json\n",
+ "added tokens file saved in ./added_tokens.json\n",
+ "Several commits (2) will be pushed upstream.\n",
+ "The progress bars may be unreliable.\n"
+ ]
+ },
+ {
+ "data": {
+ "application/vnd.jupyter.widget-view+json": {
+ "model_id": "827b4959bd524870a20e7e3fb4bfeb49",
+ "version_major": 2,
+ "version_minor": 0
+ },
+ "text/plain": [
+ "Upload file pytorch_model.bin: 0%| | 32.0k/922M [00:00, ?B/s]"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ },
+ {
+ "data": {
+ "application/vnd.jupyter.widget-view+json": {
+ "model_id": "50bb84ddede74e14b9ec803603efeea7",
+ "version_major": 2,
+ "version_minor": 0
+ },
+ "text/plain": [
+ "Upload file runs/Jan09_16-05-34_lorenzoncina-Nitro-AN517-41/events.out.tfevents.1673276761.lorenzoncina-Nitro-β¦"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "remote: Scanning LFS files for validity, may be slow... \n",
+ "remote: LFS file scan complete. \n",
+ "To https://huggingface.co/lorenzoncina/whisper-small-ja\n",
+ " dc67364..b6f7ab8 main -> main\n",
+ "\n",
+ "Dropping the following result as it does not have all the necessary fields:\n",
+ "{'task': {'name': 'Automatic Speech Recognition', 'type': 'automatic-speech-recognition'}, 'dataset': {'name': 'Common Voice 11.0', 'type': 'mozilla-foundation/common_voice_11_0', 'config': 'ja', 'split': 'test', 'args': 'ja'}}\n",
+ "To https://huggingface.co/lorenzoncina/whisper-small-ja\n",
+ " b6f7ab8..ce27e8f main -> main\n",
+ "\n"
+ ]
+ },
+ {
+ "data": {
+ "text/plain": [
+ "'https://huggingface.co/lorenzoncina/whisper-small-ja/commit/b6f7ab8c1b9c273d8fc7b2682deb4271e1fe6e64'"
+ ]
+ },
+ "execution_count": 27,
+ "metadata": {},
+ "output_type": "execute_result"
+ }
+ ],
+ "source": [
+ "trainer.push_to_hub(**kwargs)"
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": null,
+ "id": "b665c689",
+ "metadata": {},
+ "outputs": [],
+ "source": []
+ }
+ ],
+ "metadata": {
+ "kernelspec": {
+ "display_name": "Python 3 (ipykernel)",
+ "language": "python",
+ "name": "python3"
+ },
+ "language_info": {
+ "codemirror_mode": {
+ "name": "ipython",
+ "version": 3
+ },
+ "file_extension": ".py",
+ "mimetype": "text/x-python",
+ "name": "python",
+ "nbconvert_exporter": "python",
+ "pygments_lexer": "ipython3",
+ "version": "3.10.8"
+ }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}
|