Duplicate from suno/bark

Co-authored-by: Vaibhav Srivastav <reach-vb@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,34 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,192 @@
+---
+language:
+- en
+- de
+- es
+- fr
+- hi
+- it
+- ja
+- ko
+- pl
+- pt
+- ru
+- tr
+- zh
+thumbnail: >-
+  https://user-images.githubusercontent.com/5068315/230698495-cbb1ced9-c911-4c9a-941d-a1a4a1286ac6.png
+library: bark
+license: cc-by-nc-4.0
+tags:
+- bark
+- audio
+- text-to-speech
+pipeline_tag: text-to-speech
+inference: false
+duplicated_from: suno/bark
+---
+
+# Bark
+
+Bark is a transformer-based text-to-audio model created by [Suno](https://www.suno.ai). 
+Bark can generate highly realistic, multilingual speech as well as other audio - including music, 
+background noise and simple sound effects. The model can also produce nonverbal 
+communications like laughing, sighing and crying. To support the research community, 
+we are providing access to pretrained model checkpoints ready for inference.
+
+The original github repo and model card can be found [here](https://github.com/suno-ai/bark).
+
+This model is meant for research purposes only. 
+The model output is not censored and the authors do not endorse the opinions in the generated content. 
+Use at your own risk.
+
+Two checkpoints are released:
+- [small](https://huggingface.co/suno/bark-small)
+- [**large** (this checkpoint)](https://huggingface.co/suno/bark)
+
+
+## Example
+
+Try out Bark yourself!
+
+* Bark Colab:
+
+<a target="_blank" href="https://colab.research.google.com/drive/1eJfA2XUa-mXwdMy7DoYKVYHI1iTd9Vkt?usp=sharing">
+  <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
+</a>
+
+* Hugging Face Colab:
+
+<a target="_blank" href="https://colab.research.google.com/drive/1dWWkZzvu7L9Bunq9zvD-W02RFUXoW-Pd?usp=sharing"> 
+  <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> 
+</a>
+
+* Hugging Face Demo:
+
+<a target="_blank" href="https://huggingface.co/spaces/suno/bark">
+  <img src="https://huggingface.co/datasets/huggingface/badges/raw/main/open-in-hf-spaces-sm.svg" alt="Open in HuggingFace"/>
+</a>
+
+
+## 🤗 Transformers Usage
+
+
+You can run Bark locally with the 🤗 Transformers library from version 4.31.0 onwards.
+
+1. First install the 🤗 [Transformers library](https://github.com/huggingface/transformers) from main:
+
+```
+pip install git+https://github.com/huggingface/transformers.git
+```
+
+2. Run the following Python code to generate speech samples:
+
+```python
+from transformers import AutoProcessor, AutoModel
+
+
+processor = AutoProcessor.from_pretrained("suno/bark-small")
+model = AutoModel.from_pretrained("suno/bark-small")
+
+inputs = processor(
+    text=["Hello, my name is Suno. And, uh — and I like pizza. [laughs] But I also have other interests such as playing tic tac toe."],
+    return_tensors="pt",
+)
+
+speech_values = model.generate(**inputs, do_sample=True)
+```
+
+3. Listen to the speech samples either in an ipynb notebook:
+
+```python
+from IPython.display import Audio
+
+sampling_rate = model.generation_config.sample_rate
+Audio(speech_values.cpu().numpy().squeeze(), rate=sampling_rate)
+```
+
+Or save them as a `.wav` file using a third-party library, e.g. `scipy`:
+
+```python
+import scipy
+
+sampling_rate = model.config.sample_rate
+scipy.io.wavfile.write("bark_out.wav", rate=sampling_rate, data=speech_values.cpu().numpy().squeeze())
+```
+
+For more details on using the Bark model for inference using the 🤗 Transformers library, refer to the [Bark docs](https://huggingface.co/docs/transformers/model_doc/bark).
+
+## Suno Usage
+
+You can also run Bark locally through the original [Bark library]((https://github.com/suno-ai/bark):
+
+1. First install the [`bark` library](https://github.com/suno-ai/bark)
+
+3. Run the following Python code:
+
+```python
+from bark import SAMPLE_RATE, generate_audio, preload_models
+from IPython.display import Audio
+
+# download and load all models
+preload_models()
+
+# generate audio from text
+text_prompt = """
+     Hello, my name is Suno. And, uh — and I like pizza. [laughs] 
+     But I also have other interests such as playing tic tac toe.
+"""
+speech_array = generate_audio(text_prompt)
+
+# play text in notebook
+Audio(speech_array, rate=SAMPLE_RATE)
+```
+
+[pizza.webm](https://user-images.githubusercontent.com/5068315/230490503-417e688d-5115-4eee-9550-b46a2b465ee3.webm)
+
+
+To save `audio_array` as a WAV file:
+
+```python
+from scipy.io.wavfile import write as write_wav
+
+write_wav("/path/to/audio.wav", SAMPLE_RATE, audio_array)
+```
+
+## Model Details
+
+
+The following is additional information about the models released here. 
+
+Bark is a series of three transformer models that turn text into audio.
+
+### Text to semantic tokens
+ - Input: text, tokenized with [BERT tokenizer from Hugging Face](https://huggingface.co/docs/transformers/model_doc/bert#transformers.BertTokenizer)
+ - Output: semantic tokens that encode the audio to be generated
+
+### Semantic to coarse tokens
+ - Input: semantic tokens
+ - Output: tokens from the first two codebooks of the [EnCodec Codec](https://github.com/facebookresearch/encodec) from facebook
+
+### Coarse to fine tokens
+ - Input: the first two codebooks from EnCodec
+ - Output: 8 codebooks from EnCodec
+
+### Architecture
+|           Model           | Parameters | Attention  | Output Vocab size |  
+|:-------------------------:|:----------:|------------|:-----------------:|
+|  Text to semantic tokens  |    80/300 M    | Causal     |       10,000      |
+| Semantic to coarse tokens |    80/300 M    | Causal     |     2x 1,024      |
+|   Coarse to fine tokens   |    80/300 M    | Non-causal |     6x 1,024      |
+
+
+### Release date
+April 2023
+
+## Broader Implications
+We anticipate that this model's text to audio capabilities can be used to improve accessbility tools in a variety of languages. 
+ 
+While we hope that this release will enable users to express their creativity and build applications that are a force
+for good, we acknowledge that any text to audio model has the potential for dual use. While it is not straightforward
+to voice clone known people with Bark, it can still be used for nefarious purposes. To further reduce the chances of unintended use of Bark, 
+we also release a simple classifier to detect Bark-generated audio with high accuracy (see notebooks section of the main repository).

coarse.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:110580140ce5319b5b26849e24378d7594eb75ad11e7203e3091a876a07e4536
+size 1251939909

coarse_2.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:286abc253d4d7f4d148325df07585f7ca4fca36ce40577a1ddd744a8b35e4388
+size 3934534533

config.json

@@ -0,0 +1,340 @@
+{
+  "_commit_hash": null,
+  "architectures": [
+    "BarkModel"
+  ],
+  "coarse_acoustics_config": {
+    "_name_or_path": "",
+    "add_cross_attention": false,
+    "architectures": [
+      "BarkCoarseModel"
+    ],
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bias": false,
+    "block_size": 1024,
+    "bos_token_id": null,
+    "chunk_size_feed_forward": 0,
+    "cross_attention_hidden_size": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.0,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": null,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "hidden_size": 1024,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "input_vocab_size": 12096,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "coarse_acoustics",
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_heads": 16,
+    "num_layers": 24,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "output_vocab_size": 12096,
+    "pad_token_id": null,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": "float32",
+    "torchscript": false,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": true
+  },
+  "codec_config": {
+    "_name_or_path": "ArthurZ/encodec_24khz",
+    "add_cross_attention": false,
+    "architectures": [
+      "EncodecModel"
+    ],
+    "audio_channels": 1,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": null,
+    "chunk_length_s": null,
+    "chunk_size_feed_forward": 0,
+    "codebook_dim": 128,
+    "codebook_size": 1024,
+    "compress": 2,
+    "cross_attention_hidden_size": null,
+    "decoder_start_token_id": null,
+    "dilation_growth_rate": 2,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": null,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "hidden_size": 128,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "kernel_size": 7,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "last_kernel_size": 7,
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "encodec",
+    "no_repeat_ngram_size": 0,
+    "norm_type": "weight_norm",
+    "normalize": false,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_filters": 32,
+    "num_lstm_layers": 2,
+    "num_residual_layers": 1,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "overlap": null,
+    "pad_mode": "reflect",
+    "pad_token_id": null,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "residual_kernel_size": 3,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sampling_rate": 24000,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "target_bandwidths": [
+      1.5,
+      3.0,
+      6.0,
+      12.0,
+      24.0
+    ],
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": "float32",
+    "torchscript": false,
+    "transformers_version": "4.31.0.dev0",
+    "trim_right_ratio": 1.0,
+    "typical_p": 1.0,
+    "upsampling_ratios": [
+      8,
+      5,
+      4,
+      2
+    ],
+    "use_bfloat16": false,
+    "use_causal_conv": true,
+    "use_conv_shortcut": true
+  },
+  "fine_acoustics_config": {
+    "_name_or_path": "",
+    "add_cross_attention": false,
+    "architectures": [
+      "BarkFineModel"
+    ],
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bias": false,
+    "block_size": 1024,
+    "bos_token_id": null,
+    "chunk_size_feed_forward": 0,
+    "cross_attention_hidden_size": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.0,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": null,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "hidden_size": 1024,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "input_vocab_size": 1056,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "fine_acoustics",
+    "n_codes_given": 1,
+    "n_codes_total": 8,
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_heads": 16,
+    "num_layers": 24,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "output_vocab_size": 1056,
+    "pad_token_id": null,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": "float32",
+    "torchscript": false,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": true
+  },
+  "initializer_range": 0.02,
+  "model_type": "bark",
+  "semantic_config": {
+    "_name_or_path": "",
+    "add_cross_attention": false,
+    "architectures": [
+      "BarkSemanticModel"
+    ],
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bias": false,
+    "block_size": 1024,
+    "bos_token_id": null,
+    "chunk_size_feed_forward": 0,
+    "cross_attention_hidden_size": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.0,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": null,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "hidden_size": 1024,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "input_vocab_size": 129600,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "semantic",
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_heads": 16,
+    "num_layers": 24,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "output_vocab_size": 10048,
+    "pad_token_id": null,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": "float32",
+    "torchscript": false,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": true
+  },
+  "torch_dtype": "float32",
+  "transformers_version": null
+}

fine.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ec1eb35cd3e21506b0c045ded225271d9a25d9fa608662585cfd749590a0eac
+size 1107111557

fine_2.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:799c87afab4b01537094c63ea231f2c42c9c07aeb16773690540ad251a6d8fab
+size 3741740229

generation_config.json

@@ -0,0 +1,172 @@
+{
+  "coarse_acoustics_config": {
+    "_from_model_config": false,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": null,
+    "coarse_infer_token": 12050,
+    "coarse_rate_hz": 75,
+    "coarse_semantic_pad_token": 12048,
+    "constraints": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": true,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "encoder_repetition_penalty": 1.0,
+    "eos_token_id": null,
+    "epsilon_cutoff": 0.0,
+    "eta_cutoff": 0.0,
+    "exponential_decay_length_penalty": null,
+    "force_words_ids": null,
+    "forced_bos_token_id": null,
+    "forced_decoder_ids": null,
+    "forced_eos_token_id": null,
+    "generation_kwargs": {},
+    "guidance_scale": null,
+    "length_penalty": 1.0,
+    "max_coarse_history": 630,
+    "max_coarse_input_length": 256,
+    "max_length": 20,
+    "max_new_tokens": null,
+    "max_time": null,
+    "min_length": 0,
+    "min_new_tokens": null,
+    "n_coarse_codebooks": 2,
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": null,
+    "penalty_alpha": null,
+    "remove_invalid_values": false,
+    "renormalize_logits": true,
+    "repetition_penalty": 1.0,
+    "return_dict_in_generate": false,
+    "sequence_bias": null,
+    "sliding_window_len": 60,
+    "suppress_tokens": null,
+    "temperature": 0.7,
+    "top_k": 50,
+    "top_p": 1.0,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_cache": true
+  },
+  "codebook_size": 1024,
+  "fine_acoustics_config": {
+    "_from_model_config": false,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": null,
+    "constraints": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "encoder_repetition_penalty": 1.0,
+    "eos_token_id": null,
+    "epsilon_cutoff": 0.0,
+    "eta_cutoff": 0.0,
+    "exponential_decay_length_penalty": null,
+    "force_words_ids": null,
+    "forced_bos_token_id": null,
+    "forced_decoder_ids": null,
+    "forced_eos_token_id": null,
+    "generation_kwargs": {},
+    "guidance_scale": null,
+    "length_penalty": 1.0,
+    "max_fine_history_length": 512,
+    "max_fine_input_length": 1024,
+    "max_length": 20,
+    "max_new_tokens": null,
+    "max_time": null,
+    "min_length": 0,
+    "min_new_tokens": null,
+    "n_fine_codebooks": 8,
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": null,
+    "penalty_alpha": null,
+    "remove_invalid_values": false,
+    "renormalize_logits": false,
+    "repetition_penalty": 1.0,
+    "return_dict_in_generate": false,
+    "sequence_bias": null,
+    "suppress_tokens": null,
+    "temperature": 0.5,
+    "top_k": 50,
+    "top_p": 1.0,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_cache": true
+  },
+  "model_type": "bark",
+  "sample_rate": 24000,
+  "semantic_config": {
+    "_from_model_config": false,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": null,
+    "constraints": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": true,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "encoder_repetition_penalty": 1.0,
+    "eos_token_id": 10000,
+    "epsilon_cutoff": 0.0,
+    "eta_cutoff": 0.0,
+    "exponential_decay_length_penalty": null,
+    "force_words_ids": null,
+    "forced_bos_token_id": null,
+    "forced_decoder_ids": null,
+    "forced_eos_token_id": null,
+    "generation_kwargs": {},
+    "guidance_scale": null,
+    "length_penalty": 1.0,
+    "max_input_semantic_length": 256,
+    "max_length": 20,
+    "max_new_tokens": 768,
+    "max_time": null,
+    "min_length": 0,
+    "min_new_tokens": null,
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": null,
+    "penalty_alpha": null,
+    "remove_invalid_values": false,
+    "renormalize_logits": true,
+    "repetition_penalty": 1.0,
+    "return_dict_in_generate": false,
+    "semantic_infer_token": 129599,
+    "semantic_pad_token": 10000,
+    "semantic_rate_hz": 49.9,
+    "semantic_vocab_size": 10000,
+    "sequence_bias": null,
+    "suppress_tokens": null,
+    "temperature": 0.7,
+    "text_encoding_offset": 10048,
+    "text_pad_token": 129595,
+    "top_k": 50,
+    "top_p": 1.0,
+    "transformers_version": "4.31.0.dev0",
+    "typical_p": 1.0,
+    "use_cache": true
+  }
+}

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e3d407b9b3b619da184c85786c88e5e35f90f9089303e16db696ed0be477989
+size 4486643861

speaker_embeddings/announcer_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c77d5e1f9ab39e489d27628ab26dfae7a8b4cae4ba72658a1a94927f7ff5132
+size 3128

speaker_embeddings/announcer_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7aac73cd2a14c1939a718aeb48b064d149b39f773f1dcc9b93be6f79ebd33755
+size 12128

speaker_embeddings/announcer_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5564642cbd84db6f4d1d8a522bd26329b4f4cd8cd81e1965b90baf1ee80c7ff
+size 1126

speaker_embeddings/de_speaker_0_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3eb78af32779b5fabbb92e7cdbdeaaa34f5f8ad1085e213b101165665c5ce4cb
+size 9472

speaker_embeddings/de_speaker_0_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a2421bcbeb7fadfcf1c0b33e38e316474d4a95139d4dd0b3d861e72c8fd77c36
+size 18816

speaker_embeddings/de_speaker_0_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44e5539dbcd158a2471c59b46cde7f0564d108cd2fd935e3664b2ec733ad4393
+size 3240

speaker_embeddings/de_speaker_1_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ac93157e39cd0fa7a5e9d0404d6adcb3daaec8e820b42b72b96de62e19ca89b
+size 9472

speaker_embeddings/de_speaker_1_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9f8eaca4b732dd3264213ac387f4c91f83a574563b0d72368b237df03fe92b4d
+size 18816

speaker_embeddings/de_speaker_1_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98cde60e36a6265d6534e4c6422436f201a9bfcdc87f9817d6faf6ab4f22554b
+size 3240

speaker_embeddings/de_speaker_2_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd5e9d07b0480dda2c3661de1da0671f34419c029c8e7410705139a38fb133d3
+size 6944

speaker_embeddings/de_speaker_2_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f11b22a8a24428ca0114e4fcc770c0ca554376de95be7ac5ac560ae4f1988fb
+size 13760

speaker_embeddings/de_speaker_2_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8efe5707a724632900ab5cb274ffdbac0d39fd6dda1be49833d63311df478ef3
+size 2400

speaker_embeddings/de_speaker_3_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf0fb48dd18c79996fc800abbd3407dd967b21a36bda695584e29d302ead274a
+size 8608

speaker_embeddings/de_speaker_3_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:229455388c628e9d168ad11940041b15ed3b40f724ab3a4747f6cb38b2f5230a
+size 17088

speaker_embeddings/de_speaker_3_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88fee5c6b974dbfb1168b55f73990be270847a91a2e7895d298b188f3ad7da9f
+size 2952

speaker_embeddings/de_speaker_4_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0268e63ef8aa7c6113af4a840c3581c08edea0eacec8aaa7d52da8012d8c16f5
+size 5984

speaker_embeddings/de_speaker_4_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21c41cce8756afcd8b690ad8701e35f33b4c0be3c63bae5f6ebbc10e5cb3c150
+size 11840

speaker_embeddings/de_speaker_4_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a03e84c7f1f4dd97f033d999fea8eb76c4dde6883e1dae67303b6a46bdb57803
+size 2080

speaker_embeddings/de_speaker_5_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f4272d4c3928264a36a406b9c0d306db99316180dca8e96504c93244fc61d96
+size 10416

speaker_embeddings/de_speaker_5_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dac52541ccb321598997fe0e27ebadf5540eb6e53a8b3a614d7cabfcbae4b2d0
+size 20704

speaker_embeddings/de_speaker_5_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:412b3a1f45525390e84bd2109bb86af782da2245adcbdd8803c1b362a311075c
+size 3552

speaker_embeddings/de_speaker_6_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc029718234023df88f9ae4ea830a90115bd2256b10fe8c3c725483392c0f6c2
+size 9408

speaker_embeddings/de_speaker_6_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3414b015ad3567a2590f5b044f3d2043270bef8b03cb1348b7265d21bbca2299
+size 18688

speaker_embeddings/de_speaker_6_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2300ace5fda24f16a27b345a6f54c19e2e2363808cac0a58bac12518b4c8f77d
+size 3216

speaker_embeddings/de_speaker_7_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd86cb193cb39a077a2cb2540af2953ce7f2f480ec3129c5191e730b87329493
+size 17696

speaker_embeddings/de_speaker_7_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e97d71d8a7120bff91f08ccf1d0e6d1e8b6983642d56dad0cbe0f8dc2554343
+size 35264

speaker_embeddings/de_speaker_7_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7be7d81cb55364f3db979ce92315e2e64517203b9300caca6414970ec81c220b
+size 5976

speaker_embeddings/de_speaker_8_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06efd00181d007e30b7b7bede472ea50e9f7c61aa7b76074884d26eec8d965f7
+size 7424

speaker_embeddings/de_speaker_8_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f566f926840a3e70e115fc41b0bf4c3f658b1b23e8583e7492d7f0ae13423ac5
+size 14720

speaker_embeddings/de_speaker_8_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1919388fdd9b0e236e7bdeef4f6ad1416c7b0e49daf72cf5e064b2e2106584aa
+size 2560

speaker_embeddings/de_speaker_9_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:97012e37b1d51da9b2aebfb521b568713042cb4e086367dc5f2558c0b6629486
+size 6544

speaker_embeddings/de_speaker_9_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f455a59e0d759103c7d8802bccef33cf0cafbf9122605179278d6f7ff302acdf
+size 12960

speaker_embeddings/de_speaker_9_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8efede4bec02ec98fc470dc53ca00154fea57f895a931ef6f44b1e9621b18ad2
+size 2264

speaker_embeddings/en_speaker_0_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d91b5e26a8c703a7764b21570d8cc94aee3bb043a407c3ace89976f701ddf8f
+size 6608

speaker_embeddings/en_speaker_0_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24bebee667439786f17048d4ec3f36460d6d9f9f59495b3076a116e6e3f71f6e
+size 13088

speaker_embeddings/en_speaker_0_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01f0c8e96aee83c19514700491be4326c5a1194631cdd486e1d4b76e4d0c0de0
+size 2288

speaker_embeddings/en_speaker_1_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad174875bc5a8076a568bd61a293a8ab80056b97636e159d0ea7046a10833653
+size 5408

speaker_embeddings/en_speaker_1_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2f168630b806f09a27cff70e404ecc6aa1a62d30b2478e64c352461bb13e97a6
+size 10688

speaker_embeddings/en_speaker_1_semantic_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:04fd39ae31c48ce4c2578d25e07f436b671fa900fd526de06d68054735fe4fc6
+size 1888

speaker_embeddings/en_speaker_2_coarse_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:04018345b2fe98c5a5d86dad0931f8ddad010307c3d3fd3eecc7c89a168747eb
+size 10048

speaker_embeddings/en_speaker_2_fine_prompt.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d860a933d31cda9c8b2220384545b2e7c9e022e8456769326dcb5cfe34f3b5b6
+size 19968