Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+example_edit.png filter=lfs diff=lfs merge=lfs -text
+example_t2i.png filter=lfs diff=lfs merge=lfs -text
+comfy/Flux2_00030_.png filter=lfs diff=lfs merge=lfs -text
+teaser_editing.png filter=lfs diff=lfs merge=lfs -text
+teaser_generation.png filter=lfs diff=lfs merge=lfs -text
+tokenizer/tokenizer.json filter=lfs diff=lfs merge=lfs -text

LICENSE.md

@@ -0,0 +1,53 @@
+FLUX Non-Commercial License v2.1
+
+Black Forest Labs Inc. (“we” or “our” or “Company”) is pleased to make the weights, parameters, and inference code for the FLUX Model (as defined below) freely available for your non-commercial and non-production use as set forth in this FLUX Non-Commercial License (“License”).  “FLUX Model” includes, individually and collectively, the models denoted as FLUX.x [dev], where “.x” denotes the FLUX Model version number, and models made available under the License, as indicated by a license notice that is included in or attached to the work, and their elements which includes algorithms, software, checkpoints, parameters, source code (inference code, evaluation code, and if applicable, fine-tuning code) and any other materials associated with the FLUX AI models made available by Company under this License, including if any, the technical documentation, manuals, and instructions for the use and operation thereof. Note that we may also make available certain elements of what is included in the definition of “FLUX Model” under a separate license, such as the inference code, and nothing in this License will be deemed to restrict or limit any other licenses granted by us in such elements.
+
+By downloading, accessing, using, Distributing (as defined below), or creating a Derivative (as defined below) of the FLUX Model, you agree to the terms of this License. If you do not agree to this License, then you do not have any rights to access, use, Distribute or create a Derivative of the FLUX Model and you must immediately cease using the FLUX Model. If you are agreeing to be bound by the terms of this License on behalf of your employer or other entity, you represent and warrant to us that you have full legal authority to bind your employer or such entity to this License. If you do not have the requisite authority, you may not accept the License or access the FLUX Model on behalf of your employer or other entity.
+
+ 1. Definitions.
+ - a. “Derivative”  means any (i) modified version of the FLUX Model (including but not limited to any customized or fine-tuned version thereof), (ii) work based on the FLUX Model, or (iii) any other derivative work thereof. For the avoidance of doubt, Outputs are not considered Derivatives under this License.
+ - b. “Distribution” or “Distribute” or “Distributing” means providing or making available, by any means, a copy of the FLUX Model and/or the Derivatives as the case may be.
+ - c. “Non-Commercial Purpose” means any of the following uses, but only so far as you do not receive any direct or indirect payment arising from the use of the FLUX Model, Derivatives, or Content Filters (as defined below): (i) personal use for research, experimentation, and testing for the benefit of public knowledge, personal study, private entertainment, hobby projects, or otherwise not directly or indirectly connected to any commercial activities, business operations, or employment responsibilities; (ii) use by commercial or for-profit entities for testing, evaluation, or non-commercial research and development in a non-production environment; and (iii) use by any charitable organization for charitable purposes, or for testing or evaluation. For clarity, use (a) for revenue-generating activity, (b) in direct interactions with or that has impact on end users, or (c) to train, fine tune, or distill other models for commercial use, in each case, is not a Non-Commercial Purpose.
+ - d. “Outputs” means any content generated by the operation of the FLUX Model or Derivatives from an input (such as an image input) or prompt (i.e., text instructions) provided by users. For the avoidance of doubt, Outputs do not include any components of the FLUX Model, such as any fine-tuned versions of the FLUX Model, the weights, or parameters.
+ - e.   “you” or “your” means the individual or entity entering into this License with Company.
+
+2. License Grant.
+- a. License. Subject to your compliance with this License, Company grants you a non-exclusive, worldwide, non-transferable, non-sublicensable, revocable, royalty free, and limited license to access, use, create Derivatives of, and Distribute the FLUX Model and Derivatives solely for your Non-Commercial Purposes. The foregoing license is personal to you, and you may not assign or sublicense this License or any other rights or obligations under this License without Company’s prior written consent; any such assignment or sublicense will be void and will automatically and immediately terminate this License.  Any restrictions set forth herein regarding the FLUX Model also apply to any Derivative you create or that are created on your behalf.
+- b. Non-Commercial Use Only.  You may only access, use, Distribute, or create Derivatives of the FLUX Model or Derivatives for Non-Commercial Purposes.  If you want to use a FLUX Model or a Derivative for any purpose that is not expressly authorized under this License, such as for a commercial activity, you must request a license from Company, which Company may grant to you in Company’s sole discretion and which additional use may be subject to a fee, royalty or other revenue share. Please see https://bfl.ai/licensing if you would like a commercial license.
+- c. Reserved Rights. The grant of rights expressly set forth in this License are the complete grant of rights to use the FLUX Model, and no other licenses are granted, whether by waiver, estoppel, implication, equity, or otherwise. Company and its licensors reserve all rights not expressly granted by this License.
+- d. Outputs. We claim no ownership rights in and to the Outputs. You are solely responsible for the Outputs you generate and their subsequent uses in accordance with this License. You may use Output for any purpose (including for commercial purposes), except as expressly prohibited herein. You may not use the Output to train, fine-tune, or distill a model that is competitive with a FLUX Model.
+- e. You may access, use, Distribute, or create Output of the FLUX Model or Derivatives if you: (i) (A) implement and maintain content filtering measures (“Content Filters”) for your use of the FLUX Model or Derivatives to prevent the creation, display, transmission, generation, or dissemination of unlawful or infringing content, which may include Content Filters that we may make available for use with the FLUX Model (“Provided Content Filters”), or (B) ensure Output undergoes review for unlawful or infringing content before public or non-public distribution, display, transmission or dissemination; and (ii) ensure Output includes disclosure (or other indication) that the Output was generated or modified using artificial intelligence technologies to the extent required under applicable law.
+
+3. Distribution. Subject to this License, you may Distribute copies of the FLUX Model and/or Derivatives made by you, under the following conditions:
+- a. you must make available a copy of this License to third-party recipients of the FLUX Mode and/or Derivatives you Distribute, and specify that any rights to use the FLUX Model and/or Derivatives shall be directly granted by Company to said third-party recipients pursuant to this License;
+- b. you must prominently display the following notice alongside the Distribution of the FLUX Model or Derivative (such as via a “Notice” text file distributed as part of such FLUX Model or Derivative) (the “Attribution Notice”):
+
+> This FLUX Model is licensed by Black Forest Labs Inc. under the FLUX Non-Commercial License. Copyright Black Forest Labs Inc. IN NO EVENT SHALL BLACK FOREST LABS INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.
+
+- c. in the case of Distribution of Derivatives made by you: (i) you must also include in the Attribution Notice a statement that you have modified the applicable FLUX Model; (ii) any terms and conditions you impose on any third-party recipients relating to Derivatives made by or for you shall neither limit such third-party recipients’ use of the FLUX Model or any Derivatives made by or for Company in accordance with this License nor conflict with any of its terms and conditions and must include disclaimer of warranties and limitation of liability provisions that are at least as protective of Company as those set forth herein; and (iii) you must not misrepresent or imply, through any means, that the Derivatives made by or for you and/or any modified version of the FLUX Model you Distribute under your name and responsibility is an official product of the Company or has been endorsed, approved or validated by the Company, unless you are authorized by Company to do so in writing.
+
+4. Restrictions.  You will not, and will not permit, assist or cause any third party to
+- a. use, modify, copy, reproduce, create Derivatives of, or Distribute the FLUX Model (or any Derivative thereof, or any data produced by the FLUX Model), in whole or in part, (i) for any commercial or production purposes, (ii) military purposes, (iii) purposes of surveillance, including any research or development relating to surveillance, (iv) biometric processing, (v) in any manner that infringes, misappropriates, or otherwise violates (or is likely to infringe, misappropriate, or otherwise violate) any third party’s legal rights, including rights of publicity or “digital replica” rights, (vi) in any unlawful, fraudulent, defamatory, or abusive activity, (vii) to generate unlawful content, including child sexual abuse material, or non-consensual intimate images; or (viii) in any manner that violates any applicable law and any privacy or security laws, rules, regulations, directives, or governmental requirements (including the General Data Privacy Regulation (Regulation (EU) 2016/679), the California Consumer Privacy Act, any and all laws governing the processing of biometric information, and the EU Artificial Intelligence Act (Regulation (EU) 2024/1689), as well as all amendments and successor laws to any of the foregoing);
+  - b. alter or remove copyright and other proprietary notices which appear on or in any portion of the FLUX Model;
+  - c. utilize any equipment, device, software, or other means to circumvent or remove any security or protection used by Company in connection with the FLUX Model, or to circumvent or remove any usage restrictions, or to enable functionality disabled by FLUX  Model;
+  - d. offer or impose any terms on the FLUX Model that alter, restrict, or are inconsistent with the terms of this License;
+  - e. violate any applicable U.S. and non-U.S. export control and trade sanctions laws (“Export Laws”) in connection with your use or Distribution of any FLUX Model;
+  - f. directly or indirectly Distribute, export, or otherwise transfer FLUX Model (i) to any individual, entity, or country prohibited by Export Laws; (ii) to anyone on U.S. or non-U.S. government restricted parties lists; (iii) for any purpose prohibited by Export Laws, including nuclear, chemical or biological weapons, or missile technology applications; (iv) use or download FLUX Model if you or they are (a) located in a comprehensively sanctioned jurisdiction, (b) currently listed on any U.S. or non-U.S. restricted parties list, or (c) for any purpose prohibited by Export Laws; and (v) will not disguise your location through IP proxying or other methods.
+
+5. DISCLAIMERS.  THE FLUX MODEL AND PROVIDED CONTENT FILTERS ARE PROVIDED “AS IS” AND “WITH ALL FAULTS” WITH NO WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. COMPANY EXPRESSLY DISCLAIMS ALL REPRESENTATIONS AND WARRANTIES, EXPRESS OR IMPLIED, WHETHER BY STATUTE, CUSTOM, USAGE OR OTHERWISE AS TO ANY MATTERS RELATED TO THE FLUX MODEL AND PROVIDED CONTENT FILTERS, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, TITLE, SATISFACTORY QUALITY, OR NON-INFRINGEMENT. COMPANY MAKES NO WARRANTIES OR REPRESENTATIONS THAT THE FLUX MODEL AND PROVIDED CONTENT FILTERS WILL BE ERROR FREE OR FREE OF VIRUSES OR OTHER HARMFUL COMPONENTS, OR PRODUCE ANY PARTICULAR RESULTS.
+
+6. LIMITATION OF LIABILITY.  TO THE FULLEST EXTENT PERMITTED BY LAW, IN NO EVENT WILL COMPANY BE LIABLE TO YOU OR YOUR EMPLOYEES, AFFILIATES, USERS, OFFICERS OR DIRECTORS (A) UNDER ANY THEORY OF LIABILITY, WHETHER BASED IN CONTRACT, TORT, NEGLIGENCE, STRICT LIABILITY, WARRANTY, OR OTHERWISE UNDER THIS LICENSE, OR (B) FOR ANY INDIRECT, CONSEQUENTIAL, EXEMPLARY, INCIDENTAL, PUNITIVE OR SPECIAL DAMAGES OR LOST PROFITS, EVEN IF COMPANY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE FLUX MODEL, ITS CONSTITUENT COMPONENTS, PROVIDED CONTENT FILTERS, AND ANY OUTPUT (COLLECTIVELY, “MODEL MATERIALS”) ARE NOT DESIGNED OR INTENDED FOR USE IN ANY APPLICATION OR SITUATION WHERE FAILURE OR FAULT OF THE MODEL MATERIALS COULD REASONABLY BE ANTICIPATED TO LEAD TO SERIOUS INJURY OF ANY PERSON, INCLUDING POTENTIAL DISCRIMINATION OR VIOLATION OF AN INDIVIDUAL’S PRIVACY RIGHTS, OR TO SEVERE PHYSICAL, PROPERTY, OR ENVIRONMENTAL DAMAGE (EACH, A “HIGH-RISK USE”). IF YOU ELECT TO USE ANY OF THE MODEL MATERIALS FOR A HIGH-RISK USE, YOU DO SO AT YOUR OWN RISK. YOU AGREE TO DESIGN AND IMPLEMENT APPROPRIATE DECISION-MAKING AND RISK-MITIGATION PROCEDURES AND POLICIES IN CONNECTION WITH A HIGH-RISK USE SUCH THAT EVEN IF THERE IS A FAILURE OR FAULT IN ANY OF THE MODEL MATERIALS, THE SAFETY OF PERSONS OR PROPERTY AFFECTED BY THE ACTIVITY STAYS AT A LEVEL THAT IS REASONABLE, APPROPRIATE, AND LAWFUL FOR THE FIELD OF THE HIGH-RISK USE.
+
+7. INDEMNIFICATION. You will indemnify, defend and hold harmless Company and our subsidiaries and affiliates, and each of our respective shareholders, directors, officers, employees, agents, successors, and assigns (collectively, the “Company Parties”) from and against any losses, liabilities, damages, fines, penalties, and expenses (including reasonable attorneys’ fees) incurred by any Company Party in connection with any claim, demand, allegation, lawsuit, proceeding, or investigation (collectively, “Claims”) arising out of or related to  (a) your access to or use of the FLUX Model (including in connection with any Output, results or data generated from such access or use, or from your access or use of any Content Filters), including any High-Risk Use; (b) your Content Filters, including your failure to implement any Content Filters where required by this License such as in Section 2(e); (c) your violation of this License; or (d) your violation, misappropriation or infringement of any rights of another (including intellectual property or other proprietary rights and privacy rights). You will promptly notify the Company Parties of any such Claims, and cooperate with Company Parties in defending such Claims. You will also grant the Company Parties sole control of the defense or settlement, at Company’s sole option, of any Claims. This indemnity is in addition to, and not in lieu of, any other indemnities or remedies set forth in a written agreement between you and Company or the other Company Parties.
+
+8. Termination; Survival.
+        a. This License will automatically terminate upon any breach by you of the terms of this License.
+        b. We may terminate this License, in whole or in part, at any time upon notice (including electronic) to you.
+        c. If you initiate any legal action or proceedings against Company or any other entity (including a cross-claim or counterclaim in a lawsuit), alleging that the FLUX Model, any Derivative, or Provided Content Filters, or any part thereof, infringe upon intellectual property or other rights owned or licensable by you, then any licenses granted to you under this License will immediately terminate as of the date such legal action or claim is filed or initiated.
+        d. Upon termination of this License, you must cease all use, access or Distribution of the FLUX Model, any Derivatives, and any Provided Content Filters.  The following sections survive termination of this License: 2(c), 2(d), 4-11.
+
+9. Third Party Materials. The FLUX Model and Provided Content Filters may contain third-party software or other components (including free and open source software) (all of the foregoing, “Third Party Materials”), which are subject to the license terms of the respective third-party licensors. Your dealings or correspondence with third parties and your use of or interaction with any Third Party Materials are solely between you and the third party. Company does not control or endorse, and makes no representations or warranties regarding, any Third Party Materials, and your access to and use of such Third Party Materials are at your own risk.
+
+10. Trademarks. You have not been granted any trademark license as part of this License and may not use any name, logo or trademark associated with Company without the prior written permission of Company, except to the extent necessary to make the reference required in the Attribution Notice as specified above or as is reasonably necessary in describing the FLUX Model and its creators.
+
+11. General. This License will be governed and construed under the laws of the State of Delaware without regard to conflicts of law provisions. If any provision or part of a provision of this License is unlawful, void or unenforceable, that provision or part of the provision is deemed severed from this License, and will not affect the validity and enforceability of any remaining provisions. The failure of Company to exercise or enforce any right or provision of this License will not operate as a waiver of such right or provision. This License does not confer any third-party beneficiary rights upon any other person or entity. This License, together with the documentation, contains the entire understanding between you and Company regarding the subject matter of this License, and supersedes all other written or oral agreements and understandings between you and Company regarding such subject matter.

README.md

@@ -1,3 +1,84 @@
----
-license: apache-2.0
----
+---
+language:
+- en
+license: other
+license_name: flux-dev-non-commercial-license
+license_link: https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.txt
+base_model: black-forest-labs/FLUX.2-dev
+tags:
+- image-generation
+- flux
+- lora
+- distillation
+- turbo
+pipeline_tag: text-to-image
+library_name: diffusers
+---
+
+# FLUX.2 [dev] Turbo LoRA
+
+**FLUX.2 [dev] Turbo** is a distilled LoRA adapter for [FLUX.2 [dev]](https://huggingface.co/black-forest-labs/FLUX.2-dev) that enables high-quality image generation in just **8 inference steps**.
+
+![Example Text-to-Image](./example_t2i.png)
+---
+
+---
+
+![Example Image Editing](./example_edit.png)
+
+## Key Features
+
+- ⚡ **8-step inference** — 6x faster than the base model's typical 50 steps
+- 🎨 **Quality preserved** — Matches or surpasses the original FLUX.2 [dev] quality
+- 🔌 **LoRA adapter** — Lightweight, easy to integrate with existing FLUX.2 workflows
+- 🖼️ **Multiple modes** — Supports both text-to-image and image editing
+
+
+## Hosted API Endpoints
+
+FLUX.2 [dev] Turbo is available through fal.ai hosted endpoints:
+- [Text-to-Image](https://fal.ai/models/fal-ai/flux-2/turbo)
+- [Image Editing](https://fal.ai/models/fal-ai/flux-2/turbo/edit)
+
+
+## ComfyUI
+
+ComfyUI-compatible weights are available in the `comfy/` directory, converted by [ByteZSzn](https://huggingface.co/ByteZSzn/Flux.2-Turbo-ComfyUI).
+
+
+## Usage
+
+```python
+import torch
+from diffusers import Flux2Pipeline
+
+# Pre-shifted custom sigmas for 8-step turbo inference
+TURBO_SIGMAS = [1.0, 0.6509, 0.4374, 0.2932, 0.1893, 0.1108, 0.0495, 0.00031]
+
+pipe = Flux2Pipeline.from_pretrained(
+    "black-forest-labs/FLUX.2-dev", 
+    torch_dtype=torch.bfloat16
+).to("cuda")
+
+pipe.load_lora_weights(
+    "fal/FLUX.2-dev-Turbo", 
+    weight_name="flux.2-turbo-lora.safetensors"
+)
+
+prompt = "Industrial product shot of a chrome turbocharger with glowing hot exhaust manifold, engraved text 'FLUX.2 [dev] Turbo by fal' on the compressor housing and 'fal' on the turbine wheel, gradient heat glow from orange to electric blue , studio lighting with dramatic shadows, shallow depth of field, engineering blueprint pattern in background."
+
+image = pipe(
+    prompt=prompt,
+    sigmas=TURBO_SIGMAS,
+    guidance_scale=2.5,
+    height=1024,
+    width=1024,
+    num_inference_steps=8,
+).images[0]
+
+image.save("output.png")
+```
+
+## License
+
+This model inherits the [FLUX [dev] Non-Commercial License](https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.txt) from the base model.

ae.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:868fe7b343cc8f3a19dbcfcafbc3d5f888802be3f89bd81b65b3621a066ce8f3
+size 336211292

comfy/Flux_2-Turbo-LoRA_comfyui.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:011487390b8020baf22a9d543930c90d74a4809b7241bee6b0622777b17b413b
+size 2760814880

comfy/Workflow.json

@@ -0,0 +1,1395 @@
+{
+  "id": "7c048efb-a059-44e2-970a-43e1eb472d0d",
+  "revision": 0,
+  "last_node_id": 67,
+  "last_link_id": 165,
+  "nodes": [
+    {
+      "id": 22,
+      "type": "BasicGuider",
+      "pos": [
+        -160,
+        70
+      ],
+      "size": [
+        222.3482666015625,
+        46
+      ],
+      "flags": {},
+      "order": 22,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "model",
+          "type": "MODEL",
+          "link": 165
+        },
+        {
+          "name": "conditioning",
+          "type": "CONDITIONING",
+          "link": 153
+        }
+      ],
+      "outputs": [
+        {
+          "name": "GUIDER",
+          "type": "GUIDER",
+          "slot_index": 0,
+          "links": [
+            30
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "BasicGuider"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 40,
+      "type": "VAEEncode",
+      "pos": [
+        -405.919921875,
+        880
+      ],
+      "size": [
+        140,
+        46
+      ],
+      "flags": {
+        "collapsed": true
+      },
+      "order": 17,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "pixels",
+          "type": "IMAGE",
+          "link": 122
+        },
+        {
+          "name": "vae",
+          "type": "VAE",
+          "link": 120
+        }
+      ],
+      "outputs": [
+        {
+          "name": "LATENT",
+          "type": "LATENT",
+          "links": [
+            121
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "VAEEncode"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 42,
+      "type": "LoadImage",
+      "pos": [
+        -540,
+        400
+      ],
+      "size": [
+        274.080078125,
+        314
+      ],
+      "flags": {},
+      "order": 0,
+      "mode": 4,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "IMAGE",
+          "type": "IMAGE",
+          "links": [
+            123
+          ]
+        },
+        {
+          "name": "MASK",
+          "type": "MASK",
+          "links": null
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "LoadImage"
+      },
+      "widgets_values": [
+        "image_flux2_input_image.png",
+        "image"
+      ]
+    },
+    {
+      "id": 44,
+      "type": "VAEEncode",
+      "pos": [
+        -840,
+        880
+      ],
+      "size": [
+        140,
+        46
+      ],
+      "flags": {
+        "collapsed": true
+      },
+      "order": 18,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "pixels",
+          "type": "IMAGE",
+          "link": 126
+        },
+        {
+          "name": "vae",
+          "type": "VAE",
+          "link": 127
+        }
+      ],
+      "outputs": [
+        {
+          "name": "LATENT",
+          "type": "LATENT",
+          "links": [
+            125
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "VAEEncode"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 39,
+      "type": "ReferenceLatent",
+      "pos": [
+        -463.6328125,
+        920
+      ],
+      "size": [
+        204.134765625,
+        46
+      ],
+      "flags": {},
+      "order": 21,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "conditioning",
+          "type": "CONDITIONING",
+          "link": 145
+        },
+        {
+          "name": "latent",
+          "shape": 7,
+          "type": "LATENT",
+          "link": 121
+        }
+      ],
+      "outputs": [
+        {
+          "name": "CONDITIONING",
+          "type": "CONDITIONING",
+          "links": [
+            153
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "ReferenceLatent"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 26,
+      "type": "FluxGuidance",
+      "pos": [
+        -520,
+        220
+      ],
+      "size": [
+        317.4000244140625,
+        58
+      ],
+      "flags": {},
+      "order": 19,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "conditioning",
+          "type": "CONDITIONING",
+          "link": 41
+        }
+      ],
+      "outputs": [
+        {
+          "name": "CONDITIONING",
+          "type": "CONDITIONING",
+          "slot_index": 0,
+          "links": [
+            144
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "FluxGuidance"
+      },
+      "widgets_values": [
+        4
+      ],
+      "color": "#233",
+      "bgcolor": "#355"
+    },
+    {
+      "id": 16,
+      "type": "KSamplerSelect",
+      "pos": [
+        -160,
+        160
+      ],
+      "size": [
+        222.3482666015625,
+        58
+      ],
+      "flags": {},
+      "order": 1,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "SAMPLER",
+          "type": "SAMPLER",
+          "links": [
+            19
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "KSamplerSelect"
+      },
+      "widgets_values": [
+        "euler"
+      ]
+    },
+    {
+      "id": 43,
+      "type": "ReferenceLatent",
+      "pos": [
+        -910,
+        920
+      ],
+      "size": [
+        204.134765625,
+        46
+      ],
+      "flags": {},
+      "order": 20,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "conditioning",
+          "type": "CONDITIONING",
+          "link": 144
+        },
+        {
+          "name": "latent",
+          "shape": 7,
+          "type": "LATENT",
+          "link": 125
+        }
+      ],
+      "outputs": [
+        {
+          "name": "CONDITIONING",
+          "type": "CONDITIONING",
+          "links": [
+            145
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "ReferenceLatent"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 50,
+      "type": "PrimitiveNode",
+      "pos": [
+        -160,
+        470
+      ],
+      "size": [
+        210,
+        82
+      ],
+      "flags": {},
+      "order": 2,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "INT",
+          "type": "INT",
+          "widget": {
+            "name": "width"
+          },
+          "links": [
+            135,
+            136
+          ]
+        }
+      ],
+      "title": "width",
+      "properties": {
+        "Run widget replace on values": false
+      },
+      "widgets_values": [
+        1248,
+        "fixed"
+      ],
+      "color": "#223",
+      "bgcolor": "#335"
+    },
+    {
+      "id": 51,
+      "type": "PrimitiveNode",
+      "pos": [
+        -160,
+        590
+      ],
+      "size": [
+        210,
+        82
+      ],
+      "flags": {},
+      "order": 3,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "INT",
+          "type": "INT",
+          "widget": {
+            "name": "height"
+          },
+          "links": [
+            137,
+            138
+          ]
+        }
+      ],
+      "title": "height",
+      "properties": {
+        "Run widget replace on values": false
+      },
+      "widgets_values": [
+        832,
+        "fixed"
+      ],
+      "color": "#223",
+      "bgcolor": "#335"
+    },
+    {
+      "id": 10,
+      "type": "VAELoader",
+      "pos": [
+        -973.1827364834872,
+        230
+      ],
+      "size": [
+        298.1818181818182,
+        60.429901123046875
+      ],
+      "flags": {},
+      "order": 4,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "VAE",
+          "type": "VAE",
+          "slot_index": 0,
+          "links": [
+            120,
+            127,
+            159
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "VAELoader",
+        "models": [
+          {
+            "name": "flux2-vae.safetensors",
+            "url": "https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/vae/flux2-vae.safetensors",
+            "directory": "vae"
+          }
+        ]
+      },
+      "widgets_values": [
+        "flux2-vae.safetensors"
+      ]
+    },
+    {
+      "id": 47,
+      "type": "EmptyFlux2LatentImage",
+      "pos": [
+        110,
+        500
+      ],
+      "size": [
+        270,
+        106
+      ],
+      "flags": {},
+      "order": 12,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "width",
+          "type": "INT",
+          "widget": {
+            "name": "width"
+          },
+          "link": 135
+        },
+        {
+          "name": "height",
+          "type": "INT",
+          "widget": {
+            "name": "height"
+          },
+          "link": 137
+        }
+      ],
+      "outputs": [
+        {
+          "name": "LATENT",
+          "type": "LATENT",
+          "links": [
+            161
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "EmptyFlux2LatentImage"
+      },
+      "widgets_values": [
+        1248,
+        832,
+        1
+      ]
+    },
+    {
+      "id": 13,
+      "type": "SamplerCustomAdvanced",
+      "pos": [
+        90,
+        -40
+      ],
+      "size": [
+        272.3617858886719,
+        124.53733825683594
+      ],
+      "flags": {},
+      "order": 23,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "noise",
+          "type": "NOISE",
+          "link": 37
+        },
+        {
+          "name": "guider",
+          "type": "GUIDER",
+          "link": 30
+        },
+        {
+          "name": "sampler",
+          "type": "SAMPLER",
+          "link": 19
+        },
+        {
+          "name": "sigmas",
+          "type": "SIGMAS",
+          "link": 132
+        },
+        {
+          "name": "latent_image",
+          "type": "LATENT",
+          "link": 161
+        }
+      ],
+      "outputs": [
+        {
+          "name": "output",
+          "type": "LATENT",
+          "slot_index": 0,
+          "links": [
+            24
+          ]
+        },
+        {
+          "name": "denoised_output",
+          "type": "LATENT",
+          "links": null
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "SamplerCustomAdvanced"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 41,
+      "type": "ImageScaleToTotalPixels",
+      "pos": [
+        -535.919921875,
+        750
+      ],
+      "size": [
+        270,
+        106
+      ],
+      "flags": {},
+      "order": 11,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "image",
+          "type": "IMAGE",
+          "link": 123
+        }
+      ],
+      "outputs": [
+        {
+          "name": "IMAGE",
+          "type": "IMAGE",
+          "links": [
+            122
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "ImageScaleToTotalPixels"
+      },
+      "widgets_values": [
+        "lanczos",
+        1,
+        1
+      ]
+    },
+    {
+      "id": 8,
+      "type": "VAEDecode",
+      "pos": [
+        -140,
+        750
+      ],
+      "size": [
+        210,
+        46
+      ],
+      "flags": {},
+      "order": 24,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "samples",
+          "type": "LATENT",
+          "link": 24
+        },
+        {
+          "name": "vae",
+          "type": "VAE",
+          "link": 159
+        }
+      ],
+      "outputs": [
+        {
+          "name": "IMAGE",
+          "type": "IMAGE",
+          "slot_index": 0,
+          "links": [
+            9
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "VAEDecode"
+      },
+      "widgets_values": []
+    },
+    {
+      "id": 45,
+      "type": "ImageScaleToTotalPixels",
+      "pos": [
+        -970,
+        750
+      ],
+      "size": [
+        270,
+        106
+      ],
+      "flags": {},
+      "order": 14,
+      "mode": 4,
+      "inputs": [
+        {
+          "name": "image",
+          "type": "IMAGE",
+          "link": 128
+        }
+      ],
+      "outputs": [
+        {
+          "name": "IMAGE",
+          "type": "IMAGE",
+          "links": [
+            126
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "ImageScaleToTotalPixels"
+      },
+      "widgets_values": [
+        "lanczos",
+        1,
+        1
+      ]
+    },
+    {
+      "id": 60,
+      "type": "Note",
+      "pos": [
+        -980,
+        1070
+      ],
+      "size": [
+        460,
+        130
+      ],
+      "flags": {},
+      "order": 5,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [],
+      "properties": {},
+      "widgets_values": [
+        "Unbypass (CTRL-B) the ReferenceLatent nodes to give ref images.\n\nIf you want to add more reference images, you can add multiple reference images by following the pattern.\n\nIf you don't want any reference image, just select all ReferenceLatent nodes and then use CTRL-B to bypass them, turning the workflow into a Text to Image workflow."
+      ],
+      "color": "#432",
+      "bgcolor": "#653"
+    },
+    {
+      "id": 6,
+      "type": "CLIPTextEncode",
+      "pos": [
+        -630,
+        -50
+      ],
+      "size": [
+        430,
+        200
+      ],
+      "flags": {},
+      "order": 16,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "clip",
+          "type": "CLIP",
+          "link": 117
+        }
+      ],
+      "outputs": [
+        {
+          "name": "CONDITIONING",
+          "type": "CONDITIONING",
+          "slot_index": 0,
+          "links": [
+            41
+          ]
+        }
+      ],
+      "title": "CLIP Text Encode (Positive Prompt)",
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "CLIPTextEncode"
+      },
+      "widgets_values": [
+        "The woman is wearing a small pale yellow knitted beanie, with a white fabric patch on the front right, embroidered with big gray text “FLUX.2 COMFY.” Keep the face"
+      ],
+      "color": "#232",
+      "bgcolor": "#353"
+    },
+    {
+      "id": 46,
+      "type": "LoadImage",
+      "pos": [
+        -970,
+        390
+      ],
+      "size": [
+        274.080078125,
+        314
+      ],
+      "flags": {},
+      "order": 6,
+      "mode": 4,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "IMAGE",
+          "type": "IMAGE",
+          "links": [
+            128
+          ]
+        },
+        {
+          "name": "MASK",
+          "type": "MASK",
+          "links": null
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "LoadImage"
+      },
+      "widgets_values": [
+        "image_flux2_input_image.png",
+        "image"
+      ]
+    },
+    {
+      "id": 9,
+      "type": "SaveImage",
+      "pos": [
+        410,
+        -90
+      ],
+      "size": [
+        985.3012084960938,
+        1060.3828125
+      ],
+      "flags": {},
+      "order": 25,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "images",
+          "type": "IMAGE",
+          "link": 9
+        }
+      ],
+      "outputs": [],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "SaveImage"
+      },
+      "widgets_values": [
+        "Flux2"
+      ]
+    },
+    {
+      "id": 12,
+      "type": "UNETLoader",
+      "pos": [
+        -973.1827364834872,
+        -42
+      ],
+      "size": [
+        298.1818181818182,
+        82
+      ],
+      "flags": {},
+      "order": 7,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "MODEL",
+          "type": "MODEL",
+          "slot_index": 0,
+          "links": [
+            164
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "UNETLoader",
+        "models": [
+          {
+            "name": "flux2_dev_fp8mixed.safetensors",
+            "url": "https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/diffusion_models/flux2_dev_fp8mixed.safetensors",
+            "directory": "diffusion_models"
+          }
+        ]
+      },
+      "widgets_values": [
+        "flux2_dev_fp8mixed.safetensors",
+        "default"
+      ]
+    },
+    {
+      "id": 66,
+      "type": "MarkdownNote",
+      "pos": [
+        -1520,
+        -90
+      ],
+      "size": [
+        520,
+        500
+      ],
+      "flags": {
+        "collapsed": false
+      },
+      "order": 8,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [],
+      "title": "Model links",
+      "properties": {},
+      "widgets_values": [
+        "We are using quantized weights in this workflow, the original flux 2 repo is [here](https://huggingface.co/black-forest-labs/FLUX.2-dev/)\n## Report issue\n\nIf you found any issues when running this workflow, [report template issue here](https://github.com/Comfy-Org/workflow_templates/issues)\n\n\n## Model links\n\n**text_encoders**\n\n- [mistral_3_small_flux2_bf16.safetensors](https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/text_encoders/mistral_3_small_flux2_bf16.safetensors)\n\n**loras**\n\n- [flux2_berthe_morisot.safetensors](https://huggingface.co/ostris/flux2_berthe_morisot/resolve/main/flux2_berthe_morisot.safetensors)\n\n**diffusion_models**\n\n- [flux2_dev_fp8mixed.safetensors](https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/diffusion_models/flux2_dev_fp8mixed.safetensors)\n\n**vae**\n\n- [flux2-vae.safetensors](https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/vae/flux2-vae.safetensors)\n\n\nModel Storage Location\n\n```\n📂 ComfyUI/\n├── 📂 models/\n│   ├── 📂 text_encoders/\n│   │      └── mistral_3_small_flux2_bf16.safetensors\n│   ├── 📂 loras/\n│   │      └── flux2_berthe_morisot.safetensors\n│   ├── 📂 diffusion_models/\n│   │      └── flux2_dev_fp8mixed.safetensors\n│   └── 📂 vae/\n│          └── flux2-vae.safetensors\n```\n"
+      ],
+      "color": "#432",
+      "bgcolor": "#653"
+    },
+    {
+      "id": 38,
+      "type": "CLIPLoader",
+      "pos": [
+        -973.1827364834872,
+        82
+      ],
+      "size": [
+        298.1818181818182,
+        106
+      ],
+      "flags": {},
+      "order": 9,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "CLIP",
+          "type": "CLIP",
+          "links": [
+            117
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "CLIPLoader",
+        "models": [
+          {
+            "name": "mistral_3_small_flux2_bf16.safetensors",
+            "url": "https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/text_encoders/mistral_3_small_flux2_bf16.safetensors",
+            "directory": "text_encoders"
+          }
+        ]
+      },
+      "widgets_values": [
+        "mistral_3_small_flux2_fp8.safetensors",
+        "flux2",
+        "default"
+      ]
+    },
+    {
+      "id": 67,
+      "type": "LoraLoaderModelOnly",
+      "pos": [
+        -550,
+        -230
+      ],
+      "size": [
+        270,
+        82
+      ],
+      "flags": {},
+      "order": 15,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "model",
+          "type": "MODEL",
+          "link": 164
+        }
+      ],
+      "outputs": [
+        {
+          "name": "MODEL",
+          "type": "MODEL",
+          "links": [
+            165
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.6.0",
+        "Node name for S&R": "LoraLoaderModelOnly",
+        "models": [
+          {
+            "name": "flux2_berthe_morisot.safetensors",
+            "url": "https://huggingface.co/ostris/flux2_berthe_morisot/resolve/main/flux2_berthe_morisot.safetensors",
+            "directory": "loras"
+          }
+        ]
+      },
+      "widgets_values": [
+        "Flux_2-Turbo-LoRA_comfyui.safetensors",
+        1
+      ]
+    },
+    {
+      "id": 25,
+      "type": "RandomNoise",
+      "pos": [
+        -160,
+        -50
+      ],
+      "size": [
+        222.3482666015625,
+        82
+      ],
+      "flags": {},
+      "order": 10,
+      "mode": 0,
+      "inputs": [],
+      "outputs": [
+        {
+          "name": "NOISE",
+          "type": "NOISE",
+          "links": [
+            37
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "RandomNoise"
+      },
+      "widgets_values": [
+        108865988415532,
+        "randomize"
+      ]
+    },
+    {
+      "id": 48,
+      "type": "Flux2Scheduler",
+      "pos": [
+        -160,
+        260
+      ],
+      "size": [
+        222.3482666015625,
+        106
+      ],
+      "flags": {},
+      "order": 13,
+      "mode": 0,
+      "inputs": [
+        {
+          "name": "width",
+          "type": "INT",
+          "widget": {
+            "name": "width"
+          },
+          "link": 136
+        },
+        {
+          "name": "height",
+          "type": "INT",
+          "widget": {
+            "name": "height"
+          },
+          "link": 138
+        }
+      ],
+      "outputs": [
+        {
+          "name": "SIGMAS",
+          "type": "SIGMAS",
+          "links": [
+            132
+          ]
+        }
+      ],
+      "properties": {
+        "cnr_id": "comfy-core",
+        "ver": "0.3.71",
+        "Node name for S&R": "Flux2Scheduler"
+      },
+      "widgets_values": [
+        8,
+        1248,
+        832
+      ]
+    }
+  ],
+  "links": [
+    [
+      9,
+      8,
+      0,
+      9,
+      0,
+      "IMAGE"
+    ],
+    [
+      19,
+      16,
+      0,
+      13,
+      2,
+      "SAMPLER"
+    ],
+    [
+      24,
+      13,
+      0,
+      8,
+      0,
+      "LATENT"
+    ],
+    [
+      30,
+      22,
+      0,
+      13,
+      1,
+      "GUIDER"
+    ],
+    [
+      37,
+      25,
+      0,
+      13,
+      0,
+      "NOISE"
+    ],
+    [
+      41,
+      6,
+      0,
+      26,
+      0,
+      "CONDITIONING"
+    ],
+    [
+      117,
+      38,
+      0,
+      6,
+      0,
+      "CLIP"
+    ],
+    [
+      120,
+      10,
+      0,
+      40,
+      1,
+      "VAE"
+    ],
+    [
+      121,
+      40,
+      0,
+      39,
+      1,
+      "LATENT"
+    ],
+    [
+      122,
+      41,
+      0,
+      40,
+      0,
+      "IMAGE"
+    ],
+    [
+      123,
+      42,
+      0,
+      41,
+      0,
+      "IMAGE"
+    ],
+    [
+      125,
+      44,
+      0,
+      43,
+      1,
+      "LATENT"
+    ],
+    [
+      126,
+      45,
+      0,
+      44,
+      0,
+      "IMAGE"
+    ],
+    [
+      127,
+      10,
+      0,
+      44,
+      1,
+      "VAE"
+    ],
+    [
+      128,
+      46,
+      0,
+      45,
+      0,
+      "IMAGE"
+    ],
+    [
+      132,
+      48,
+      0,
+      13,
+      3,
+      "SIGMAS"
+    ],
+    [
+      135,
+      50,
+      0,
+      47,
+      0,
+      "INT"
+    ],
+    [
+      136,
+      50,
+      0,
+      48,
+      0,
+      "INT"
+    ],
+    [
+      137,
+      51,
+      0,
+      47,
+      1,
+      "INT"
+    ],
+    [
+      138,
+      51,
+      0,
+      48,
+      1,
+      "INT"
+    ],
+    [
+      144,
+      26,
+      0,
+      43,
+      0,
+      "CONDITIONING"
+    ],
+    [
+      145,
+      43,
+      0,
+      39,
+      0,
+      "CONDITIONING"
+    ],
+    [
+      153,
+      39,
+      0,
+      22,
+      1,
+      "CONDITIONING"
+    ],
+    [
+      159,
+      10,
+      0,
+      8,
+      1,
+      "VAE"
+    ],
+    [
+      161,
+      47,
+      0,
+      13,
+      4,
+      "LATENT"
+    ],
+    [
+      164,
+      12,
+      0,
+      67,
+      0,
+      "MODEL"
+    ],
+    [
+      165,
+      67,
+      0,
+      22,
+      0,
+      "MODEL"
+    ]
+  ],
+  "groups": [
+    {
+      "id": 1,
+      "title": "Step 1 - Upload models",
+      "bounding": [
+        -980,
+        -120,
+        318.18181818181813,
+        416.0299011230469
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    },
+    {
+      "id": 2,
+      "title": "Custom sampler",
+      "bounding": [
+        -170,
+        -120,
+        558.5359191894531,
+        501.6
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    },
+    {
+      "id": 3,
+      "title": "Step 4- Image size",
+      "bounding": [
+        -170,
+        400,
+        560,
+        285.6
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    },
+    {
+      "id": 4,
+      "title": "Step2 - Prompt",
+      "bounding": [
+        -640,
+        -120,
+        450,
+        420
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    },
+    {
+      "id": 5,
+      "title": "Step 3- Reference images",
+      "bounding": [
+        -980,
+        320,
+        790,
+        700
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    },
+    {
+      "id": 6,
+      "title": "Ctrl-B to Enable",
+      "bounding": [
+        -640,
+        -310,
+        450,
+        170
+      ],
+      "color": "#3f789e",
+      "font_size": 24,
+      "flags": {}
+    }
+  ],
+  "config": {},
+  "extra": {
+    "ds": {
+      "scale": 0.8907171599668258,
+      "offset": [
+        1485.8806212299676,
+        483.18657780300765
+      ]
+    },
+    "frontendVersion": "1.34.9",
+    "workflowRendererVersion": "LG",
+    "groupNodes": {},
+    "VHS_latentpreview": false,
+    "VHS_latentpreviewrate": 0,
+    "VHS_MetadataImage": true,
+    "VHS_KeepIntermediate": true
+  },
+  "version": 0.4
+}

flux.2-turbo-lora.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f76cf9c2cc546ddca878799136434a1098477af3f4b0adff2cfd79f2ebe4aa01
+size 2760818216

flux2-dev.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6159a3f19f829c8e84ba6e9996b7afaf7c0a5f3428677f5b37445778a320d275
+size 64446596128

model_index.json

@@ -0,0 +1,24 @@
+{
+  "_class_name": "Flux2Pipeline",
+  "_diffusers_version": "0.36.0.dev0",
+  "scheduler": [
+    "diffusers",
+    "FlowMatchEulerDiscreteScheduler"
+  ],
+  "text_encoder": [
+    "transformers",
+    "Mistral3ForConditionalGeneration"
+  ],
+  "tokenizer": [
+    "transformers",
+    "PixtralProcessor"
+  ],
+  "transformer": [
+    "diffusers",
+    "Flux2Transformer2DModel"
+  ],
+  "vae": [
+    "diffusers",
+    "AutoencoderKLFlux2"
+  ]
+}

scheduler/scheduler_config.json

@@ -0,0 +1,18 @@
+{
+  "_class_name": "FlowMatchEulerDiscreteScheduler",
+  "_diffusers_version": "0.36.0.dev0",
+  "base_image_seq_len": 256,
+  "base_shift": 0.5,
+  "invert_sigmas": false,
+  "max_image_seq_len": 4096,
+  "max_shift": 1.15,
+  "num_train_timesteps": 1000,
+  "shift": 3.0,
+  "shift_terminal": null,
+  "stochastic_sampling": false,
+  "time_shift_type": "exponential",
+  "use_beta_sigmas": false,
+  "use_dynamic_shifting": true,
+  "use_exponential_sigmas": false,
+  "use_karras_sigmas": false
+}

text_encoder/config.json

@@ -0,0 +1,48 @@
+{
+  "architectures": [
+    "Mistral3ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "image_token_index": 10,
+  "model_type": "mistral3",
+  "multimodal_projector_bias": false,
+  "projector_hidden_act": "gelu",
+  "spatial_merge_size": 2,
+  "text_config": {
+    "attention_dropout": 0.0,
+    "dtype": "bfloat16",
+    "head_dim": 128,
+    "hidden_act": "silu",
+    "hidden_size": 5120,
+    "initializer_range": 0.02,
+    "intermediate_size": 32768,
+    "max_position_embeddings": 131072,
+    "model_type": "mistral",
+    "num_attention_heads": 32,
+    "num_hidden_layers": 40,
+    "num_key_value_heads": 8,
+    "rms_norm_eps": 1e-05,
+    "rope_theta": 1000000000.0,
+    "sliding_window": null,
+    "use_cache": true,
+    "vocab_size": 131072
+  },
+  "transformers_version": "4.57.1",
+  "vision_config": {
+    "attention_dropout": 0.0,
+    "dtype": "bfloat16",
+    "head_dim": 64,
+    "hidden_act": "silu",
+    "hidden_size": 1024,
+    "image_size": 1540,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "pixtral",
+    "num_attention_heads": 16,
+    "num_channels": 3,
+    "num_hidden_layers": 24,
+    "patch_size": 14,
+    "rope_theta": 10000.0
+  },
+  "vision_feature_layer": -1
+}

text_encoder/generation_config.json

@@ -0,0 +1,8 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "do_sample": true,
+  "eos_token_id": 2,
+  "temperature": 0.15,
+  "transformers_version": "4.57.1"
+}

text_encoder/model-00001-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91831c2ce219df0ce63bc33c6249e5cb01db8d93816bcebf975f1c406286520e
+size 4883550696

text_encoder/model-00002-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ffe80706a66b2f5ef1fb058806ccf09f124ec4ad38af7a377e44ab1ee2fd664
+size 4781593336

text_encoder/model-00003-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99ec66e891f9563f568734eadfc5b7701e04620e8e163d4d5755277a3b50cf2f
+size 4886472224

text_encoder/model-00004-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1df1527b12b1eb5cbd9a50914f9e6eb24e885ec830a3c16b5eed6ad0b53a396
+size 4781593376

text_encoder/model-00005-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3556ac03f47c24eb8ad27c237e25baad639c651d9596fd72cb1523137bf56163
+size 4781593368

text_encoder/model-00006-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c41e6f80f2b5ca384ce703eac048a13daf2aff689c3acca66a8943f45338aae
+size 4886472248

text_encoder/model-00007-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62a725f154f6ba942a36b5cc450db2b2df32f434e3224558c789bc04fa05fd36
+size 4781593376

text_encoder/model-00008-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a1a6ac77e6434418bb7273b68a7b3534fed5217c990061c92a8f990dd6ab20e
+size 4781593368

text_encoder/model-00009-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1fffc9bb2b77d4d2382c1bd9053e9d017741d67ca00cc6f77034a294f2f5cfd
+size 4886472248

text_encoder/model-00010-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:116ef7ae6fa0fd46b478324e4aa6a49f448afed900ca9f71d4fbd3d02289bbd4
+size 4571866320

text_encoder/model.safetensors.index.json

@@ -0,0 +1,593 @@
+{
+  "metadata": {
+    "total_parameters": 24011361280,
+    "total_size": 48022722560
+  },
+  "weight_map": {
+    "language_model.lm_head.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.embed_tokens.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.input_layernorm.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.mlp.down_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.mlp.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.mlp.up_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.post_attention_layernorm.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.self_attn.k_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.self_attn.o_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.self_attn.q_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.0.self_attn.v_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.input_layernorm.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.mlp.down_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.mlp.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.mlp.up_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.post_attention_layernorm.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.self_attn.k_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.self_attn.o_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.self_attn.q_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.1.self_attn.v_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.10.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.10.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.11.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.11.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.11.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.11.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.11.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.11.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.11.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.11.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.11.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.12.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.12.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.13.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.14.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.15.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.15.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.15.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.15.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.15.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.15.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.15.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.15.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.15.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "language_model.model.layers.16.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.16.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.17.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.18.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.19.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.19.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.19.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.19.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "language_model.model.layers.2.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.2.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.2.mlp.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.2.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.2.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.2.self_attn.k_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.2.self_attn.o_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.2.self_attn.q_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.2.self_attn.v_proj.weight": "model-00001-of-00010.safetensors",
+    "language_model.model.layers.20.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.20.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.21.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.22.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.23.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.24.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.24.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.24.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.24.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.24.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.24.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.24.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.24.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.24.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "language_model.model.layers.25.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.25.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.26.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.27.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.28.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.28.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.28.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.28.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.28.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.28.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.28.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.28.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.28.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "language_model.model.layers.29.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.29.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.3.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.3.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.30.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.30.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.31.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.32.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.32.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.32.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.32.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "language_model.model.layers.33.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.33.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.34.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.35.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.36.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.37.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.37.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.37.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.37.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.37.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.37.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.37.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.37.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.37.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "language_model.model.layers.38.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.38.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.39.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "language_model.model.layers.4.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.4.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.5.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.6.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.6.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.6.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.6.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "language_model.model.layers.7.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.7.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.8.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.layers.9.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "language_model.model.norm.weight": "model-00010-of-00010.safetensors",
+    "multi_modal_projector.linear_1.weight": "model-00001-of-00010.safetensors",
+    "multi_modal_projector.linear_2.weight": "model-00001-of-00010.safetensors",
+    "multi_modal_projector.norm.weight": "model-00001-of-00010.safetensors",
+    "multi_modal_projector.patch_merger.merging_layer.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.ln_pre.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.patch_conv.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.0.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.1.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.10.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.11.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.12.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.13.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.14.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.15.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.16.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.17.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.18.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.19.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.2.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.20.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.21.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.22.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.23.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.3.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.4.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.5.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.6.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.7.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.8.ffn_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.attention.k_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.attention.o_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.attention.q_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.attention.v_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.attention_norm.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.feed_forward.down_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.feed_forward.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.feed_forward.up_proj.weight": "model-00001-of-00010.safetensors",
+    "vision_tower.transformer.layers.9.ffn_norm.weight": "model-00001-of-00010.safetensors"
+  }
+}

tokenizer/chat_template.jinja

@@ -0,0 +1,51 @@
+{%- set today = strftime_now("%Y-%m-%d") %}
+{%- set default_system_message = "You are Mistral Small 3, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris.\nYour knowledge base was last updated on 2023-10-01. The current date is " + today + ".\n\nWhen you're not sure about some information, you say that you don't have the information and don't make up anything.\nIf the user's question is not clear, ambiguous, or does not provide enough context for you to accurately answer the question, you do not try to answer it right away and you rather ask the user to clarify their request (e.g. \"What are some good restaurants around me?\" => \"Where are you?\" or \"When is the next flight to Tokyo\" => \"Where do you travel from?\")" %}
+
+{{- bos_token }}
+
+{%- if messages[0]['role'] == 'system' %}
+    {%- if messages[0]['content'] is string %}
+        {%- set system_message = messages[0]['content'] %}
+    {%- else %}
+        {%- set system_message = messages[0]['content'][0]['text'] %}
+    {%- endif %}
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = default_system_message %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+{{- '[SYSTEM_PROMPT]' + system_message + '[/SYSTEM_PROMPT]' }}
+
+{%- for message in loop_messages %}
+    {%- if message['role'] == 'user' %}
+        {%- if message['content'] is string %}
+            {{- '[INST]' + message['content'] + '[/INST]' }}
+        {%- else %}
+            {{- '[INST]' }}
+            {%- for block in message['content'] %}
+                {%- if block['type'] == 'text' %}
+                    {{- block['text'] }}
+                {%- elif block['type'] in ['image', 'image_url'] %}
+                    {{- '[IMG]' }}
+                {%- else %}
+                    {{- raise_exception('Only text and image blocks are supported in message content!') }}
+                {%- endif %}
+            {%- endfor %}
+            {{- '[/INST]' }}
+        {%- endif %}
+    {%- elif message['role'] == 'system' %}
+        {%- if message['content'] is string %}
+            {{- '[SYSTEM_PROMPT]' + message['content'] + '[/SYSTEM_PROMPT]' }}
+        {%- else %}
+            {{- '[SYSTEM_PROMPT]' + message['content'][0]['text'] + '[/SYSTEM_PROMPT]' }}
+        {%- endif %}
+    {%- elif message['role'] == 'assistant' %}
+        {%- if message['content'] is string %}
+            {{- message['content'] + eos_token }}
+        {%- else %}
+            {{- message['content'][0]['text'] + eos_token }}
+        {%- endif %}
+    {%- else %}
+        {{- raise_exception('Only user, system and assistant roles are supported!') }}
+    {%- endif %}
+{%- endfor %}

tokenizer/preprocessor_config.json

@@ -0,0 +1,34 @@
+{
+  "crop_size": null,
+  "data_format": "channels_first",
+  "default_to_square": true,
+  "device": null,
+  "disable_grouping": null,
+  "do_center_crop": null,
+  "do_convert_rgb": true,
+  "do_normalize": true,
+  "do_pad": null,
+  "do_rescale": true,
+  "do_resize": true,
+  "image_mean": [
+    0.48145466,
+    0.4578275,
+    0.40821073
+  ],
+  "image_processor_type": "PixtralImageProcessorFast",
+  "image_std": [
+    0.26862954,
+    0.26130258,
+    0.27577711
+  ],
+  "input_data_format": null,
+  "pad_size": null,
+  "patch_size": 14,
+  "processor_class": "PixtralProcessor",
+  "resample": 3,
+  "rescale_factor": 0.00392156862745098,
+  "return_tensors": null,
+  "size": {
+    "longest_edge": 1540
+  }
+}

tokenizer/processor_config.json

@@ -0,0 +1,8 @@
+{
+  "image_break_token": "[IMG_BREAK]",
+  "image_end_token": "[IMG_END]",
+  "image_token": "[IMG]",
+  "patch_size": 14,
+  "processor_class": "PixtralProcessor",
+  "spatial_merge_size": 2
+}

tokenizer/special_tokens_map.json

@@ -0,0 +1,1032 @@
+{
+  "additional_special_tokens": [
+    "<unk>",
+    "<s>",
+    "</s>",
+    "[INST]",
+    "[/INST]",
+    "[AVAILABLE_TOOLS]",
+    "[/AVAILABLE_TOOLS]",
+    "[TOOL_RESULTS]",
+    "[/TOOL_RESULTS]",
+    "[TOOL_CALLS]",
+    "[IMG]",
+    "<pad>",
+    "[IMG_BREAK]",
+    "[IMG_END]",
+    "[PREFIX]",
+    "[MIDDLE]",
+    "[SUFFIX]",
+    "[SYSTEM_PROMPT]",
+    "[/SYSTEM_PROMPT]",
+    "[TOOL_CONTENT]",
+    "<SPECIAL_20>",
+    "<SPECIAL_21>",
+    "<SPECIAL_22>",
+    "<SPECIAL_23>",
+    "<SPECIAL_24>",
+    "<SPECIAL_25>",
+    "<SPECIAL_26>",
+    "<SPECIAL_27>",
+    "<SPECIAL_28>",
+    "<SPECIAL_29>",
+    "<SPECIAL_30>",
+    "<SPECIAL_31>",
+    "<SPECIAL_32>",
+    "<SPECIAL_33>",
+    "<SPECIAL_34>",
+    "<SPECIAL_35>",
+    "<SPECIAL_36>",
+    "<SPECIAL_37>",
+    "<SPECIAL_38>",
+    "<SPECIAL_39>",
+    "<SPECIAL_40>",
+    "<SPECIAL_41>",
+    "<SPECIAL_42>",
+    "<SPECIAL_43>",
+    "<SPECIAL_44>",
+    "<SPECIAL_45>",
+    "<SPECIAL_46>",
+    "<SPECIAL_47>",
+    "<SPECIAL_48>",
+    "<SPECIAL_49>",
+    "<SPECIAL_50>",
+    "<SPECIAL_51>",
+    "<SPECIAL_52>",
+    "<SPECIAL_53>",
+    "<SPECIAL_54>",
+    "<SPECIAL_55>",
+    "<SPECIAL_56>",
+    "<SPECIAL_57>",
+    "<SPECIAL_58>",
+    "<SPECIAL_59>",
+    "<SPECIAL_60>",
+    "<SPECIAL_61>",
+    "<SPECIAL_62>",
+    "<SPECIAL_63>",
+    "<SPECIAL_64>",
+    "<SPECIAL_65>",
+    "<SPECIAL_66>",
+    "<SPECIAL_67>",
+    "<SPECIAL_68>",
+    "<SPECIAL_69>",
+    "<SPECIAL_70>",
+    "<SPECIAL_71>",
+    "<SPECIAL_72>",
+    "<SPECIAL_73>",
+    "<SPECIAL_74>",
+    "<SPECIAL_75>",
+    "<SPECIAL_76>",
+    "<SPECIAL_77>",
+    "<SPECIAL_78>",
+    "<SPECIAL_79>",
+    "<SPECIAL_80>",
+    "<SPECIAL_81>",
+    "<SPECIAL_82>",
+    "<SPECIAL_83>",
+    "<SPECIAL_84>",
+    "<SPECIAL_85>",
+    "<SPECIAL_86>",
+    "<SPECIAL_87>",
+    "<SPECIAL_88>",
+    "<SPECIAL_89>",
+    "<SPECIAL_90>",
+    "<SPECIAL_91>",
+    "<SPECIAL_92>",
+    "<SPECIAL_93>",
+    "<SPECIAL_94>",
+    "<SPECIAL_95>",
+    "<SPECIAL_96>",
+    "<SPECIAL_97>",
+    "<SPECIAL_98>",
+    "<SPECIAL_99>",
+    "<SPECIAL_100>",
+    "<SPECIAL_101>",
+    "<SPECIAL_102>",
+    "<SPECIAL_103>",
+    "<SPECIAL_104>",
+    "<SPECIAL_105>",
+    "<SPECIAL_106>",
+    "<SPECIAL_107>",
+    "<SPECIAL_108>",
+    "<SPECIAL_109>",
+    "<SPECIAL_110>",
+    "<SPECIAL_111>",
+    "<SPECIAL_112>",
+    "<SPECIAL_113>",
+    "<SPECIAL_114>",
+    "<SPECIAL_115>",
+    "<SPECIAL_116>",
+    "<SPECIAL_117>",
+    "<SPECIAL_118>",
+    "<SPECIAL_119>",
+    "<SPECIAL_120>",
+    "<SPECIAL_121>",
+    "<SPECIAL_122>",
+    "<SPECIAL_123>",
+    "<SPECIAL_124>",
+    "<SPECIAL_125>",
+    "<SPECIAL_126>",
+    "<SPECIAL_127>",
+    "<SPECIAL_128>",
+    "<SPECIAL_129>",
+    "<SPECIAL_130>",
+    "<SPECIAL_131>",
+    "<SPECIAL_132>",
+    "<SPECIAL_133>",
+    "<SPECIAL_134>",
+    "<SPECIAL_135>",
+    "<SPECIAL_136>",
+    "<SPECIAL_137>",
+    "<SPECIAL_138>",
+    "<SPECIAL_139>",
+    "<SPECIAL_140>",
+    "<SPECIAL_141>",
+    "<SPECIAL_142>",
+    "<SPECIAL_143>",
+    "<SPECIAL_144>",
+    "<SPECIAL_145>",
+    "<SPECIAL_146>",
+    "<SPECIAL_147>",
+    "<SPECIAL_148>",
+    "<SPECIAL_149>",
+    "<SPECIAL_150>",
+    "<SPECIAL_151>",
+    "<SPECIAL_152>",
+    "<SPECIAL_153>",
+    "<SPECIAL_154>",
+    "<SPECIAL_155>",
+    "<SPECIAL_156>",
+    "<SPECIAL_157>",
+    "<SPECIAL_158>",
+    "<SPECIAL_159>",
+    "<SPECIAL_160>",
+    "<SPECIAL_161>",
+    "<SPECIAL_162>",
+    "<SPECIAL_163>",
+    "<SPECIAL_164>",
+    "<SPECIAL_165>",
+    "<SPECIAL_166>",
+    "<SPECIAL_167>",
+    "<SPECIAL_168>",
+    "<SPECIAL_169>",
+    "<SPECIAL_170>",
+    "<SPECIAL_171>",
+    "<SPECIAL_172>",
+    "<SPECIAL_173>",
+    "<SPECIAL_174>",
+    "<SPECIAL_175>",
+    "<SPECIAL_176>",
+    "<SPECIAL_177>",
+    "<SPECIAL_178>",
+    "<SPECIAL_179>",
+    "<SPECIAL_180>",
+    "<SPECIAL_181>",
+    "<SPECIAL_182>",
+    "<SPECIAL_183>",
+    "<SPECIAL_184>",
+    "<SPECIAL_185>",
+    "<SPECIAL_186>",
+    "<SPECIAL_187>",
+    "<SPECIAL_188>",
+    "<SPECIAL_189>",
+    "<SPECIAL_190>",
+    "<SPECIAL_191>",
+    "<SPECIAL_192>",
+    "<SPECIAL_193>",
+    "<SPECIAL_194>",
+    "<SPECIAL_195>",
+    "<SPECIAL_196>",
+    "<SPECIAL_197>",
+    "<SPECIAL_198>",
+    "<SPECIAL_199>",
+    "<SPECIAL_200>",
+    "<SPECIAL_201>",
+    "<SPECIAL_202>",
+    "<SPECIAL_203>",
+    "<SPECIAL_204>",
+    "<SPECIAL_205>",
+    "<SPECIAL_206>",
+    "<SPECIAL_207>",
+    "<SPECIAL_208>",
+    "<SPECIAL_209>",
+    "<SPECIAL_210>",
+    "<SPECIAL_211>",
+    "<SPECIAL_212>",
+    "<SPECIAL_213>",
+    "<SPECIAL_214>",
+    "<SPECIAL_215>",
+    "<SPECIAL_216>",
+    "<SPECIAL_217>",
+    "<SPECIAL_218>",
+    "<SPECIAL_219>",
+    "<SPECIAL_220>",
+    "<SPECIAL_221>",
+    "<SPECIAL_222>",
+    "<SPECIAL_223>",
+    "<SPECIAL_224>",
+    "<SPECIAL_225>",
+    "<SPECIAL_226>",
+    "<SPECIAL_227>",
+    "<SPECIAL_228>",
+    "<SPECIAL_229>",
+    "<SPECIAL_230>",
+    "<SPECIAL_231>",
+    "<SPECIAL_232>",
+    "<SPECIAL_233>",
+    "<SPECIAL_234>",
+    "<SPECIAL_235>",
+    "<SPECIAL_236>",
+    "<SPECIAL_237>",
+    "<SPECIAL_238>",
+    "<SPECIAL_239>",
+    "<SPECIAL_240>",
+    "<SPECIAL_241>",
+    "<SPECIAL_242>",
+    "<SPECIAL_243>",
+    "<SPECIAL_244>",
+    "<SPECIAL_245>",
+    "<SPECIAL_246>",
+    "<SPECIAL_247>",
+    "<SPECIAL_248>",
+    "<SPECIAL_249>",
+    "<SPECIAL_250>",
+    "<SPECIAL_251>",
+    "<SPECIAL_252>",
+    "<SPECIAL_253>",
+    "<SPECIAL_254>",
+    "<SPECIAL_255>",
+    "<SPECIAL_256>",
+    "<SPECIAL_257>",
+    "<SPECIAL_258>",
+    "<SPECIAL_259>",
+    "<SPECIAL_260>",
+    "<SPECIAL_261>",
+    "<SPECIAL_262>",
+    "<SPECIAL_263>",
+    "<SPECIAL_264>",
+    "<SPECIAL_265>",
+    "<SPECIAL_266>",
+    "<SPECIAL_267>",
+    "<SPECIAL_268>",
+    "<SPECIAL_269>",
+    "<SPECIAL_270>",
+    "<SPECIAL_271>",
+    "<SPECIAL_272>",
+    "<SPECIAL_273>",
+    "<SPECIAL_274>",
+    "<SPECIAL_275>",
+    "<SPECIAL_276>",
+    "<SPECIAL_277>",
+    "<SPECIAL_278>",
+    "<SPECIAL_279>",
+    "<SPECIAL_280>",
+    "<SPECIAL_281>",
+    "<SPECIAL_282>",
+    "<SPECIAL_283>",
+    "<SPECIAL_284>",
+    "<SPECIAL_285>",
+    "<SPECIAL_286>",
+    "<SPECIAL_287>",
+    "<SPECIAL_288>",
+    "<SPECIAL_289>",
+    "<SPECIAL_290>",
+    "<SPECIAL_291>",
+    "<SPECIAL_292>",
+    "<SPECIAL_293>",
+    "<SPECIAL_294>",
+    "<SPECIAL_295>",
+    "<SPECIAL_296>",
+    "<SPECIAL_297>",
+    "<SPECIAL_298>",
+    "<SPECIAL_299>",
+    "<SPECIAL_300>",
+    "<SPECIAL_301>",
+    "<SPECIAL_302>",
+    "<SPECIAL_303>",
+    "<SPECIAL_304>",
+    "<SPECIAL_305>",
+    "<SPECIAL_306>",
+    "<SPECIAL_307>",
+    "<SPECIAL_308>",
+    "<SPECIAL_309>",
+    "<SPECIAL_310>",
+    "<SPECIAL_311>",
+    "<SPECIAL_312>",
+    "<SPECIAL_313>",
+    "<SPECIAL_314>",
+    "<SPECIAL_315>",
+    "<SPECIAL_316>",
+    "<SPECIAL_317>",
+    "<SPECIAL_318>",
+    "<SPECIAL_319>",
+    "<SPECIAL_320>",
+    "<SPECIAL_321>",
+    "<SPECIAL_322>",
+    "<SPECIAL_323>",
+    "<SPECIAL_324>",
+    "<SPECIAL_325>",
+    "<SPECIAL_326>",
+    "<SPECIAL_327>",
+    "<SPECIAL_328>",
+    "<SPECIAL_329>",
+    "<SPECIAL_330>",
+    "<SPECIAL_331>",
+    "<SPECIAL_332>",
+    "<SPECIAL_333>",
+    "<SPECIAL_334>",
+    "<SPECIAL_335>",
+    "<SPECIAL_336>",
+    "<SPECIAL_337>",
+    "<SPECIAL_338>",
+    "<SPECIAL_339>",
+    "<SPECIAL_340>",
+    "<SPECIAL_341>",
+    "<SPECIAL_342>",
+    "<SPECIAL_343>",
+    "<SPECIAL_344>",
+    "<SPECIAL_345>",
+    "<SPECIAL_346>",
+    "<SPECIAL_347>",
+    "<SPECIAL_348>",
+    "<SPECIAL_349>",
+    "<SPECIAL_350>",
+    "<SPECIAL_351>",
+    "<SPECIAL_352>",
+    "<SPECIAL_353>",
+    "<SPECIAL_354>",
+    "<SPECIAL_355>",
+    "<SPECIAL_356>",
+    "<SPECIAL_357>",
+    "<SPECIAL_358>",
+    "<SPECIAL_359>",
+    "<SPECIAL_360>",
+    "<SPECIAL_361>",
+    "<SPECIAL_362>",
+    "<SPECIAL_363>",
+    "<SPECIAL_364>",
+    "<SPECIAL_365>",
+    "<SPECIAL_366>",
+    "<SPECIAL_367>",
+    "<SPECIAL_368>",
+    "<SPECIAL_369>",
+    "<SPECIAL_370>",
+    "<SPECIAL_371>",
+    "<SPECIAL_372>",
+    "<SPECIAL_373>",
+    "<SPECIAL_374>",
+    "<SPECIAL_375>",
+    "<SPECIAL_376>",
+    "<SPECIAL_377>",
+    "<SPECIAL_378>",
+    "<SPECIAL_379>",
+    "<SPECIAL_380>",
+    "<SPECIAL_381>",
+    "<SPECIAL_382>",
+    "<SPECIAL_383>",
+    "<SPECIAL_384>",
+    "<SPECIAL_385>",
+    "<SPECIAL_386>",
+    "<SPECIAL_387>",
+    "<SPECIAL_388>",
+    "<SPECIAL_389>",
+    "<SPECIAL_390>",
+    "<SPECIAL_391>",
+    "<SPECIAL_392>",
+    "<SPECIAL_393>",
+    "<SPECIAL_394>",
+    "<SPECIAL_395>",
+    "<SPECIAL_396>",
+    "<SPECIAL_397>",
+    "<SPECIAL_398>",
+    "<SPECIAL_399>",
+    "<SPECIAL_400>",
+    "<SPECIAL_401>",
+    "<SPECIAL_402>",
+    "<SPECIAL_403>",
+    "<SPECIAL_404>",
+    "<SPECIAL_405>",
+    "<SPECIAL_406>",
+    "<SPECIAL_407>",
+    "<SPECIAL_408>",
+    "<SPECIAL_409>",
+    "<SPECIAL_410>",
+    "<SPECIAL_411>",
+    "<SPECIAL_412>",
+    "<SPECIAL_413>",
+    "<SPECIAL_414>",
+    "<SPECIAL_415>",
+    "<SPECIAL_416>",
+    "<SPECIAL_417>",
+    "<SPECIAL_418>",
+    "<SPECIAL_419>",
+    "<SPECIAL_420>",
+    "<SPECIAL_421>",
+    "<SPECIAL_422>",
+    "<SPECIAL_423>",
+    "<SPECIAL_424>",
+    "<SPECIAL_425>",
+    "<SPECIAL_426>",
+    "<SPECIAL_427>",
+    "<SPECIAL_428>",
+    "<SPECIAL_429>",
+    "<SPECIAL_430>",
+    "<SPECIAL_431>",
+    "<SPECIAL_432>",
+    "<SPECIAL_433>",
+    "<SPECIAL_434>",
+    "<SPECIAL_435>",
+    "<SPECIAL_436>",
+    "<SPECIAL_437>",
+    "<SPECIAL_438>",
+    "<SPECIAL_439>",
+    "<SPECIAL_440>",
+    "<SPECIAL_441>",
+    "<SPECIAL_442>",
+    "<SPECIAL_443>",
+    "<SPECIAL_444>",
+    "<SPECIAL_445>",
+    "<SPECIAL_446>",
+    "<SPECIAL_447>",
+    "<SPECIAL_448>",
+    "<SPECIAL_449>",
+    "<SPECIAL_450>",
+    "<SPECIAL_451>",
+    "<SPECIAL_452>",
+    "<SPECIAL_453>",
+    "<SPECIAL_454>",
+    "<SPECIAL_455>",
+    "<SPECIAL_456>",
+    "<SPECIAL_457>",
+    "<SPECIAL_458>",
+    "<SPECIAL_459>",
+    "<SPECIAL_460>",
+    "<SPECIAL_461>",
+    "<SPECIAL_462>",
+    "<SPECIAL_463>",
+    "<SPECIAL_464>",
+    "<SPECIAL_465>",
+    "<SPECIAL_466>",
+    "<SPECIAL_467>",
+    "<SPECIAL_468>",
+    "<SPECIAL_469>",
+    "<SPECIAL_470>",
+    "<SPECIAL_471>",
+    "<SPECIAL_472>",
+    "<SPECIAL_473>",
+    "<SPECIAL_474>",
+    "<SPECIAL_475>",
+    "<SPECIAL_476>",
+    "<SPECIAL_477>",
+    "<SPECIAL_478>",
+    "<SPECIAL_479>",
+    "<SPECIAL_480>",
+    "<SPECIAL_481>",
+    "<SPECIAL_482>",
+    "<SPECIAL_483>",
+    "<SPECIAL_484>",
+    "<SPECIAL_485>",
+    "<SPECIAL_486>",
+    "<SPECIAL_487>",
+    "<SPECIAL_488>",
+    "<SPECIAL_489>",
+    "<SPECIAL_490>",
+    "<SPECIAL_491>",
+    "<SPECIAL_492>",
+    "<SPECIAL_493>",
+    "<SPECIAL_494>",
+    "<SPECIAL_495>",
+    "<SPECIAL_496>",
+    "<SPECIAL_497>",
+    "<SPECIAL_498>",
+    "<SPECIAL_499>",
+    "<SPECIAL_500>",
+    "<SPECIAL_501>",
+    "<SPECIAL_502>",
+    "<SPECIAL_503>",
+    "<SPECIAL_504>",
+    "<SPECIAL_505>",
+    "<SPECIAL_506>",
+    "<SPECIAL_507>",
+    "<SPECIAL_508>",
+    "<SPECIAL_509>",
+    "<SPECIAL_510>",
+    "<SPECIAL_511>",
+    "<SPECIAL_512>",
+    "<SPECIAL_513>",
+    "<SPECIAL_514>",
+    "<SPECIAL_515>",
+    "<SPECIAL_516>",
+    "<SPECIAL_517>",
+    "<SPECIAL_518>",
+    "<SPECIAL_519>",
+    "<SPECIAL_520>",
+    "<SPECIAL_521>",
+    "<SPECIAL_522>",
+    "<SPECIAL_523>",
+    "<SPECIAL_524>",
+    "<SPECIAL_525>",
+    "<SPECIAL_526>",
+    "<SPECIAL_527>",
+    "<SPECIAL_528>",
+    "<SPECIAL_529>",
+    "<SPECIAL_530>",
+    "<SPECIAL_531>",
+    "<SPECIAL_532>",
+    "<SPECIAL_533>",
+    "<SPECIAL_534>",
+    "<SPECIAL_535>",
+    "<SPECIAL_536>",
+    "<SPECIAL_537>",
+    "<SPECIAL_538>",
+    "<SPECIAL_539>",
+    "<SPECIAL_540>",
+    "<SPECIAL_541>",
+    "<SPECIAL_542>",
+    "<SPECIAL_543>",
+    "<SPECIAL_544>",
+    "<SPECIAL_545>",
+    "<SPECIAL_546>",
+    "<SPECIAL_547>",
+    "<SPECIAL_548>",
+    "<SPECIAL_549>",
+    "<SPECIAL_550>",
+    "<SPECIAL_551>",
+    "<SPECIAL_552>",
+    "<SPECIAL_553>",
+    "<SPECIAL_554>",
+    "<SPECIAL_555>",
+    "<SPECIAL_556>",
+    "<SPECIAL_557>",
+    "<SPECIAL_558>",
+    "<SPECIAL_559>",
+    "<SPECIAL_560>",
+    "<SPECIAL_561>",
+    "<SPECIAL_562>",
+    "<SPECIAL_563>",
+    "<SPECIAL_564>",
+    "<SPECIAL_565>",
+    "<SPECIAL_566>",
+    "<SPECIAL_567>",
+    "<SPECIAL_568>",
+    "<SPECIAL_569>",
+    "<SPECIAL_570>",
+    "<SPECIAL_571>",
+    "<SPECIAL_572>",
+    "<SPECIAL_573>",
+    "<SPECIAL_574>",
+    "<SPECIAL_575>",
+    "<SPECIAL_576>",
+    "<SPECIAL_577>",
+    "<SPECIAL_578>",
+    "<SPECIAL_579>",
+    "<SPECIAL_580>",
+    "<SPECIAL_581>",
+    "<SPECIAL_582>",
+    "<SPECIAL_583>",
+    "<SPECIAL_584>",
+    "<SPECIAL_585>",
+    "<SPECIAL_586>",
+    "<SPECIAL_587>",
+    "<SPECIAL_588>",
+    "<SPECIAL_589>",
+    "<SPECIAL_590>",
+    "<SPECIAL_591>",
+    "<SPECIAL_592>",
+    "<SPECIAL_593>",
+    "<SPECIAL_594>",
+    "<SPECIAL_595>",
+    "<SPECIAL_596>",
+    "<SPECIAL_597>",
+    "<SPECIAL_598>",
+    "<SPECIAL_599>",
+    "<SPECIAL_600>",
+    "<SPECIAL_601>",
+    "<SPECIAL_602>",
+    "<SPECIAL_603>",
+    "<SPECIAL_604>",
+    "<SPECIAL_605>",
+    "<SPECIAL_606>",
+    "<SPECIAL_607>",
+    "<SPECIAL_608>",
+    "<SPECIAL_609>",
+    "<SPECIAL_610>",
+    "<SPECIAL_611>",
+    "<SPECIAL_612>",
+    "<SPECIAL_613>",
+    "<SPECIAL_614>",
+    "<SPECIAL_615>",
+    "<SPECIAL_616>",
+    "<SPECIAL_617>",
+    "<SPECIAL_618>",
+    "<SPECIAL_619>",
+    "<SPECIAL_620>",
+    "<SPECIAL_621>",
+    "<SPECIAL_622>",
+    "<SPECIAL_623>",
+    "<SPECIAL_624>",
+    "<SPECIAL_625>",
+    "<SPECIAL_626>",
+    "<SPECIAL_627>",
+    "<SPECIAL_628>",
+    "<SPECIAL_629>",
+    "<SPECIAL_630>",
+    "<SPECIAL_631>",
+    "<SPECIAL_632>",
+    "<SPECIAL_633>",
+    "<SPECIAL_634>",
+    "<SPECIAL_635>",
+    "<SPECIAL_636>",
+    "<SPECIAL_637>",
+    "<SPECIAL_638>",
+    "<SPECIAL_639>",
+    "<SPECIAL_640>",
+    "<SPECIAL_641>",
+    "<SPECIAL_642>",
+    "<SPECIAL_643>",
+    "<SPECIAL_644>",
+    "<SPECIAL_645>",
+    "<SPECIAL_646>",
+    "<SPECIAL_647>",
+    "<SPECIAL_648>",
+    "<SPECIAL_649>",
+    "<SPECIAL_650>",
+    "<SPECIAL_651>",
+    "<SPECIAL_652>",
+    "<SPECIAL_653>",
+    "<SPECIAL_654>",
+    "<SPECIAL_655>",
+    "<SPECIAL_656>",
+    "<SPECIAL_657>",
+    "<SPECIAL_658>",
+    "<SPECIAL_659>",
+    "<SPECIAL_660>",
+    "<SPECIAL_661>",
+    "<SPECIAL_662>",
+    "<SPECIAL_663>",
+    "<SPECIAL_664>",
+    "<SPECIAL_665>",
+    "<SPECIAL_666>",
+    "<SPECIAL_667>",
+    "<SPECIAL_668>",
+    "<SPECIAL_669>",
+    "<SPECIAL_670>",
+    "<SPECIAL_671>",
+    "<SPECIAL_672>",
+    "<SPECIAL_673>",
+    "<SPECIAL_674>",
+    "<SPECIAL_675>",
+    "<SPECIAL_676>",
+    "<SPECIAL_677>",
+    "<SPECIAL_678>",
+    "<SPECIAL_679>",
+    "<SPECIAL_680>",
+    "<SPECIAL_681>",
+    "<SPECIAL_682>",
+    "<SPECIAL_683>",
+    "<SPECIAL_684>",
+    "<SPECIAL_685>",
+    "<SPECIAL_686>",
+    "<SPECIAL_687>",
+    "<SPECIAL_688>",
+    "<SPECIAL_689>",
+    "<SPECIAL_690>",
+    "<SPECIAL_691>",
+    "<SPECIAL_692>",
+    "<SPECIAL_693>",
+    "<SPECIAL_694>",
+    "<SPECIAL_695>",
+    "<SPECIAL_696>",
+    "<SPECIAL_697>",
+    "<SPECIAL_698>",
+    "<SPECIAL_699>",
+    "<SPECIAL_700>",
+    "<SPECIAL_701>",
+    "<SPECIAL_702>",
+    "<SPECIAL_703>",
+    "<SPECIAL_704>",
+    "<SPECIAL_705>",
+    "<SPECIAL_706>",
+    "<SPECIAL_707>",
+    "<SPECIAL_708>",
+    "<SPECIAL_709>",
+    "<SPECIAL_710>",
+    "<SPECIAL_711>",
+    "<SPECIAL_712>",
+    "<SPECIAL_713>",
+    "<SPECIAL_714>",
+    "<SPECIAL_715>",
+    "<SPECIAL_716>",
+    "<SPECIAL_717>",
+    "<SPECIAL_718>",
+    "<SPECIAL_719>",
+    "<SPECIAL_720>",
+    "<SPECIAL_721>",
+    "<SPECIAL_722>",
+    "<SPECIAL_723>",
+    "<SPECIAL_724>",
+    "<SPECIAL_725>",
+    "<SPECIAL_726>",
+    "<SPECIAL_727>",
+    "<SPECIAL_728>",
+    "<SPECIAL_729>",
+    "<SPECIAL_730>",
+    "<SPECIAL_731>",
+    "<SPECIAL_732>",
+    "<SPECIAL_733>",
+    "<SPECIAL_734>",
+    "<SPECIAL_735>",
+    "<SPECIAL_736>",
+    "<SPECIAL_737>",
+    "<SPECIAL_738>",
+    "<SPECIAL_739>",
+    "<SPECIAL_740>",
+    "<SPECIAL_741>",
+    "<SPECIAL_742>",
+    "<SPECIAL_743>",
+    "<SPECIAL_744>",
+    "<SPECIAL_745>",
+    "<SPECIAL_746>",
+    "<SPECIAL_747>",
+    "<SPECIAL_748>",
+    "<SPECIAL_749>",
+    "<SPECIAL_750>",
+    "<SPECIAL_751>",
+    "<SPECIAL_752>",
+    "<SPECIAL_753>",
+    "<SPECIAL_754>",
+    "<SPECIAL_755>",
+    "<SPECIAL_756>",
+    "<SPECIAL_757>",
+    "<SPECIAL_758>",
+    "<SPECIAL_759>",
+    "<SPECIAL_760>",
+    "<SPECIAL_761>",
+    "<SPECIAL_762>",
+    "<SPECIAL_763>",
+    "<SPECIAL_764>",
+    "<SPECIAL_765>",
+    "<SPECIAL_766>",
+    "<SPECIAL_767>",
+    "<SPECIAL_768>",
+    "<SPECIAL_769>",
+    "<SPECIAL_770>",
+    "<SPECIAL_771>",
+    "<SPECIAL_772>",
+    "<SPECIAL_773>",
+    "<SPECIAL_774>",
+    "<SPECIAL_775>",
+    "<SPECIAL_776>",
+    "<SPECIAL_777>",
+    "<SPECIAL_778>",
+    "<SPECIAL_779>",
+    "<SPECIAL_780>",
+    "<SPECIAL_781>",
+    "<SPECIAL_782>",
+    "<SPECIAL_783>",
+    "<SPECIAL_784>",
+    "<SPECIAL_785>",
+    "<SPECIAL_786>",
+    "<SPECIAL_787>",
+    "<SPECIAL_788>",
+    "<SPECIAL_789>",
+    "<SPECIAL_790>",
+    "<SPECIAL_791>",
+    "<SPECIAL_792>",
+    "<SPECIAL_793>",
+    "<SPECIAL_794>",
+    "<SPECIAL_795>",
+    "<SPECIAL_796>",
+    "<SPECIAL_797>",
+    "<SPECIAL_798>",
+    "<SPECIAL_799>",
+    "<SPECIAL_800>",
+    "<SPECIAL_801>",
+    "<SPECIAL_802>",
+    "<SPECIAL_803>",
+    "<SPECIAL_804>",
+    "<SPECIAL_805>",
+    "<SPECIAL_806>",
+    "<SPECIAL_807>",
+    "<SPECIAL_808>",
+    "<SPECIAL_809>",
+    "<SPECIAL_810>",
+    "<SPECIAL_811>",
+    "<SPECIAL_812>",
+    "<SPECIAL_813>",
+    "<SPECIAL_814>",
+    "<SPECIAL_815>",
+    "<SPECIAL_816>",
+    "<SPECIAL_817>",
+    "<SPECIAL_818>",
+    "<SPECIAL_819>",
+    "<SPECIAL_820>",
+    "<SPECIAL_821>",
+    "<SPECIAL_822>",
+    "<SPECIAL_823>",
+    "<SPECIAL_824>",
+    "<SPECIAL_825>",
+    "<SPECIAL_826>",
+    "<SPECIAL_827>",
+    "<SPECIAL_828>",
+    "<SPECIAL_829>",
+    "<SPECIAL_830>",
+    "<SPECIAL_831>",
+    "<SPECIAL_832>",
+    "<SPECIAL_833>",
+    "<SPECIAL_834>",
+    "<SPECIAL_835>",
+    "<SPECIAL_836>",
+    "<SPECIAL_837>",
+    "<SPECIAL_838>",
+    "<SPECIAL_839>",
+    "<SPECIAL_840>",
+    "<SPECIAL_841>",
+    "<SPECIAL_842>",
+    "<SPECIAL_843>",
+    "<SPECIAL_844>",
+    "<SPECIAL_845>",
+    "<SPECIAL_846>",
+    "<SPECIAL_847>",
+    "<SPECIAL_848>",
+    "<SPECIAL_849>",
+    "<SPECIAL_850>",
+    "<SPECIAL_851>",
+    "<SPECIAL_852>",
+    "<SPECIAL_853>",
+    "<SPECIAL_854>",
+    "<SPECIAL_855>",
+    "<SPECIAL_856>",
+    "<SPECIAL_857>",
+    "<SPECIAL_858>",
+    "<SPECIAL_859>",
+    "<SPECIAL_860>",
+    "<SPECIAL_861>",
+    "<SPECIAL_862>",
+    "<SPECIAL_863>",
+    "<SPECIAL_864>",
+    "<SPECIAL_865>",
+    "<SPECIAL_866>",
+    "<SPECIAL_867>",
+    "<SPECIAL_868>",
+    "<SPECIAL_869>",
+    "<SPECIAL_870>",
+    "<SPECIAL_871>",
+    "<SPECIAL_872>",
+    "<SPECIAL_873>",
+    "<SPECIAL_874>",
+    "<SPECIAL_875>",
+    "<SPECIAL_876>",
+    "<SPECIAL_877>",
+    "<SPECIAL_878>",
+    "<SPECIAL_879>",
+    "<SPECIAL_880>",
+    "<SPECIAL_881>",
+    "<SPECIAL_882>",
+    "<SPECIAL_883>",
+    "<SPECIAL_884>",
+    "<SPECIAL_885>",
+    "<SPECIAL_886>",
+    "<SPECIAL_887>",
+    "<SPECIAL_888>",
+    "<SPECIAL_889>",
+    "<SPECIAL_890>",
+    "<SPECIAL_891>",
+    "<SPECIAL_892>",
+    "<SPECIAL_893>",
+    "<SPECIAL_894>",
+    "<SPECIAL_895>",
+    "<SPECIAL_896>",
+    "<SPECIAL_897>",
+    "<SPECIAL_898>",
+    "<SPECIAL_899>",
+    "<SPECIAL_900>",
+    "<SPECIAL_901>",
+    "<SPECIAL_902>",
+    "<SPECIAL_903>",
+    "<SPECIAL_904>",
+    "<SPECIAL_905>",
+    "<SPECIAL_906>",
+    "<SPECIAL_907>",
+    "<SPECIAL_908>",
+    "<SPECIAL_909>",
+    "<SPECIAL_910>",
+    "<SPECIAL_911>",
+    "<SPECIAL_912>",
+    "<SPECIAL_913>",
+    "<SPECIAL_914>",
+    "<SPECIAL_915>",
+    "<SPECIAL_916>",
+    "<SPECIAL_917>",
+    "<SPECIAL_918>",
+    "<SPECIAL_919>",
+    "<SPECIAL_920>",
+    "<SPECIAL_921>",
+    "<SPECIAL_922>",
+    "<SPECIAL_923>",
+    "<SPECIAL_924>",
+    "<SPECIAL_925>",
+    "<SPECIAL_926>",
+    "<SPECIAL_927>",
+    "<SPECIAL_928>",
+    "<SPECIAL_929>",
+    "<SPECIAL_930>",
+    "<SPECIAL_931>",
+    "<SPECIAL_932>",
+    "<SPECIAL_933>",
+    "<SPECIAL_934>",
+    "<SPECIAL_935>",
+    "<SPECIAL_936>",
+    "<SPECIAL_937>",
+    "<SPECIAL_938>",
+    "<SPECIAL_939>",
+    "<SPECIAL_940>",
+    "<SPECIAL_941>",
+    "<SPECIAL_942>",
+    "<SPECIAL_943>",
+    "<SPECIAL_944>",
+    "<SPECIAL_945>",
+    "<SPECIAL_946>",
+    "<SPECIAL_947>",
+    "<SPECIAL_948>",
+    "<SPECIAL_949>",
+    "<SPECIAL_950>",
+    "<SPECIAL_951>",
+    "<SPECIAL_952>",
+    "<SPECIAL_953>",
+    "<SPECIAL_954>",
+    "<SPECIAL_955>",
+    "<SPECIAL_956>",
+    "<SPECIAL_957>",
+    "<SPECIAL_958>",
+    "<SPECIAL_959>",
+    "<SPECIAL_960>",
+    "<SPECIAL_961>",
+    "<SPECIAL_962>",
+    "<SPECIAL_963>",
+    "<SPECIAL_964>",
+    "<SPECIAL_965>",
+    "<SPECIAL_966>",
+    "<SPECIAL_967>",
+    "<SPECIAL_968>",
+    "<SPECIAL_969>",
+    "<SPECIAL_970>",
+    "<SPECIAL_971>",
+    "<SPECIAL_972>",
+    "<SPECIAL_973>",
+    "<SPECIAL_974>",
+    "<SPECIAL_975>",
+    "<SPECIAL_976>",
+    "<SPECIAL_977>",
+    "<SPECIAL_978>",
+    "<SPECIAL_979>",
+    "<SPECIAL_980>",
+    "<SPECIAL_981>",
+    "<SPECIAL_982>",
+    "<SPECIAL_983>",
+    "<SPECIAL_984>",
+    "<SPECIAL_985>",
+    "<SPECIAL_986>",
+    "<SPECIAL_987>",
+    "<SPECIAL_988>",
+    "<SPECIAL_989>",
+    "<SPECIAL_990>",
+    "<SPECIAL_991>",
+    "<SPECIAL_992>",
+    "<SPECIAL_993>",
+    "<SPECIAL_994>",
+    "<SPECIAL_995>",
+    "<SPECIAL_996>",
+    "<SPECIAL_997>",
+    "<SPECIAL_998>",
+    "<SPECIAL_999>"
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b76085f9923309d873994d444989f7eb6ec074b06f25b58f1e8d7b7741070949
+size 17078037

transformer/config.json

@@ -0,0 +1,22 @@
+{
+  "_class_name": "Flux2Transformer2DModel",
+  "_diffusers_version": "0.36.0.dev0",
+  "attention_head_dim": 128,
+  "axes_dims_rope": [
+    32,
+    32,
+    32,
+    32
+  ],
+  "eps": 1e-06,
+  "in_channels": 128,
+  "joint_attention_dim": 15360,
+  "mlp_ratio": 3.0,
+  "num_attention_heads": 48,
+  "num_layers": 8,
+  "num_single_layers": 48,
+  "out_channels": null,
+  "patch_size": 1,
+  "rope_theta": 2000,
+  "timestep_guidance_channels": 256
+}

transformer/diffusion_pytorch_model-00001-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d9b85f75f72fb17c7d29dacf7c430e924da93122d578a559a36a7635e153714
+size 9935797200

transformer/diffusion_pytorch_model-00002-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86adf6f41474b00bd57afbb29a09f008be7d6af8ae914956585ba5bc6bf97c28
+size 9890181048

transformer/diffusion_pytorch_model-00003-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a14e26e8f305dd26d7881f333e6e6ce5b562cbb55282538f46d38e1ff2715179
+size 9814681480

transformer/diffusion_pytorch_model-00004-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c4f38976fd8d7e5fb2d4cd20562d74eebba3264566987e3ef938d807c75be90
+size 9814681536

transformer/diffusion_pytorch_model-00005-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d7a74d916fc22117cde8bad76aa4b561e6dc92368cddc23bdae06dbc586ad95
+size 9814681536

transformer/diffusion_pytorch_model-00006-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08f3ad03610651f9d630177ac3a4770d532fa72d788d3b36c39a0301b1595447
+size 9814681536

transformer/diffusion_pytorch_model-00007-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:789b9bacb607e9b97597f77c86056fa6cbb747c2a6016588e6e196814b5f9733
+size 5361898792

transformer/diffusion_pytorch_model.safetensors.index.json

@@ -0,0 +1,338 @@
+{
+  "metadata": {
+    "total_size": 64446562304
+  },
+  "weight_map": {
+    "context_embedder.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "double_stream_modulation_img.linear.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "double_stream_modulation_txt.linear.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "norm_out.linear.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "proj_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_stream_modulation.linear.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "single_transformer_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.0.attn.to_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.0.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.1.attn.to_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.1.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.10.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.10.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.10.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.10.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.11.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.11.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.11.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.11.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.12.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.12.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.12.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.12.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.13.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.13.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.13.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.13.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.14.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.14.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.14.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.14.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.15.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.15.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.15.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.15.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.16.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.16.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.16.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.16.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.17.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.17.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.17.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.17.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.18.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.18.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.18.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.18.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.19.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.19.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.19.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.19.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.2.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.2.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.2.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.2.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "single_transformer_blocks.20.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.20.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.20.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.20.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.21.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.21.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.21.attn.to_out.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.21.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.22.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.22.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.22.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.22.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00004-of-00007.safetensors",
+    "single_transformer_blocks.23.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.23.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.23.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.23.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.24.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.24.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.24.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.24.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.25.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.25.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.25.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.25.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.26.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.26.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.26.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.26.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.27.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.27.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.27.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.27.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.28.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.28.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.28.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.28.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.29.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.29.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.29.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.29.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.3.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.3.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.3.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.3.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.30.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.30.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.30.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.30.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.31.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.31.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.31.attn.to_out.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.31.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.32.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.32.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.32.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.32.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00005-of-00007.safetensors",
+    "single_transformer_blocks.33.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.33.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.33.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.33.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.34.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.34.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.34.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.34.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.35.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.35.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.35.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.35.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.36.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.36.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.36.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.36.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.37.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.37.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.37.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.37.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.38.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.38.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.38.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.38.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.39.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.39.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.39.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.39.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.4.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.4.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.4.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.4.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.40.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.40.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.40.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.40.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.41.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.41.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.41.attn.to_out.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.41.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.42.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.42.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.42.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.42.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00006-of-00007.safetensors",
+    "single_transformer_blocks.43.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.43.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.43.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.43.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.44.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.44.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.44.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.44.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.45.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.45.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.45.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.45.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.46.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.46.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.46.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.46.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.47.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.47.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.47.attn.to_out.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.47.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00007-of-00007.safetensors",
+    "single_transformer_blocks.5.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.5.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.5.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.5.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.6.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.6.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.6.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.6.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.7.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.7.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.7.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.7.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.8.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.8.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.8.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.8.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.9.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.9.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.9.attn.to_out.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "single_transformer_blocks.9.attn.to_qkv_mlp_proj.weight": "diffusion_pytorch_model-00003-of-00007.safetensors",
+    "time_guidance_embed.guidance_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "time_guidance_embed.guidance_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "time_guidance_embed.timestep_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "time_guidance_embed.timestep_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.ff.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.ff.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.ff_context.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.0.ff_context.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.ff.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.ff.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.ff_context.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.1.ff_context.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.ff.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.ff.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.ff_context.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.2.ff_context.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.ff.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.ff.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.ff_context.linear_in.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.3.ff_context.linear_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00007.safetensors",
+    "transformer_blocks.4.ff.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.4.ff.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.4.ff_context.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.4.ff_context.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.ff.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.ff.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.ff_context.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.5.ff_context.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.ff.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.ff.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.ff_context.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.6.ff_context.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.ff.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.ff.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.ff_context.linear_in.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "transformer_blocks.7.ff_context.linear_out.weight": "diffusion_pytorch_model-00002-of-00007.safetensors",
+    "x_embedder.weight": "diffusion_pytorch_model-00001-of-00007.safetensors"
+  }
+}

vae/config.json

@@ -0,0 +1,39 @@
+{
+  "_class_name": "AutoencoderKLFlux2",
+  "_diffusers_version": "0.36.0.dev0",
+  "act_fn": "silu",
+  "batch_norm_eps": 0.0001,
+  "batch_norm_momentum": 0.1,
+  "block_out_channels": [
+    128,
+    256,
+    512,
+    512
+  ],
+  "down_block_types": [
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D"
+  ],
+  "force_upcast": true,
+  "in_channels": 3,
+  "latent_channels": 32,
+  "layers_per_block": 2,
+  "mid_block_add_attention": true,
+  "norm_num_groups": 32,
+  "out_channels": 3,
+  "patch_size": [
+    2,
+    2
+  ],
+  "sample_size": 1024,
+  "up_block_types": [
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D"
+  ],
+  "use_post_quant_conv": true,
+  "use_quant_conv": true
+}

vae/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d64f3a68e1cc4f9f4e29b6e0da38a0204fe9a49f2d4053f0ec1fa1ca02f9c4b5
+size 336213556