Configuration Parsing Warning:In config.json: "quantization_config.modules_to_not_convert" must be an array
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
SpydazWebAI_VisionEncoderDecoderModel_Mini548m - AWQ
- Model creator: https://huggingface.co/LeroyDyer/
- Original model: https://huggingface.co/LeroyDyer/SpydazWebAI_VisionEncoderDecoderModel_Mini548m/
Original model description:
license: mit language: - en library_name: transformers tags: - vision - VISION-ENCODER-DECODER-MODEL pipeline_tag: image-to-text
ADD HEAD
Mistral
VISION-ENCODER-DECODER-MODEL
print('Add Vision...')
# ADD HEAD
# Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model
Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(
"google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"
)
_Encoder_ImageProcessor = Vmodel.encoder
_Decoder_ImageTokenizer = Vmodel.decoder
_VisionEncoderDecoderModel = Vmodel
# Add Pad tokems
LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel
# Add Sub Components
LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor
LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer
LM_MODEL
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support