Hugging Face's logo

HyperGAI
/
HPT1_5-Air-Llama-3-8B-Instruct-multimodal

Text Generation
Transformers
Safetensors
English
llama
multimodal
vision-language
text-generation-inference
Inference Endpoints
Model card Files Community
HPT1_5-Air-Llama-3-8B-Instruct-multimodal
File size: 2,264 Bytes 
3807d2c
 
 
 
 
 
 
 
 
 
 
 
 
 
a9fca8f
3807d2c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
 
---
library_name: transformers
tags:
- multimodal
- vision-language
license: apache-2.0
language:
- en
---

# Model Card for HPT

Hyper-Pretrained Transformers (HPT) is a novel multimodal LLM framework from [HyperGAI](https://hypergai.com/), and has been trained for vision-language models that are capable of multimodal understanding for both textual and visual inputs. Here we release our best open-sourced 8B Multimodal LLM HPT 1.5 Air. Built with Meta Llama 3, our hyper capable HPT 1.5 Air packs a punch on real world understanding and complex reasoning. This repository contains the open-source weight to reproduce the evaluation results of HPT 1.5 Air on different benchmarks. 

For full details of this model please read our [technical blog post](https://hypergai.com/blog/hpt-1-5-air-best-open-sourced-8b-multimodal-llm-with-llama-3)

## Run the model

Please use the scripts available in our [gitHub repository](https://github.com/HyperGAI/HPT) to utilize the model.

## Troubleshooting

Please report the issue at our [github repo](https://github.com/HyperGAI/HPT)

## Pretrained models used

- Pretrained LLM: [Llama3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)

- Pretrained Visual Encoder: [siglip-so400m-patch14-384](https://huggingface.co/google/siglip-so400m-patch14-384)

## Disclaimer and Responsible Use

Note that the HPT Air is a quick open release of our models to facilitate the open, responsible AI research and community development. It does not have any moderation mechanism and provides no guarantees on their results. We hope to engage with the community to make the model finely respect guardrails to allow adoptions in practical applications requiring moderated outputs.

## Contact Us

- Contact: hpt@hypergai.com 
- Follow us on [Twitter](https://twitter.com/hypergai).
- Follow us on [Linkedin](https://www.linkedin.com/company/hypergai/).
- Visit our [website](https://www.hypergai.com) to learn more about us.


## License

This project is released under the [Apache 2.0 license](LICENSE). 
Parts of this project contain code and models from other sources, which are subject to their respective licenses and you need to apply their respective license if you may want to use for commercial purposes.