Edit model card

Oryx-7B-Image

Model Summary

The Oryx-Image models are 7/34B parameter models trained on Oryx-Image-Data, based on Qwen2 language model with a context window of 32K tokens.

Oryx offers an on-demand solution to seamlessly and efficiently process visual inputs with arbitrary spatial sizes and temporal lengths.

Model Architecture

  • Architecture: Pre-trained Oryx-ViT + Qwen2-7B
  • Data: a mixture of 4M image data
  • Precision: BFloat16

Hardware & Software

  • Hardware: 64 * NVIDIA Tesla A100
  • Orchestration: HuggingFace Trainer
  • Code: Pytorch

Citation

Downloads last month
28
Safetensors
Model size
8.06B params
Tensor type
BF16
·
Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for THUdyh/Oryx-7B-Image

Base model

Qwen/Qwen2-7B
Finetuned
(53)
this model

Collection including THUdyh/Oryx-7B-Image