Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/models-cards#model-card-metadata)


Inference Notebook:

Русская версия CLIP prefix caption, обученная на ruGPTSMALL + CLIP(OPENAI), можно использовать для VQA, image captioning и прочее. Модель работает <1c + ее можно эффективно квантануть/перенести в ONNX. Обучалось в течении 3х дней на 2*1080ti

Trained and validated on ruCOCO BLEU: 37.3

chrF: 32.4

ROUGE-1-F: 33.0

ROUGE-2-F: 14.1

ROUGE-L-F: 30.3

THIS WORK IS BASED ON https://github.com/rmokady/CLIP_prefix_caption (english version)

  title={ClipCap: CLIP Prefix for Image Captioning},
  author={Mokady, Ron and Hertz, Amir and Bermano, Amit H},
  journal={arXiv preprint arXiv:2111.09734},
  title={ruImage captioning},
  author={Aleksandr Nikolic, Asta gpu server },


This repository is heavily based on CLIP and Hugging-faces repositories. For training we used the data of COCO dataset and Conceptual Captions translated by ALEX WORTEGA ruCOCO

Downloads last month
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .