|
--- |
|
title: README |
|
emoji: 🏢 |
|
colorFrom: blue |
|
colorTo: green |
|
sdk: static |
|
pinned: true |
|
tags: |
|
- fine-tuning |
|
- inference |
|
- function calling |
|
- quantization |
|
--- |
|
*last updated Dec 6th 2024* |
|
## About |
|
[Trelis Research](https://Trelis.com) provides: |
|
- Advanced LLM fine-tuning scripts. |
|
- Advanced LLM inference guides. |
|
- Advanced vision fine-tuning scripts. |
|
- Advanced voice/transcription fine-tuning scripts. |
|
- One click LLM API templates |
|
- Function-calling models. |
|
|
|
## ADVANCED Fine-tuning Scripts |
|
|
|
[Get access here](https://trelis.com/advanced-fine-tuning-scripts/) |
|
|
|
- retrieval (bm25, similarity, re-rankers) |
|
- wikipedia fine-tuning and dataset creation |
|
- ReFT fine-tuning |
|
- multi-gpu fine-tuning |
|
- orpo fine-tuning |
|
- memorization fine-tuning |
|
- mamba-fine-tune |
|
- DPO fine-tuning |
|
- chat-fine-tuning |
|
- function-calling fine-tuning |
|
- long-context fine-tuning |
|
- quantization |
|
- supervised-fine-tuning |
|
- unsupervised-fine-tuning |
|
|
|
## ADVANCED Inference |
|
|
|
[Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/) |
|
|
|
- Server setup, API setup and inference guide for open source models |
|
- Inference for function calling |
|
- Monte Carlo Inference Methods |
|
- Private Data Redaction |
|
- Structured Data Extraction with LLMs |
|
- Verified RAG citations |
|
|
|
## ADVANCED Vision Fine-tuning |
|
|
|
[Get access here](https://trelis.com/advanced-vision/) |
|
|
|
- Dataset Preparation |
|
- Fine-tuning Llava, IDEFICS2 |
|
|
|
## ADVANCED Transcription and Voice Cloning |
|
|
|
[Get access here](https://trelis.com/advanced-transcription/) |
|
|
|
- Dataset Generation |
|
- Fine-tuning Whisper speech-to-text on custom datasets |
|
- Voice Cloning Fine-tuning / Text-to-Speech |
|
|
|
## One-click LLM API/Server Templates |
|
- Check out the full list [here](https://github.com/TrelisResearch/one-click-llms) |
|
|
|
## Function-calling Models and Datasets |
|
|
|
[Get access here](https://trelis.com/function-calling/) |
|
|
|
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915) |
|
- Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3) |
|
- Scripts to fine-tune models for function calling and structured responses. |
