File size: 2,262 Bytes
dd252de
 
 
a15fc34
dd252de
 
a15fc34
 
933db07
39dcea0
8c953f6
 
dd252de
0b3c906
94e24ec
0b3c906
945859a
 
 
933db07
39dcea0
933db07
46e1228
1abef1a
2f7d5c3
39dcea0
2f7d5c3
933db07
 
 
 
 
 
 
 
 
 
 
 
 
 
1ff0453
4d7dc11
2141791
39dcea0
795fb59
933db07
 
 
 
 
 
46e1228
933db07
945859a
 
 
 
933db07
945859a
933db07
945859a
 
 
 
933db07
 
945859a
39dcea0
 
933db07
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
---
title: README
emoji: 🏢
colorFrom: blue
colorTo: green
sdk: static
pinned: true
tags:
- fine-tuning
- inference
- function calling
- quantization
---
*last updated Dec 6th 2024*
## About
[Trelis Research](https://Trelis.com) provides:
- Advanced LLM fine-tuning scripts.
- Advanced LLM inference guides.
- Advanced vision fine-tuning scripts.
- Advanced voice/transcription fine-tuning scripts.
- One click LLM API templates
- Function-calling models.

## ADVANCED Fine-tuning Scripts

[Get access here](https://trelis.com/advanced-fine-tuning-scripts/)

- retrieval (bm25, similarity, re-rankers)
- wikipedia fine-tuning and dataset creation
- ReFT fine-tuning
- multi-gpu fine-tuning
- orpo fine-tuning
- memorization fine-tuning
- mamba-fine-tune
- DPO fine-tuning
- chat-fine-tuning
- function-calling fine-tuning
- long-context fine-tuning
- quantization
- supervised-fine-tuning
- unsupervised-fine-tuning

## ADVANCED Inference

[Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)

- Server setup, API setup and inference guide for open source models
- Inference for function calling
- Monte Carlo Inference Methods
- Private Data Redaction
- Structured Data Extraction with LLMs
- Verified RAG citations

## ADVANCED Vision Fine-tuning

[Get access here](https://trelis.com/advanced-vision/)

- Dataset Preparation
- Fine-tuning Llava, IDEFICS2

## ADVANCED Transcription and Voice Cloning

[Get access here](https://trelis.com/advanced-transcription/)

- Dataset Generation
- Fine-tuning Whisper speech-to-text on custom datasets
- Voice Cloning Fine-tuning / Text-to-Speech

## One-click LLM API/Server Templates
- Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)

## Function-calling Models and Datasets

[Get access here](https://trelis.com/function-calling/)

- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
- Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
- Scripts to fine-tune models for function calling and structured responses.