RonanMcGovern commited on
Commit
933db07
·
verified ·
1 Parent(s): 945859a

update readme aug 2024

Browse files
Files changed (1) hide show
  1. README.md +37 -33
README.md CHANGED
@@ -6,69 +6,73 @@ colorTo: green
6
  sdk: static
7
  pinned: true
8
  tags:
 
9
  - inference
10
  - function calling
11
- - long context
12
- - mistral
13
- - deepseek
14
- - yi
15
- - code-llama
16
  - quantization
17
- - SFT
18
- - fine-tuning
19
  ---
20
- *last updated Feb 16th 2024*
21
  ## About
22
  Trelis Research provides:
23
- - Function-calling models.
24
  - Advanced LLM fine-tuning scripts.
25
  - Advanced LLM inference guides.
26
  - Advanced vision fine-tuning scripts.
27
- - Advanced voice/transcription fine-tuning scripts.
28
  - One click LLM API templates
29
-
30
- ## Function-calling Models and Datasets
31
-
32
- [Get access here](https://trelis.com/function-calling/)
33
-
34
- - Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
35
- - Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
36
- - Scripts to fine-tune models for function calling and structured responses.
37
 
38
  ## ADVANCED Fine-tuning Scripts
39
 
40
  [Get access here](https://trelis.com/advanced-fine-tuning-scripts/)
41
 
42
- 1. Unsupervised + Supervised Fine-tuning Notebooks
43
- 1. Chat fine-tuning scripts
44
- 1. Long context fine-tuning scripts
45
- 1. Function calling fine-tuning
46
- 1. Q&A Dataset Preparation + Cleaning Scripts
47
- 1. Scripts to create and use Embeddings
48
- 1. Quantization Scripts
 
 
 
 
 
 
 
49
 
50
  ## ADVANCED Inference
51
 
52
  [Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)
53
 
54
- - Server setup, API setup and inference guide for open source models.
55
- - Inference for function calling.
 
 
 
 
56
 
57
- ## ADVANCED Vision
58
 
59
  [Get access here](https://trelis.com/advanced-vision/)
60
 
61
  - Dataset Preparation
62
- - Fine-tuning Llava and IDEFICS
63
 
64
- ## ADVANCED Transcription
65
 
66
  [Get access here](https://trelis.com/advanced-transcription/)
67
 
68
- - Fine-tuning Whisper on custom datasets
69
  - Dataset Generation
70
- - Evaluation
 
71
 
72
  ## One-click LLM API/Server Templates
73
  - Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)
74
- - Includes Llama 70B, Mistral 7B, Mixtral 8x7B and many more
 
 
 
 
 
 
 
 
6
  sdk: static
7
  pinned: true
8
  tags:
9
+ - fine-tuning
10
  - inference
11
  - function calling
 
 
 
 
 
12
  - quantization
 
 
13
  ---
14
+ *last updated August 1st 2024*
15
  ## About
16
  Trelis Research provides:
 
17
  - Advanced LLM fine-tuning scripts.
18
  - Advanced LLM inference guides.
19
  - Advanced vision fine-tuning scripts.
20
+ - Advanced voice/transcription fine-tuning scripts.
21
  - One click LLM API templates
22
+ - Function-calling models.
 
 
 
 
 
 
 
23
 
24
  ## ADVANCED Fine-tuning Scripts
25
 
26
  [Get access here](https://trelis.com/advanced-fine-tuning-scripts/)
27
 
28
+ - retrieval (bm25, similarity, re-rankers)
29
+ - wikipedia fine-tuning and dataset creation
30
+ - ReFT fine-tuning
31
+ - multi-gpu fine-tuning
32
+ - orpo fine-tuning
33
+ - memorization fine-tuning
34
+ - mamba-fine-tune
35
+ - DPO fine-tuning
36
+ - chat-fine-tuning
37
+ - function-calling fine-tuning
38
+ - long-context fine-tuning
39
+ - quantization
40
+ - supervised-fine-tuning
41
+ - unsupervised-fine-tuning
42
 
43
  ## ADVANCED Inference
44
 
45
  [Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)
46
 
47
+ - Server setup, API setup and inference guide for open source models
48
+ - Inference for function calling
49
+ - Monte Carlo Inference Methods
50
+ - Private Data Redaction
51
+ - Structured Data Extraction with LLMs
52
+ - Verified RAG citations
53
 
54
+ ## ADVANCED Vision Fine-tuning
55
 
56
  [Get access here](https://trelis.com/advanced-vision/)
57
 
58
  - Dataset Preparation
59
+ - Fine-tuning Llava, IDEFICS2
60
 
61
+ ## ADVANCED Transcription and Voice Cloning
62
 
63
  [Get access here](https://trelis.com/advanced-transcription/)
64
 
 
65
  - Dataset Generation
66
+ - Fine-tuning Whisper speech-to-text on custom datasets
67
+ - Voice Cloning Fine-tuning / Text-to-Speech
68
 
69
  ## One-click LLM API/Server Templates
70
  - Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)
71
+
72
+ ## Function-calling Models and Datasets
73
+
74
+ [Get access here](https://trelis.com/function-calling/)
75
+
76
+ - Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
77
+ - Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
78
+ - Scripts to fine-tune models for function calling and structured responses.