LeroyDyer commited on
Commit
54d01b7
1 Parent(s): cf63572

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +154 -0
README.md ADDED
@@ -0,0 +1,154 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: LeroyDyer/_Spydaz_Web_AI_Chatml_BASE
3
+ datasets:
4
+ - gretelai/synthetic_text_to_sql
5
+ - HuggingFaceTB/cosmopedia
6
+ - teknium/OpenHermes-2.5
7
+ - Open-Orca/SlimOrca
8
+ - Open-Orca/OpenOrca
9
+ - cognitivecomputations/dolphin-coder
10
+ - databricks/databricks-dolly-15k
11
+ - yahma/alpaca-cleaned
12
+ - uonlp/CulturaX
13
+ - mwitiderrick/SwahiliPlatypus
14
+ - swahili
15
+ - Rogendo/English-Swahili-Sentence-Pairs
16
+ - ise-uiuc/Magicoder-Evol-Instruct-110K
17
+ - meta-math/MetaMathQA
18
+ - abacusai/ARC_DPO_FewShot
19
+ - abacusai/MetaMath_DPO_FewShot
20
+ - abacusai/HellaSwag_DPO_FewShot
21
+ - HaltiaAI/Her-The-Movie-Samantha-and-Theodore-Dataset
22
+ - HuggingFaceFW/fineweb
23
+ - occiglot/occiglot-fineweb-v0.5
24
+ - omi-health/medical-dialogue-to-soap-summary
25
+ - keivalya/MedQuad-MedicalQnADataset
26
+ - ruslanmv/ai-medical-dataset
27
+ - Shekswess/medical_llama3_instruct_dataset_short
28
+ - ShenRuililin/MedicalQnA
29
+ - virattt/financial-qa-10K
30
+ - PatronusAI/financebench
31
+ - takala/financial_phrasebank
32
+ - Replete-AI/code_bagel
33
+ - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
34
+ - IlyaGusev/gpt_roleplay_realm
35
+ - rickRossie/bluemoon_roleplay_chat_data_300k_messages
36
+ - jtatman/hypnosis_dataset
37
+ - Hypersniper/philosophy_dialogue
38
+ - Locutusque/function-calling-chatml
39
+ - bible-nlp/biblenlp-corpus
40
+ - DatadudeDev/Bible
41
+ - Helsinki-NLP/bible_para
42
+ - HausaNLP/AfriSenti-Twitter
43
+ - aixsatoshi/Chat-with-cosmopedia
44
+ - xz56/react-llama
45
+ - BeIR/hotpotqa
46
+ - arcee-ai/agent-data
47
+ - HuggingFaceTB/cosmopedia-100k
48
+ - HuggingFaceFW/fineweb-edu
49
+ - m-a-p/CodeFeedback-Filtered-Instruction
50
+ - heliosbrahma/mental_health_chatbot_dataset
51
+ language:
52
+ - en
53
+ - sw
54
+ - ig
55
+ - so
56
+ - es
57
+ - ca
58
+ - xh
59
+ - zu
60
+ - ha
61
+ - tw
62
+ - af
63
+ - hi
64
+ - bm
65
+ - su
66
+ license: apache-2.0
67
+ tags:
68
+ - Mistral_Star
69
+ - Mistral_Quiet
70
+ - Mistral
71
+ - Mixtral
72
+ - Question-Answer
73
+ - Token-Classification
74
+ - Sequence-Classification
75
+ - SpydazWeb-AI
76
+ - chemistry
77
+ - biology
78
+ - legal
79
+ - code
80
+ - climate
81
+ - medical
82
+ - text-generation-inference
83
+ - not-for-all-audiences
84
+ - chain-of-thought
85
+ - tree-of-knowledge
86
+ - forest-of-thoughts
87
+ - visual-spacial-sketchpad
88
+ - alpha-mind
89
+ - knowledge-graph
90
+ - entity-detection
91
+ - encyclopedia
92
+ - wikipedia
93
+ - stack-exchange
94
+ - Reddit
95
+ - Cyber-series
96
+ - MegaMind
97
+ - Cybertron
98
+ - SpydazWeb
99
+ - Spydaz
100
+ - LCARS
101
+ - star-trek
102
+ - mega-transformers
103
+ - Mulit-Mega-Merge
104
+ - Multi-Lingual
105
+ - Afro-Centric
106
+ - African-Model
107
+ - Ancient-One
108
+ - llama-cpp
109
+ - gguf-my-repo
110
+ ---
111
+
112
+ # LeroyDyer/_Spydaz_Web_AI_Chatml_BASE-Q4_K_M-GGUF
113
+ This model was converted to GGUF format from [`LeroyDyer/_Spydaz_Web_AI_Chatml_BASE`](https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_Chatml_BASE) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
114
+ Refer to the [original model card](https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_Chatml_BASE) for more details on the model.
115
+
116
+ ## Use with llama.cpp
117
+ Install llama.cpp through brew (works on Mac and Linux)
118
+
119
+ ```bash
120
+ brew install llama.cpp
121
+
122
+ ```
123
+ Invoke the llama.cpp server or the CLI.
124
+
125
+ ### CLI:
126
+ ```bash
127
+ llama-cli --hf-repo LeroyDyer/_Spydaz_Web_AI_Chatml_BASE-Q4_K_M-GGUF --hf-file _spydaz_web_ai_chatml_base-q4_k_m.gguf -p "The meaning to life and the universe is"
128
+ ```
129
+
130
+ ### Server:
131
+ ```bash
132
+ llama-server --hf-repo LeroyDyer/_Spydaz_Web_AI_Chatml_BASE-Q4_K_M-GGUF --hf-file _spydaz_web_ai_chatml_base-q4_k_m.gguf -c 2048
133
+ ```
134
+
135
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
136
+
137
+ Step 1: Clone llama.cpp from GitHub.
138
+ ```
139
+ git clone https://github.com/ggerganov/llama.cpp
140
+ ```
141
+
142
+ Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
143
+ ```
144
+ cd llama.cpp && LLAMA_CURL=1 make
145
+ ```
146
+
147
+ Step 3: Run inference through the main binary.
148
+ ```
149
+ ./llama-cli --hf-repo LeroyDyer/_Spydaz_Web_AI_Chatml_BASE-Q4_K_M-GGUF --hf-file _spydaz_web_ai_chatml_base-q4_k_m.gguf -p "The meaning to life and the universe is"
150
+ ```
151
+ or
152
+ ```
153
+ ./llama-server --hf-repo LeroyDyer/_Spydaz_Web_AI_Chatml_BASE-Q4_K_M-GGUF --hf-file _spydaz_web_ai_chatml_base-q4_k_m.gguf -c 2048
154
+ ```