Upload folder using huggingface_hub

#1
by nold - opened
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ HelpingAI-9B_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ HelpingAI-9B_Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ HelpingAI-9B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ HelpingAI-9B_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ HelpingAI-9B_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ HelpingAI-9B_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
HelpingAI-9B_Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c8b35db89cf48bbfef561b9fdf8e0af79dfd117d3ec507d2dc33805faaa684d
3
+ size 3354325344
HelpingAI-9B_Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eab0c22790dab84bad7aaa895a666a3a060753736ac89f84b260c06622b278e2
3
+ size 4324405600
HelpingAI-9B_Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c90f3a65332a03a6cbb563eee19c7586d9544f646ff9f33f7f1904b3d415ae2
3
+ size 5328957792
HelpingAI-9B_Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14a9893336a2b04316a9076779ee609b73b185f8379b050af1d5ec7031a43859
3
+ size 6258258272
HelpingAI-9B_Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35fc97f6b05c09657387cc5ffb1e74cc780bc385e55ece1b0578ecf6084a60fd
3
+ size 7245640032
HelpingAI-9B_Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d037bdd57d64964e9af844dc08f4fffb18fd806fc2793e6bc2424bb8b33d67f3
3
+ size 9383915872
README.md ADDED
@@ -0,0 +1,128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: hsul
4
+ license_link: https://huggingface.co/OEvortex/vortex-3b/raw/main/LICENSE.md
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - HelpingAI
8
+ - Emotionally Intelligent
9
+ ---
10
+
11
+
12
+ # HelpingAI-9B: Emotionally Intelligent Conversational AI
13
+
14
+ ![logo](https://huggingface.co/OEvortex/HelpingAI-3B/resolve/main/HelpingAI.png)
15
+
16
+ ## Overview
17
+ HelpingAI-9B is a large language model designed for emotionally intelligent conversational interactions. It is trained to engage users with empathy, understanding, and supportive dialogue across a wide range of topics and contexts. The model aims to provide a supportive AI companion that can attune to users' emotional states and communicative needs.
18
+
19
+ ## Objectives
20
+ - Engage in open-ended dialogue while displaying emotional intelligence
21
+ - Recognize and validate user emotions and emotional contexts
22
+ - Provide supportive, empathetic, and psychologically-grounded responses
23
+ - Avoid insensitive, harmful, or unethical speech
24
+ - Continuously improve emotional awareness and dialogue skills
25
+
26
+ ## Methodology
27
+ HelpingAI-9B is based on the HelpingAI series and further trained using:
28
+ - Supervised learning on large dialogue datasets with emotional labeling
29
+ - Reinforcement learning with a reward model favoring emotionally supportive responses
30
+ - Constitution training to instill stable and beneficial objectives
31
+ - Knowledge augmentation from psychological resources on emotional intelligence
32
+
33
+ ## Usage code
34
+ ```python
35
+ from transformers import AutoModelForCausalLM, AutoTokenizer
36
+ import torch
37
+ device = "cuda" # the device to load the model onto
38
+
39
+ model = AutoModelForCausalLM.from_pretrained(
40
+ "OEvortex/HelpingAI-9B",
41
+ torch_dtype='auto',
42
+ device_map="auto"
43
+ )
44
+ tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI-9B")
45
+
46
+ prompt = "Express joy and excitement about visiting a new place"
47
+ messages = [
48
+ # {"role": "system", "content": "You are a helpful AI assistant."},
49
+ {"role": "user", "content": prompt}
50
+ ]
51
+ text = tokenizer.apply_chat_template(
52
+ messages,
53
+ tokenize=False,
54
+ add_generation_prompt=True
55
+ )
56
+ model_inputs = tokenizer([text], return_tensors="pt").to(device)
57
+
58
+ generated_ids = model.generate(
59
+ model_inputs.input_ids,
60
+ max_new_tokens=1024,
61
+ eos_token_id=tokenizer.eos_token_id,
62
+ temperature=0.25,
63
+ )
64
+ generated_ids = [
65
+ output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
66
+ ]
67
+
68
+ response = tokenizer.batch_decode(generated_ids)[0]
69
+ print(response)
70
+
71
+ ```
72
+ *Directly using this model from GGUF*
73
+
74
+ ```python
75
+ %pip install -U 'webscout[loacl]'
76
+
77
+ from webscout.Local.utils import download_model
78
+ from webscout.Local.model import Model
79
+ from webscout.Local.thread import Thread
80
+ from webscout.Local import formats
81
+ from webscout.Local import samplers
82
+ # 1. Download the model
83
+ repo_id = "OEvortex/HelpingAI-9B"
84
+ filename = "helpingai-9b.Q4_0.gguf"
85
+ model_path = download_model(repo_id, filename)
86
+
87
+ # 2. Load the model
88
+ model = Model(model_path, n_gpu_layers=48)
89
+
90
+ # 3. Create a Thread for conversation
91
+ thread = Thread(model, formats.chatml, samplers.TikTokenSampling)
92
+
93
+ # 4. Start interacting with the model
94
+ thread.interact()
95
+ ```
96
+ ## Example Dialogue
97
+ > Express joy and excitement about visiting a new place.
98
+
99
+ Yay! I'm super excited to visit this new place! πŸŽ‰ It sounds amazing and I can't wait to explore and have fun there! This is going to be such an exciting adventure! 🌟 Let's go, let's do this! ✨
100
+
101
+ > I'm feeling really down today. Nothing seems to be going right.
102
+
103
+ Oh no, I'm sorry to hear that you're feeling down. It happens sometimes, but remember that it's okay to feel sad. If you want to talk about what's bothering you, I'm here to listen and offer support. We can find a way through this together! 🌈
104
+
105
+ > I'm excited because I just got accepted into my dream school! I wanted to share the good news with someone.
106
+
107
+ Wow, that's amazing! πŸŽ‰ Congratulations on getting accepted into your dream school! That's such an incredible accomplishment and I'm really happy for you! Keep up the hard work and enjoy the journey ahead! 🌟 If there's anything else I can do to help, just let me know! 😊
108
+
109
+ > My best friend just got into an argument with me and I don't know what to do. How can I fix this situation?
110
+
111
+ Oh no, it sounds like you both need some time to cool off. Take a step back and give each other some space. Then, when things have calmed down, try talking things through in a calm and respectful manner. Communication is key for resolving conflicts, so let's work towards finding a resolution that works for both of you! 🌟 If you need any advice or support, I'm here to help! 😊
112
+
113
+ > How can you identify the emotions of others based on their body language and facial expressions?
114
+
115
+ Identifying the emotions of others is a great skill! πŸ€” You can look for body language cues like frowns, smiles, or tense posture. Facial expressions also give away a lot about someone's feelings - watch out for changes in their eyes, mouth, and facial muscles. It's all about being observant and empathetic to understand others better! 😊
116
+
117
+ > What kind of safety devices do I need to install in my house
118
+
119
+ Installing security devices in your home can bring peace of mind and keep you safe. Some essential safety devices include a home alarm system, smoke detectors, carbon monoxide detectors, motion sensors, and surveillance cameras. It's always good to take precautions and ensure that your home is secure! 🌟 If you need help choosing the right security devices for your family, I can definitely point you in the right direction! 😊
120
+
121
+ > How can your own feelings affect your ability to empathize with someone else?
122
+
123
+ Our own emotions can impact our ability to empathize with others because they shape how we perceive and interpret other people's experiences. If you're feeling happy or positive, it may be easier to see the good in others and offer support. On the other hand, if you're feeling down or stressed, it might be harder to put yourself in someone else's shoes. It's important to acknowledge your own feelings and work on being open and understanding towards others! 🌟
124
+
125
+ ***
126
+
127
+ Quantization of Model [OEvortex/HelpingAI-9B](https://huggingface.co/OEvortex/HelpingAI-9B).
128
+ Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline
test.log ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ What is a Large Language Model?
2
+ Large Language Models (LLMs) are AI models that have been trained on a massive amount of text data, enabling them to generate human-like responses and perform tasks such as translation, summarization, and text generation. These models are capable of understanding and processing complex language patterns, making them highly effective in a wide range of natural language processing tasks.
3
+
4
+ LLMs have been developed to assist with various language-related tasks, such as language translation, text summarization, and generating responses to user queries. They have been trained on large datasets to learn from the data, enabling them to generate human-like responses and perform tasks with