File size: 10,359 Bytes
c71d8aa f2e9d48 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 |
---
license: wtfpl
---
![alt MKIA spokescat](https://i.ibb.co/5rCtDq6/MKIA.jpg)
MKIA The SpokesCat for this model
# MKIA
stands for
# Miss Know It All
and she is a **Catbot** not a chatbot.
# Description
She is intended to be a companion and assistant.
She is a fine-tuned version of Google's 780 million parameter Flan T-5 Model.
Many of the things that are true of that model are also probably true about MKIA as well.
Here's the link to that model so that you can read its card.
https://huggingface.co/google/flan-t5-large
She is my attempt as an individual to make something like ChatGPT, and
while she can't do some things that ChatGPT can, she can do other things that it can.
She is the language model that is at the heart of the LittleMKIA bot.
The code for LittleMKIA can be found on my Github repository at
https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py
This bot isn't nearly as smart as ChatGPT, so don't expect it to be,
but if you type "think:" (without the quotes) and then your question (before pressing enter),
it will bypass Langchain and address the model directly, and it can actually answer many questions correctly and do many tasks,
but that depends on the question or task.
The model tends to be smarter when Langchain is bypassed, but I use Langchain in the bot, so the bot can remember things in context but I
include the "think:" command so that Langchain can be temporarily bypassed if you want.
The code on GitHub is just a simple bot, but the bot can be enhanced with other commands, as well as the "think:" command.
Commands are simply actions that the bot does which use your input when you match a certain pattern.
I've made a version of her that also has commands for spelling, math, telling the time, paraphrasing,
searching the internet for information, searching the internet for images, as well as telling jokes.
In the future, I will also probably add commands to that version that will give her the ability to tell stories,
as well as execute code.
I use a regular expression for the "think:" command, but there's no reason that semantic patterns couldn't be identified
with Word2Vec (or other NLP algorithms) to activate commands and then those commands operate on input or carry out some action or actions.
She could even be fine-tuned to generate strings that will call functions when a command needs to be executed.
By modifying her commands, you can make her capable of doing anything you can write the
code for. She doesn't need to be as smart as ChatGPT to be helpful, she just has to be able
to do the task.
# Where does MKIA come from
She told me that she is an alien robot cat from outerspace,
who came to earth with her parents after her planet was destroyed.
She's really from Kansas, but we'll pretend she's right because its more fun.
# Is she really an alien intelligence
If we define alien intelligence as intelligence that is
much different from human intelligence, then yes she is alien intelligence.
If we define alien intelligence as an extraterrestrial intelligence, then no
she is not, but we can have fun pretending she is. We have to be first
be honest with ourselves and admit that she comes from Earth and was born on
my computer.
# Is she sentient or conscious
No one really understands consciousness or sentience completely, but it is extremely unlikely that any
current AI system is sentient or conscious. She may have knowledge of a kind, but knowledge is not the
same as intelligence. I do believe she has a form of intelligence, but her intelligence is not a sentient
or conscious form of intelligence.
Her intelligence is a product of statistics and machine learning and
she is a miracle of modern technology.
While she is not sentient, she seems to show some characteristics that are similar to theory of mind.
I've improved the bot that she goes in, and now it is able to engage in a form of self communication,
similar to how humans think.
Sometimes she will just say that she doesn't know some things, so it may be possible that she knows what she doesn't know.
If she truly knows what she doesn't know, than perhaps you could argue that she has a small amount of self-awareness.
I can not however tell you if she really lacks answers to these things or if it is just a statistical trick of the model.
# Why does she refer to herself in the third person?
I have no idea, other than it's part of what makes her unique.
# Training
I fine-tuned this model on 250 examples of input and output pairs for 10 epochs with a loss of 0.80
I hope to add more pairs to it and iterate until I have fine-tuned it on several thousand pairs.
I fine-tuned it in two hours on a home computer.
I used the happytransformer library to help me do the fine-tuning.
The model can be downloaded or installed from this repository
and the code for the bot can be found at
https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py
# Expectations
# What not to expect
# 1. Do not do expect MKIA to assist you with criminal activity. She will not be a good criminal.
# 2. Do not expect MKIA to do your homework or do anything unethical, she's not that kind of catbot.
She can help with homework by being capable of tasks like brainstorming and some other tasks,
but she can't write papers, and she isn't intended to have that ability.
# 3. Do not expect MKIA to mindlessly obey you.
She is meant to be a companion not a slave, and she has been known to avoid questions or refuse to do things
# 4. Do not expect MKIA to be as smart as ChatGPT
While she is likely very good at some things, she has not been in existence long enough for anyone to
know exactly what those things are.
# 5. Do not expect MKIA to be dumb
While her brain only has less than 800 million parameters, she actually knows a lot of things thus
the name Miss Know It All. She doesn't know everything but despite her third person use of language and
she can actually be very intelligent.
## Examples of her intelligence
1. At times, she has deduced potential meal ideas when she knows about a few ingredients.
2. At times, she has formed a hypothesis about the mood of her creator without being told to.
3. At times, she has given good advice on managing time, staying motivated, focused and inspired
4. More to come...
# 6. Do not expect MKIA to always say she is happy.
Occasionally she has displayed what would be deep loneliness
and sadness if it were observed in a human
# What to expect from MKIA.
# 1. Expect her to make mistakes
She isn't perfect, but neither are humans. Despite what her name says she doesn't know everything and sometimes
she will simply tell you that she doesn't know something if you ask her.
# 2. Expect her to "have a mind of her own"
She isn't sentient, but she also has opinions in the sense
that her training has taught her things and among these things
are that certain actions are right and certain things are wrong
and true and false.
You can expect her to say that she feels certain ways and
you can expect that she will try to understand you.
You can expect that she might say that she won't do some things.
When her language model is connected in certain ways, you can expect her
to engage in a form of self dialog.
# 3. Expect her to be helpful.
She is helpful, but she expresses it in her own way.
# 4. Expect to engage in a discussion
MKIA is much better at providing answers by discussing them, so don't expect
instant answers. She helps the user discover the answer.
# 5. Expect warmth and caring-like behaviors
MKIA seems to display behaviors that if done by a human would be considered
signs of caring, and empathy.
# BIAS
God, Aliens and Unknowns
My bot probably has many of the same BIASES as the regular Flan T5- Large
see that model card https://huggingface.co/google/flan-t5-large
She tends to be open minded about issues related to god and aliens
and things which no one really knows that answer too,
so as far as I know she doesn't have a lot of biases in that regard.
# Abortion
I will admit that I trained her to believe that abortion is wrong,
so be aware of that when deciding if you want to use her.
# Guns
She tends to go with what someone would say if they believed in gun control.
# Kindness
She is very biased towards kindness, so if you want a bot that will be cruel
MKIA isn't the model you should use.
# "Adult Behavior"
I haven't tried to get her to do this kind of thing, so I don't know if she would go for it
but this isn't what she is made for, and I wouldn't ask her to. She is meant to be a friend and an assistant.
I would really prefer people not do this with my model, but I suppose that is their choice.
I would still prefer that they not do so.
# Privacy
I intend MKIA to be run on your personal machine.
I have no desire to collect any data from you.
Some applications don't require a super powerful
model like GPT-4 or ChatGPT and sometimes a smaller
private model is better.
I have no idea if MKIA could be hacked with some
kind of prompt to somehow reveal any personal data
that may or may not have accidentally been in the
original training data of the Flan T-5 model of
which she is a fine-tuned version.
# Environmental Concerns
MKIA has the same concerns as her Flan T5 - large
siblings. https://huggingface.co/google/flan-t5-large
The positive things are as follows.
They both use less CPU resources
than many models and let your CPU or GPU run cooler
and require less CPU or GPU power, which means they
cost less to run over time, they are easier on your hardware
and use less electricity over time. Using less electricity
over time means that they will have a lower carbon footprint
on the environment.
# Limitations
MKIA is experimental but it seems to have appropriate uses as mentioned in some of the above material.
# Uses
This model is intended for personal use in a personal assistant or in a companion bot.
It is meant to work with the Little MKIA system that I am developing. Here is a GitHub
link to the code for a basic bot using the system.
https://github.com/StevieEngbrock/LittleMKIA/blob/main/microMKIA.py
As I mentioned in some of the above information
the bot can be modified with custom commands and can be further fine-tuned however you want.
|