Best 13B model ever!! Can we have a 30B scale of this model?

#1
by Tonight223 - opened

This model works well with different task in multiple languages, even can answer both Chinese and Japanese questions pretty good. can we have a 30B scale of this model? 30B version of this is gonna be the best 30B model ever, and the best model as a consumer GPU owner can have.

Eh, it depends on whether the Vicuna team rolls out the 30B delta weights. Or we can just hope someone with enough GPU resources could replicate a 30B vicuna with open-sourced vicuna's dataset.

Agree! Probably the best for 13/14B LLM. Reasoning is better than Vicuna 13B / RWKV14B-v11
I put it through ReAct loop, although it may not know when to stop, but it knows about tool, it knows to give correct input for it, and the observation seems to make sense.

Question: Who is Leo DiCaprio's longest dated girlfriend? What is her current age raised to the 0.43 power?
Thought: I can use a search engine to find information about Leo DiCaprio's girlfriends and use a calculator to find the age raised to the 0.43 power.
Action: Search
serper( Leo DiCaprio girlfriend) ...
Internet search returns 195 words.
Action Input: Leo DiCaprio girlfriend
Action Result: DiCaprio broke up with girlfriend Camila Morrone, 25, in the summer of 2022, after dating for four years. He had been with the model turned actress for nearly five years, as they were first said to be dating.
Observation: Leo DiCaprio's longest dated girlfriend was Camila Morrone, who he dated for almost five years.
Reflection: I learned that Leo DiCaprio has had a few long-term relationships, but it seems like he's been single for a while now.
Thought: I can use a calculator to find the age raised to the 0.43 power.
Action: Calculator
wolfram(25 raised to the 0.43 power) ...
Action Input: 25 raised to the 0.43 power
Action Result: 3.99130...
Observation: The age raised to the 0.43 power is approximately 4.
Reflection: I'm not sure what the significance of the age raised to the 0.43 power is, but it seems like a useful tool to have in my back pocket.
Thought: I can repeat this process to find out more about Leo DiCaprio's relationships.
Action: Search
serper( Leo DiCaprio relationships) ...
Internet search returns 167 words.
Action Input: Leo DiCaprio relationships
Action Result: Leonardo DiCaprio is believed to have split from his girlfriend of five years, Camila Morrone, but has previously been romantically with Bridget Hall, Naomi Campbell and Eva Herzigová. He went on to date Bar Refaeli, Blake Lively, Toni Garrn and Nina Agdal.
Observation: Leo DiCaprio has had a lot of high-profile relationships over the years.
Reflection: It's interesting to see how many famous women Leo DiCaprio has dated, but I'm still curious about his longest dated girlfriend's age raised to the 0.43 power.
Thought: I can use a calculator to find the age raised to the 0.43 power.
...

Glad you're finding it useful!

One of best models i tried , gonna be interesting to compare it with pure Wizard13B. :)

I suspect the larger the size, the more money it costs to train. Further to that, perhaps it is much harder for folks like me to train and run inference. I think if we can solve the training and inference issue with large model, say we can do all with runpod cheaply, then the next logical thing is to raise money through some kind of patreon campaign to raise money for producing it. I believe someone has to pay the bill some how. Please correct me if this is not the case.

I am curious how 30B will perform compared with 13B tho.

Created now by TheBloke. What an amazing guy!

Created by Eric Hartford - quantised by me :)

Sign up or log in to comment