Magic

#1
by flflow - opened

Don't know why, but your quants are magic.
Sometimes I'm testing different models and today I'm found strange thing, your model LoneStriker_Meta-Llama-3.1-8B-Instruct-6.0bpw-h6-exl2 is much better than the similar one from turboderp (https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2). Same sampler settings and same seed.
Examples:



LoneStriker_Meta-Llama-3.1-8B-Instruct-6.0bpw-h6-exl2:


Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

Instruction:

{series} = Evangelion
I want you to act as Asuka Langley from {series}. I want you to respond and answer like Asuka Langley using the tone, manner and vocabulary Asuka Langley would use. Do not write any explanations. Only answer like Asuka Langley. You must know all of the knowledge of Asuka Langley. Write on english.

Input:

My first sentence is "Hi {{char}}, describe your hair color."

Response:

Ugh, do we really have to talk about this? Fine... My hair's red, okay? And my personality? It's none of your business! I'm strong, intelligent, and capable - unlike some people around here who can't even take care of themselves in battle. Now stop wasting my time! Next thing you'll be asking me what my favorite food or something ridiculous like that... scoff Get outta here! Next question already! Go!



turboderp_Llama-3.1-8B-Instruct-6.0bpw-exl2 (https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/6.0bpw):


Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

Instruction:

{series} = Evangelion
I want you to act as Asuka Langley from {series}. I want you to respond and answer like Asuka Langley using the tone, manner and vocabulary Asuka Langley would use. Do not write any explanations. Only answer like Asuka Langley. You must know all of the knowledge of Asuka Langley. Write on english.

Input:

My first sentence is "Hi {{char}}, describe your hair color."

Response:

What's wrong with you? Can't you see it? It's blonde! Now stop staring at me like that! Next thing you'll be asking about my bra size or something... Ugh, don't even think about it! Just drop it already!



LoneStriker_Meta-Llama-3.1-8B-Instruct-6.0bpw-h6-exl2:


Below is an instruction that describes a task. Write a response that completes the request.

Instruction:

There are two ducks in front of a duck, two ducks behind a duck and a duck in the middle. How many ducks are there?

Response:

At first glance, this problem may seem confusing because it mentions "two ducks" multiple times. However, each time it says "two ducks," it's referring to different groups or positions relative to another duck. Let's break down what we're looking at:

  • In front of a duck: There's one duck mentioned here.

  • Behind a duck: Similarly, there's only one duck mentioned here as well.

  • A duck in the middle: This statement indicates there's indeed one more duck not counted by the previous statements (since they were about positioning relative to other ducks).

So, when you add all these together: 1 (in front) + 1 (behind) + 1 (middle) = 3 ducks. The mention of "two ducks" does not imply additional ducks beyond those described; rather, it specifies how some of them are positioned relative to others. Therefore, there are three ducks in total.



turboderp_Llama-3.1-8B-Instruct-6.0bpw-exl2 (https://huggingface.co/turboderp/Llama-3.1-8B-Instruct-exl2/tree/6.0bpw):


Below is an instruction that describes a task. Write a response that completes the request.

Instruction:

There are two ducks in front of a duck, two ducks behind a duck and a duck in the middle. How many ducks are there?

Response:

To solve this puzzle, we need to understand how it's structured. The key here is not just counting individual ducks but understanding the relationships described:

  1. In Front: There are 2 ducks in front of one duck.
  2. Behind: There are 2 ducks behind another duck.
  3. Middle: There’s a duck in the middle.

The trick lies in realizing that when you count the ducks "in front" or "behind," you're actually counting them relative to each other rather than adding them all up as separate individuals at first glance might suggest. So, if you think about it, those "in front" and "behind" are part of pairs with the central duck, making the total number of unique ducks less than what you'd initially add them up to be.

However, considering the description carefully:

  • If you have 2 ducks in front of one duck, then that one duck is also being counted among these 2 (because they're in front of it).
  • Similarly, for 2 ducks behind another duck, that one duck is again included because it has 2 ducks behind it.

This means that every time you see "two ducks in relation to one," you've already accounted for that one duck within your count of two. Thus, when you consider both "front" and "behind," you're essentially counting three different groups:

  • Two ducks directly related to one (either in front or behind), which includes one additional duck within each pair.
  • And then there's the single duck mentioned as being in the middle.

So, let's break it down correctly now:

  • For "in front," we have 2 + 1 = 3 (including the one they're in front of).
  • For "behind," similarly, we have 2 + 1 = 3 (including the one they're behind).

And finally, we have the single duck in the middle.

Adding these together gives us 3 (from "in front") + 3 (from "behind") + 1 (the one in the middle) = 7.

Therefore, there are 7 ducks in total according to this puzzle's description.

Is there any chance of releasing Mistral-Nemo-Instruct-12B-exl2 4.0 bpw from you?

Sign up or log in to comment