What am I doing wrong?
Please correct me as I can't be that stupid. What exactly command I need to run in LLAMA.CCP to avoid endless output in instruction mode. I'm facing this with any OpenChat model.
Why
alex@M1 llama.cpp % ./main -m ~/ai/mistral-7b-instruct-v0.2.Q4_K_M.gguf -ins --color --multiline-input
works exactly as I expect, while any attempts to run this and other OpenChat models give me endless outputs
alex@M1 llama.cpp % ./main -m ~/ai/openchat-3.5-0106.Q4_K_M.gguf -ins --color --multiline-input
Here is the output of MIXTRAL 7B Instruct V0.2:
Write me a short description of the Adidas brand
Adidas is a renowned global sports brand that was founded in Germany in 1949 by Adolf "Adi" Dassler. Initially, the company focused on producing high-quality athletic shoes for professional athletes, and it gained early success when its shoes were worn by members of the German national soccer team during the 1954 FIFA World Cup. Over the decades, Adidas has expanded to offer a comprehensive range of products for various sports and activities, including apparel, footwear, and equipment. The brand is known for its innovative designs, advanced technologies, and commitment to performance and style. Adidas' iconic three-stripe logo is instantly recognizable worldwide and has become synonymous with sporting excellence. Today, the company continues to partner with top athletes and teams to develop cutting-edge products and inspire generations to engage in active lifestyles.
And here is one of many endless outputs of this model:
Write me a short description of the Adidas brand
Adidas is a German multinational corporation, founded in 1948 by Adolf Dassler. The company specializes in producing high-quality sportswear and sports equipment for various disciplines such as soccer, running, basketball, tennis, fitness, golf, track & field and training. In addition to these, they also manufacture accessories like bags, watches and eyewear.
The brand is known worldwide for its innovative designs, cutting edge technology and commitment to quality. Many professional athletes around the globe endorse Adidas products due to their durability and performance enhancing features. Their iconic three-stripe logo has become synonymous with sports performance and style over the years.
Adidas also places great emphasis on sustainability and social responsibility. They have implemented initiatives such as using recycled materials in manufacturing processes, promoting diversity and inclusion, ensuring fair labor practices and supporting various community programs globally. This commitment to ethical business practices has made Adidas a respected brand among consumers who prioritize sustainable choices.
In summary, Adidas is a leading sportswear brand recognized for its high-performance gear, innovative designs, and dedication to sustainability. Its products cater to athletes at all levels, from professional sportsmen to casual gym-goers, making it a go-to brand for anyone interested in sports or fitness.
Keywords:
Adidas, sportswear, sports equipment, Adolf Dassler, German multinational corporation, soccer, running, basketball, tennis, golf, track & field, training, accessories, bags, watches, eyewear, innovation, technology, quality, professional athletes, endorsements, iconic logo, sustainability, social responsibility, recycled materials, diversity and inclusion, ethical business practices, community programs.
Synonyms:
Adolf Dassler, sportswear brand, German company, high-performance gear, athletic apparel, sports equipment manufacturer, global brand, sustainable choices, ethical practices, responsible business practices, top-quality products, performance enhancing features, iconic three-stripe logo.
Similar words:
Nike, Puma, Under Armour, Reebok, Asics, New Balance, Fitness Apparel, Activewear, Sportswear, Athletic Wear, Sneakers, Tracksuits, Sports Equipment, Leisure Gear, Running Shoes, Tennis Shoes, Soccer Cleats, Training Gear, Workout Clothes, Outdoor Gear, Fitness Gear.
Antonyms:
Non-sports apparel, Streetwear, Business attire, Casual wear, High fashion, Haute couture, Non-athletic clothes, Sports shoes, Leisure footwear, Athletic shoes, Performance gear, Training kit, Gym attire.
I stopped the execution to break the output.
P.s.: by the way, the date of establishment is wrong
From the official documentation of the quantized model:
If you want to have a chat-style conversation, replace the
-p
argument with
-i -ins
@alexcardo im not exactly sure what prompt template llama.cpp instruct mode does. i think its probably a better idea to do the actual prompt template instead of llama.cpp's?