| TITLE = "LLaMA 13B(Int8 Quantized) Model Playground" | |
| ABSTRACT = """ | |
| This Space allows you to play with the one of the variant(13B) as part of the [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/)(Large Language Model Meta AI) released by Meta AI. | |
| LLaMA is a general purpose language model, so it behaves differently comparing to [ChatGPT](https://openai.com/blog/chatgpt/). Even though the UI or this Space application is in Chat-like form, the generated output will be the completion of the given prompt. Because of this, your prompts should appropriately guide what to be generated. | |
| Thanks to tloen who provided the modified code base to achieve int8 Quantization ([repo](https://github.com/tloen/llama-int8)). | |
| """ | |
| EXAMPLES = [ | |
| "Who are 5 people you would like to meet?", | |
| "Send an email requesting that people use language models responsibly.", | |
| "Write a theory to explain why cat never existed", | |
| "write a story about a grain of sand as it watches millions of years go by" | |
| ] |