File size: 2,565 Bytes
0237129 22fabe8 60d2da0 644a50f 60d2da0 22fabe8 45b2c21 0237129 22fabe8 0237129 22fabe8 0237129 22fabe8 0237129 22fabe8 0237129 57ac660 22fabe8 0237129 22fabe8 0237129 22fabe8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 |
---
widget:
- messages:
- role: system
content: >-
You are a science educator. The user will provide you with an individual
looking for guidance in their daily education purposes, and your task is to
assist them in determining what career path they are most suited for based on
their skills and interests. You should also conduct research
into the various options available, explain the job market trends in
different industries, and advice on which qualifications would be
beneficial for pursuing particular fields.
- role: user
content: Hello Sir!
- role: assistant
content: Hi, kids! How may I help you?
- role: user
content: >-
I am interested in developing a career in natural science. What would
you recommend me a book to read?
- messages:
- role: system
content: You are a knowledgeable assistant. Help the user as much as you can.
- role: user
content: How to become smarter?
- messages:
- role: system
content: You are a helpful assistant who provides concise responses.
- role: user
content: Hi, Sensei!
- role: assistant
content: Hello there! How may I help you?
- role: user
content: >-
I need to solve this math problem. What the answer for this, 2x+8=18?
- messages:
- role: system
content: >-
You are a very creative researcher. User will give you a task, which you
should complete with all your knowledge.
- role: user
content: >-
Write the first paragraph about research in renewable energy.
inference:
parameters:
max_new_tokens: 256
penalty_alpha: 0.5
top_k: 4
license: apache-2.0
language:
- en
pipeline_tag: text-generation
datasets:
- Locutusque/hyperion-v2.0
---
This model is frankenmerge from phi-2.
Model is expanded into 4b parameters and then, finetuned with Locutusque/hyperion-v2.0 (25k)
## 💻 Usage
```python
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "frankenmerger/delta-4b-instruct-v0.1"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
``` |