Upload README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,38 @@
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
base_model: mistralai/Mistral-7B-v0.1
|
|
|
|
|
4 |
---
|
5 |
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
-
Trained with [Ludwig.ai](https://ludwig.ai) and [
|
9 |
|
10 |
Given a passage from a news report generates a headline.
|
11 |
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
|
15 |
|
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
base_model: mistralai/Mistral-7B-v0.1
|
4 |
+
datasets:
|
5 |
+
- JulesBelveze/tldr_news
|
6 |
---
|
7 |
|
8 |
# Model Card for Model ID
|
9 |
|
10 |
+
Trained with [Ludwig.ai](https://ludwig.ai) and [Predibase](https://predibase.com)!
|
11 |
|
12 |
Given a passage from a news report generates a headline.
|
13 |
|
14 |
+
Try it in [LoRAX](https://github.com/predibase/lorax):
|
15 |
+
|
16 |
+
```python
|
17 |
+
from lorax import Client
|
18 |
+
|
19 |
+
client = Client("http://<your_endpoint>")
|
20 |
+
|
21 |
+
content = "<your news story>"
|
22 |
+
|
23 |
+
prompt = f"""
|
24 |
+
The following passage is content from a news report. Please summarize this
|
25 |
+
passage in one sentence or less.
|
26 |
+
|
27 |
+
Passage: {content}
|
28 |
+
|
29 |
+
Summary:
|
30 |
+
"""
|
31 |
+
|
32 |
+
adapter_id = "tgaddair/mistral-7b-tldrnews-headlines-lora-r8"
|
33 |
+
resp = client.generate(prompt, max_new_tokens=64, adapter_id=adapter_id)
|
34 |
+
print(resp.generated_text)
|
35 |
+
```
|
36 |
|
37 |
|
38 |
|