RichardErkhov
commited on
Commit
•
63fd53f
1
Parent(s):
ebf6e05
uploaded readme
Browse files
README.md
ADDED
@@ -0,0 +1,164 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Quantization made by Richard Erkhov.
|
2 |
+
|
3 |
+
[Github](https://github.com/RichardErkhov)
|
4 |
+
|
5 |
+
[Discord](https://discord.gg/pvy7H8DZMG)
|
6 |
+
|
7 |
+
[Request more models](https://github.com/RichardErkhov/quant_request)
|
8 |
+
|
9 |
+
|
10 |
+
Bart-Finetuned-conversational-summarization - bnb 4bits
|
11 |
+
- Model creator: https://huggingface.co/Mr-Vicky-01/
|
12 |
+
- Original model: https://huggingface.co/Mr-Vicky-01/Bart-Finetuned-conversational-summarization/
|
13 |
+
|
14 |
+
|
15 |
+
|
16 |
+
|
17 |
+
Original model description:
|
18 |
+
---
|
19 |
+
license: mit
|
20 |
+
pipeline_tag: summarization
|
21 |
+
widget:
|
22 |
+
- text: >-
|
23 |
+
Now, there is no doubt that one of the most important aspects of any Pixel
|
24 |
+
phone is its camera. And there might be good news for all camera lovers.
|
25 |
+
Rumours have suggested that the Pixel 9 could come with a telephoto lens,
|
26 |
+
improving its photography capabilities even further. Google will likely
|
27 |
+
continue to focus on using AI to enhance its camera performance, in order to
|
28 |
+
make sure that Pixel phones remain top contenders in the world of mobile
|
29 |
+
photography.
|
30 |
+
- text: >-
|
31 |
+
Elon Reeve Musk (/ˈiːlɒn/ EE-lon; born June 28, 1971) is a businessman and investor. He is the founder,
|
32 |
+
chairman, CEO, and CTO of SpaceX; angel investor, CEO, product architect, and former chairman of Tesla,
|
33 |
+
Inc.; owner, executive chairman, and CTO of X Corp.; founder of the Boring Company and xAI; co-founder
|
34 |
+
of Neuralink and OpenAI; and president of the Musk Foundation. He is one of the wealthiest people in
|
35 |
+
the world, with an estimated net worth of US$190 billion as of March 2024, according to the Bloomberg
|
36 |
+
Billionaires Index, and $195 billion according to Forbes, primarily from his ownership stakes in Tesla
|
37 |
+
and SpaceX.[5][6]
|
38 |
+
|
39 |
+
A member of the wealthy South African Musk family, Elon was born in Pretoria and briefly attended the
|
40 |
+
University of Pretoria before immigrating to Canada at age 18, acquiring citizenship through his
|
41 |
+
Canadian-born mother. Two years later, he matriculated at Queen University at Kingston in Canada.
|
42 |
+
Musk later transferred to the University of Pennsylvania, and received bachelor degrees in economics
|
43 |
+
and physics. He moved to California in 1995 to attend Stanford University, but dropped out after two
|
44 |
+
days and, with his brother Kimbal, co-founded online city guide software company Zip2. The startup
|
45 |
+
was acquired by Compaq for $307 million in 1999, and that same year Musk co-founded X.com, a direct
|
46 |
+
bank. X.com merged with Confinity in 2000 to form PayPal.
|
47 |
+
|
48 |
+
In October 2002, eBay acquired PayPal for $1.5 billion, and that same year, with $100 million of the
|
49 |
+
money he made, Musk founded SpaceX, a spaceflight services company. In 2004, he became an early investor
|
50 |
+
in electric vehicle manufacturer Tesla Motors, Inc. (now Tesla, Inc.). He became its chairman and product
|
51 |
+
architect, assuming the position of CEO in 2008. In 2006, Musk helped create SolarCity, a solar-energy
|
52 |
+
company that was acquired by Tesla in 2016 and became Tesla Energy. In 2013, he proposed a hyperloop
|
53 |
+
high-speed vactrain transportation system. In 2015, he co-founded OpenAI, a nonprofit artificial
|
54 |
+
intelligence research company. The following year, Musk co-founded Neuralink—a neurotechnology company
|
55 |
+
developing brain–computer interfaces—and the Boring Company, a tunnel construction company. In 2022,
|
56 |
+
he acquired Twitter for $44 billion. He subsequently merged the company into newly created X Corp.
|
57 |
+
and rebranded the service as X the following year. In March 2023, he founded xAI, an artificial
|
58 |
+
intelligence company.
|
59 |
+
|
60 |
+
Musk has expressed views that have made him a polarizing figure.[7] He has been criticized for making
|
61 |
+
unscientific and misleading statements, including COVID-19 misinformation and antisemitic conspiracy
|
62 |
+
theories.[7][8][9][10] His ownership of Twitter has been similarly controversial, being marked by the
|
63 |
+
laying off of a large number of employees, an increase in hate speech and misinformation and disinformation
|
64 |
+
on the website, as well as changes to Twitter Blue verification. In 2018, the U.S. Securities and Exchange
|
65 |
+
Commission (SEC) sued him, alleging that he had falsely announced that he had secured funding for a private
|
66 |
+
takeover of Tesla. To settle the case, Musk stepped down as the chairman of Tesla and paid a $20 million fine.
|
67 |
+
- text: >-
|
68 |
+
OnePlus faces the prospect of going out of store in some states in the Indian market next month. Reports
|
69 |
+
this week suggest OnePlus phones will be taken off around 4,500 stores in different parts of the country
|
70 |
+
from May 1, 2024 onwards. It has been pointed out that the retailer organisation taking charge of stores
|
71 |
+
in the South and western parts of the country are not pleased with the company for various reasons.
|
72 |
+
|
73 |
+
The South Indian Organized Retailers Association (ORA) has been quoted saying that OnePlus does not garner
|
74 |
+
enough margins for its network to sell OnePlus phones and that will definitely come as a big jolt to the
|
75 |
+
popular brand.
|
76 |
+
|
77 |
+
Report also mentions that the ORA has sent a formal complaint to OnePlus executives earlier this week,
|
78 |
+
stating that until the issues regarding OnePlus warranty and margins are not resolved, retailers will
|
79 |
+
decide against selling OnePlus phones at their stores in states like Gujarat, Maharashtra, Andhra Pradesh,
|
80 |
+
Telangana, Karnataka, and Tamil Nadu, that caters to a total of 4,500 stores.
|
81 |
+
|
82 |
+
Having said that, the retailers looking to stop selling OnePlus phones are associated with multi-retail
|
83 |
+
brands, so it is possible that small-time mobile shops could still offer phones from the brand. OnePlus
|
84 |
+
has claimed to be one of the top-sellers via online channels but its focus on the offline market seems
|
85 |
+
to have wavered which seems to have caused this displeasure among the retailers in the country.
|
86 |
+
|
87 |
+
We have previously seen that offline retailers play a big role in the growth and demand for phones, and
|
88 |
+
OnePlus will need to do everything to make sure this issue is resolved at the earliest, before it starts
|
89 |
+
to impact its online sales as well. We’re still a few weeks away from the deadline, which ensures OnePlus
|
90 |
+
can still get things sorted and go back to business as usual in these regions.
|
91 |
+
datasets:
|
92 |
+
- EdinburghNLP/xsum
|
93 |
+
- samsum
|
94 |
+
language:
|
95 |
+
- en
|
96 |
+
library_name: transformers
|
97 |
+
---
|
98 |
+
|
99 |
+
# Model Description
|
100 |
+
|
101 |
+
This model is based on the Facebook BART (Bidirectional and Auto-Regressive Transformers) architecture, specifically the large variant fine-tuned for text summarization tasks. BART is a sequence-to-sequence model introduced by Facebook AI, capable of handling various natural language processing tasks, including summarization.
|
102 |
+
|
103 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65af937a30e33d1b60c8772b/jWIThYZRayUFKgScplHrZ.png)
|
104 |
+
|
105 |
+
## Model Details:
|
106 |
+
|
107 |
+
- **Architecture**: BART Large CNN
|
108 |
+
- **Pre-trained model**: BART Large
|
109 |
+
- **Fine-tuned for**: Text Summarization
|
110 |
+
- **Fine-tuning dataset**: [xsum](https://huggingface.co/datasets/EdinburghNLP/xsum) & [samsum](https://huggingface.co/datasets/samsum)
|
111 |
+
|
112 |
+
## Space Link:
|
113 |
+
[Summarization Model](https://huggingface.co/spaces/Mr-Vicky-01/Summarization)
|
114 |
+
|
115 |
+
## How To FineTune This Model:
|
116 |
+
[Github](https://github.com/Mr-Vicky-01/English-Summization)
|
117 |
+
|
118 |
+
## Usage:
|
119 |
+
|
120 |
+
### Installation:
|
121 |
+
|
122 |
+
You can install the necessary libraries using pip:
|
123 |
+
```bash
|
124 |
+
pip install transformers
|
125 |
+
```
|
126 |
+
### Inferecnce
|
127 |
+
provided a simple snippet of how to use this model for the task of paragraph summarization in PyTorch.
|
128 |
+
```python
|
129 |
+
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
|
130 |
+
|
131 |
+
tokenizer = AutoTokenizer.from_pretrained("Mr-Vicky-01/Bart-Finetuned-conversational-summarization")
|
132 |
+
model = AutoModelForSeq2SeqLM.from_pretrained("Mr-Vicky-01/Bart-Finetuned-conversational-summarization")
|
133 |
+
|
134 |
+
def generate_summary(text):
|
135 |
+
inputs = tokenizer([text], max_length=1024, return_tensors='pt', truncation=True)
|
136 |
+
summary_ids = model.generate(inputs['input_ids'], max_new_tokens=100, do_sample=False)
|
137 |
+
summary = tokenizer.decode(summary_ids[0], skip_special_tokens=True)
|
138 |
+
return summary
|
139 |
+
|
140 |
+
text_to_summarize = """Now, there is no doubt that one of the most important aspects of any Pixel phone is its camera.
|
141 |
+
And there might be good news for all camera lovers. Rumours have suggested that the Pixel 9 could come with a telephoto lens,
|
142 |
+
improving its photography capabilities even further. Google will likely continue to focus on using AI to enhance its camera performance,
|
143 |
+
in order to make sure that Pixel phones remain top contenders in the world of mobile photography."""
|
144 |
+
summary = generate_summary(text_to_summarize)
|
145 |
+
|
146 |
+
print(summary)
|
147 |
+
```
|
148 |
+
|
149 |
+
```
|
150 |
+
Google is rumoured to be about to unveil its next-generation Pixel smartphone,
|
151 |
+
the Google Pixel 9,which is expected to come with a telephoto lens and an artificial intelligence (AI)
|
152 |
+
system to improve its camera capabilities, as well as improve the quality of its images.
|
153 |
+
```
|
154 |
+
|
155 |
+
### Training Parameters
|
156 |
+
```python
|
157 |
+
num_train_epochs=1,
|
158 |
+
warmup_steps = 500,
|
159 |
+
per_device_train_batch_size=4,
|
160 |
+
per_device_eval_batch_size=4,
|
161 |
+
weight_decay = 0.01,
|
162 |
+
gradient_accumulation_steps=16
|
163 |
+
```
|
164 |
+
|