File size: 3,831 Bytes
e50b7bd
 
dc11efe
 
 
 
 
 
 
 
 
5cc57b1
a777f29
6c34185
 
 
 
 
 
 
 
 
 
 
3b57212
 
6c34185
 
f592f82
 
 
 
 
 
 
 
 
 
 
4d908a3
f592f82
12d6d6a
 
 
 
 
0ef54b4
 
 
 
dc11efe
0ef54b4
 
 
31a8954
 
0ef54b4
 
 
 
 
 
 
2281d27
 
 
 
0ef54b4
 
 
 
 
0777942
 
 
6515c20
 
 
 
7105d90
 
 
 
 
 
0ef54b4
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
---
license: mit
pipeline_tag: summarization
widget:
- text: >-
    Now, there is no doubt that one of the most important aspects of any Pixel
    phone is its camera. And there might be good news for all camera lovers.
    Rumours have suggested that the Pixel 9 could come with a telephoto lens,
    improving its photography capabilities even further. Google will likely
    continue to focus on using AI to enhance its camera performance, in order to
    make sure that Pixel phones remain top contenders in the world of mobile
    photography.
- text: >-
    The Samastha Kerala Sunni Students Federation (SKSSF) has also expressed
    concern over holding the election on Friday. In a statement issued in
    Kozhikode on Saturday, SKSSF state secretariat asked the EC to postpone the
    election to another day. It said conducting elections on Friday will cause
    inconvenience to people from the Muslim community deputed on poll duty or as
    booth agents of political parties to participate in Friday juma prayers.
    Meanwhile, the Wisdom Islamic Organisation has asked the state government to
    officially demand the EC to hold the elections in Kerala and Tamil Nadu on
    some other day, citing inconvenience of believers. State president P N Abdul
    Latheef Madani said all secular forces should put pressure on the poll panel
    to change the date of elections.
datasets:
- EdinburghNLP/xsum
language:
- en
---

# BART Large CNN Text Summarization Model

This model is based on the Facebook BART (Bidirectional and Auto-Regressive Transformers) architecture, specifically the large variant fine-tuned for text summarization tasks. BART is a sequence-to-sequence model introduced by Facebook AI, capable of handling various natural language processing tasks, including summarization.

## Model Details:

- **Architecture**: BART Large CNN
- **Pre-trained model**: BART Large
- **Fine-tuned for**: Text Summarization
- **Fine-tuning dataset**: [xsum](https://huggingface.co/datasets/EdinburghNLP/xsum)

## Usage:

### Installation:

You can install the necessary libraries using pip:
```bash
pip install transformers
```
### Inferecnce
provided a simple snippet of how to use this model for the task of paragraph summarization in PyTorch.
```python
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("suriya7/bart-finetuned-text-summarization")
model = AutoModelForSeq2SeqLM.from_pretrained("suriya7/bart-finetuned-text-summarization")

def generate_summary(text):
    inputs = tokenizer([text], max_length=1024, return_tensors='pt', truncation=True)
    summary_ids = model.generate(inputs['input_ids'], max_new_tokens=100, do_sample=False)
    summary = tokenizer.decode(summary_ids[0], skip_special_tokens=True)
    return summary

text_to_summarize = """Now, there is no doubt that one of the most important aspects of any Pixel phone is its camera.
And there might be good news for all camera lovers. Rumours have suggested that the Pixel 9 could come with a telephoto lens,
improving its photography capabilities even further. Google will likely continue to focus on using AI to enhance its camera performance,
in order to make sure that Pixel phones remain top contenders in the world of mobile photography."""
summary = generate_summary(text_to_summarize)
print(summary)
```

```
Google is rumoured to be about to unveil its next-generation Pixel smartphone,
the Google Pixel 9,which is expected to come with a telephoto lens and an artificial intelligence (AI)
system to improve its camera capabilities, as well as improve the quality of its images.
```

### Training Parameters
```python
num_train_epochs=1,
warmup_steps = 500,
per_device_train_batch_size=4,
per_device_eval_batch_size=4,
weight_decay = 0.01,
gradient_accumulation_steps=16
```