mrutyunjay-patil
commited on
Commit
•
777bda3
1
Parent(s):
1e0a0dd
Delete README.md
Browse files
README.md
DELETED
@@ -1,48 +0,0 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
language:
|
4 |
-
- en
|
5 |
-
library_name: transformers
|
6 |
-
pipeline_tag: text2text-generation
|
7 |
-
tags:
|
8 |
-
- keyword-generation
|
9 |
-
- t5
|
10 |
-
- english
|
11 |
-
- code
|
12 |
-
---
|
13 |
-
|
14 |
-
## KeywordGen-v1 Model
|
15 |
-
|
16 |
-
KeywordGen-v1 is a T5-based model fine-tuned for keyword generation from a piece of text. Given an input text, the model will return relevant keywords.
|
17 |
-
|
18 |
-
### Model details
|
19 |
-
|
20 |
-
This model was trained using the T5 base model, and was fine-tuned on a custom dataset. The training data consists of text and corresponding keywords. The model generates keywords by predicting the relevant words or phrases present in the input text.
|
21 |
-
|
22 |
-
### How to use
|
23 |
-
|
24 |
-
You can use this model in your application using the Hugging Face Transformers library. Here is an example:
|
25 |
-
|
26 |
-
```python
|
27 |
-
from transformers import T5TokenizerFast, T5ForConditionalGeneration
|
28 |
-
|
29 |
-
# Load the tokenizer and model
|
30 |
-
tokenizer = T5TokenizerFast.from_pretrained('mrutyunjay-patil/keywordGen-v1')
|
31 |
-
model = T5ForConditionalGeneration.from_pretrained('mrutyunjay-patil/keywordGen-v1')
|
32 |
-
|
33 |
-
# Define the input text
|
34 |
-
input_text = "I love going to the park."
|
35 |
-
|
36 |
-
# Encode the input text
|
37 |
-
input_ids = tokenizer.encode(input_text, return_tensors='pt')
|
38 |
-
|
39 |
-
# Generate the keywords
|
40 |
-
outputs = model.generate(input_ids)
|
41 |
-
|
42 |
-
# Decode the outputs
|
43 |
-
keywords = tokenizer.decode(outputs[0])
|
44 |
-
```
|
45 |
-
|
46 |
-
### Limitations and bias
|
47 |
-
|
48 |
-
The model might perform poorly on texts that are very different from the texts in the training data. It might also be biased towards the types of text or keywords that are overrepresented in the training data.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|