Update README.md
Browse files
README.md
CHANGED
@@ -73,13 +73,13 @@ bnb_config = BitsAndBytesConfig(
|
|
73 |
bnb_4bit_compute_dtype=torch.bfloat16)
|
74 |
|
75 |
|
76 |
-
peft_model_id = "Kleo/
|
77 |
-
|
78 |
-
model = AutoModelForSequenceClassification.from_pretrained(
|
79 |
-
tokenizer = AutoTokenizer.from_pretrained(
|
80 |
|
81 |
# Load the Lora model
|
82 |
-
model = PeftModel.from_pretrained(model,
|
83 |
|
84 |
tokenizer.pad_token_id = tokenizer.eos_token_id
|
85 |
tokenizer.pad_token = tokenizer.eos_token
|
@@ -232,7 +232,10 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
232 |
|
233 |
- **Hardware Type:** Tesla P100
|
234 |
- **Hours used:** 21 hours
|
235 |
-
- **
|
|
|
|
|
|
|
236 |
- **Carbon Emitted:** 0.1
|
237 |
|
238 |
## Technical Specifications
|
@@ -244,13 +247,6 @@ library, meaning it outputs two class labels, out of which the matching score is
|
|
244 |
extracted. We consider as scores the probabilities of the class_1, meaning the
|
245 |
probability of a key point to match the argument.
|
246 |
|
247 |
-
### Compute Infrastructure
|
248 |
-
The model has been trained with the available [Kaggle](https://www.kaggle.com/) resources:
|
249 |
-
- Number of nodes: 1
|
250 |
-
- Number of GPUs per node: 1
|
251 |
-
- GPU type: Tesla P100
|
252 |
-
- GPU memory: 16GB
|
253 |
-
|
254 |
|
255 |
## Citation
|
256 |
|
|
|
73 |
bnb_4bit_compute_dtype=torch.bfloat16)
|
74 |
|
75 |
|
76 |
+
peft_model_id = "Kleo/meltemi_arg2kp_matcher"
|
77 |
+
peft_config = PeftConfig.from_pretrained(peft_model_id)
|
78 |
+
model = AutoModelForSequenceClassification.from_pretrained(peft_config.base_model_name_or_path, return_dict=True, quantization_config=bnb_config, device_map='auto')
|
79 |
+
tokenizer = AutoTokenizer.from_pretrained(peft_config.base_model_name_or_path)
|
80 |
|
81 |
# Load the Lora model
|
82 |
+
model = PeftModel.from_pretrained(model, peft_config)
|
83 |
|
84 |
tokenizer.pad_token_id = tokenizer.eos_token_id
|
85 |
tokenizer.pad_token = tokenizer.eos_token
|
|
|
232 |
|
233 |
- **Hardware Type:** Tesla P100
|
234 |
- **Hours used:** 21 hours
|
235 |
+
- **GPU memory**: 16GB
|
236 |
+
- **Number of nodes**: 1
|
237 |
+
- **Number of GPUs per node**: 1
|
238 |
+
- **Cloud Provider:** [Kaggle](https://www.kaggle.com/)
|
239 |
- **Carbon Emitted:** 0.1
|
240 |
|
241 |
## Technical Specifications
|
|
|
247 |
extracted. We consider as scores the probabilities of the class_1, meaning the
|
248 |
probability of a key point to match the argument.
|
249 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
250 |
|
251 |
## Citation
|
252 |
|