Wonder-Griffin/squadtrainTraXL

README.md

@@ -1,56 +1,52 @@
-
----
-library_name: sentence-transformers
-tags:
-- sentence-transformers
-- sentence-similarity
-- feature-extraction
-- autotrain
-base_model: Wonder-Griffin/TraXLMistral
-widget:
-- source_sentence: 'search_query: i love autotrain'
-  sentences:
-  - 'search_query: huggingface auto train'
-  - 'search_query: hugging face auto train'
-  - 'search_query: i love autotrain'
-pipeline_tag: sentence-similarity
-datasets:
-- rajpurkar/squad_v2
----
-
-# Model Trained Using AutoTrain
-
-- Problem type: Sentence Transformers
-
-## Validation Metrics
-No validation metrics available
-
-## Usage
-
-### Direct Usage (Sentence Transformers)
-
-First install the Sentence Transformers library:
-
-```bash
-pip install -U sentence-transformers
-```
-
-Then you can load this model and run inference.
-```python
-from sentence_transformers import SentenceTransformer
-
-# Download from the Hugging Face Hub
-model = SentenceTransformer("sentence_transformers_model_id")
-# Run inference
-sentences = [
-    'search_query: autotrain',
-    'search_query: auto train',
-    'search_query: i love autotrain',
-]
-embeddings = model.encode(sentences)
-print(embeddings.shape)
-
-# Get the similarity scores for the embeddings
-similarities = model.similarity(embeddings, embeddings)
-print(similarities.shape)
-```
+---
+library_name: transformers
+tags:
+- generated_from_trainer
+model-index:
+- name: squadtrainTraXL
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# squadtrainTraXL
+
+This model was trained from scratch on an unknown dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 3.598262103710215e-05
+- train_batch_size: 16
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 5
+- mixed_precision_training: Native AMP
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.44.2
+- Pytorch 2.4.0+cu124
+- Datasets 2.19.1
+- Tokenizers 0.19.1

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.44.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:65fe87469267e1cf4210417de7d55dbe8c441f562ea5c208daf433c30f7ac6b6
+oid sha256:9fea8d72f03302aa15c68cc4c6113fdae086fcbe8189996292bb207464c68b24
 size 34422704