Update README.md

README.md

@@ -99,7 +99,7 @@ https://huggingface.co/datasets/isaacchung/hotpotqa-dev-raft-subset
 
 #### Training Hyperparameters
 
-<!-- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision --> -->
+<!-- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
 
 Model loaded:
 ```python
@@ -160,11 +160,27 @@ trainer = SFTTrainer(
 )
 ```
 
-<!-- #### Speeds, Sizes, Times [optional] -->
+#### Speeds, Sizes, Times [optional]
 
 <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
 
-<!-- [More Information Needed] -->
+- train_runtime: 1148.4436
+- train_samples_per_second: 0.392
+- train_steps_per_second: 0.065
+- train_loss: 0.5639963404337565
+- epoch: 3.0
+
+#### Training Loss
+
+```
+{'loss': 1.0092, 'grad_norm': 0.27965569496154785, 'learning_rate': 0.0002, 'epoch': 0.4}                                   
+{'loss': 0.695, 'grad_norm': 0.17789314687252045, 'learning_rate': 0.0002, 'epoch': 0.8}
+{'loss': 0.6747, 'grad_norm': 0.13655725121498108, 'learning_rate': 0.0002, 'epoch': 1.2}                                   
+{'loss': 0.508, 'grad_norm': 0.14653471112251282, 'learning_rate': 0.0002, 'epoch': 1.6}                                    
+{'loss': 0.4961, 'grad_norm': 0.14873674511909485, 'learning_rate': 0.0002, 'epoch': 2.0}                                   
+{'loss': 0.3509, 'grad_norm': 0.1657964587211609, 'learning_rate': 0.0002, 'epoch': 2.4}                                    
+{'loss': 0.3321, 'grad_norm': 0.1634644716978073, 'learning_rate': 0.0002, 'epoch': 2.8} 
+```
 
 <!-- ## Evaluation -->
 
@@ -207,29 +223,29 @@ trainer = SFTTrainer(
 <!-- ## Environmental Impact -->
 
 <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-<!-- 
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+<!-- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
 
 - **Hardware Type:** [More Information Needed]
 - **Hours used:** [More Information Needed]
 - **Cloud Provider:** [More Information Needed]
 - **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed] -->
 
 ## Technical Specifications [optional]
 
-### Model Architecture and Objective
+<!-- ### Model Architecture and Objective -->
 
-[More Information Needed]
+<!-- [More Information Needed] -->
 
 ### Compute Infrastructure
 
-[More Information Needed]
+<!-- [More Information Needed] -->
 
 #### Hardware
 
-[More Information Needed]
- -->
+- 1x NVIDIA RTX 6000 Ada
+
 <!-- #### Software
 
 [More Information Needed]