Update README.md

README.md

@@ -33,7 +33,7 @@ According to the leaderboard description, here are the benchmarks used for the e
 - [TruthfulQA](https://arxiv.org/abs/2109.07958) (0-shot) - a test to measure a model’s propensity to reproduce falsehoods commonly found online.
 
 ## Leaderboard Highlights (as of August 17, 2023)
-- Godzilla 2 70B ranks 4th, worldwide, in the Open LLM Leaderboard.
+- Godzilla 2 70B ranks 4th worldwide in the Open LLM Leaderboard.
 - Godzilla 2 70B ranks #3 in the ARC challenge.
 - Godzilla 2 70B ranks #5 in the TruthfulQA benchmark.
 - *Godzilla 2 70B beats GPT-3.5 (ChatGPT) in terms of average performance and the HellaSwag benchmark (87.53 > 85.5).
@@ -86,6 +86,12 @@ python main.py --model hf-causal-experimental --model_args pretrained=MayaPH/God
 ### Response:
 ```
 
+## Technical Considerations
+
+When using GodziLLa 2 70B, kindly take note of the following:
+- The default precision is `fp32`, and the total file size that would be loaded onto the RAM/VRAM is around 275 GB. Consider using a lower precision (fp16, int8, int4) to save memory.
+- To further save on memory, set the `low_cpu_mem_usage` argument to True.
+
 ## Ethical Considerations
 When using GodziLLa 2 70B, it is important to consider the following ethical considerations: