Update README.md

README.md

@@ -8,57 +8,56 @@ license: apache-2.0
 
 # Model Card for Ostrich
 
+**Finetuned from model:** [Llama3-70B](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct)
 
-- **Trained with Nostr notes**
-- **Aligned a bit in these domains:**
-- Bitcoin
+## Fine Tuned With
+
+**Trained with Nostr notes**: Knowledge and ideas about bitcoin and also Nostr itself. You can read more about the effects of Nostr training here:
+https://habla.news/a/naddr1qvzqqqr4gupzp8lvwt2hnw42wu40nec7vw949ys4wgdvums0svs8yhktl8mhlpd3qqxnzde3xumrswfjx56rjwf4kkqhsx
+
+**Aligned a bit in these domains:**
 - Health
 - Permaculture
 - Phytochemicals
 - Alternative medicine
 - Herbs
 - Nutrition
-- Faith
-
-You can read more about it here:
-https://habla.news/a/naddr1qvzqqqr4gupzp8lvwt2hnw42wu40nec7vw949ys4wgdvums0svs8yhktl8mhlpd3qqxnzde3xumrswfjx56rjwf4kkqhsx
-
-
 
-## Model Details
+More to come around these topics.
 
-
-- **Finetuned from model:** https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
-
-The number in the filenames like 7314 means the version. 
+Fine tuned a bit in faith related topics.
 
 
 ## Uses
 
-Likes to disagree more compared to Llama3. It can be used for refutation, counter argument production.
+Compared to other models this may know more about Nostr and Bitcoin. It is aligned with opinions of people on Nostr. It may have alternative ideas to mainstream because Nostr is very censorship resistant. 
 
-Ask any question, compared to other models this may know more about Nostr and Bitcoin.
-
-You can use llama.cpp to chat with it. You can also use llama-cpp-python package to use it in a Python script.
+You can use llama.cpp to use the GGUF file.
 
 Use repeat penalty of 1.05 or more to avoid repetitions.
 
+I am using the model here as a ground truth for Nostr related questions: https://wikifreedia.xyz/based-llm-leaderboard/npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9c
+
 
 ## Warning
 
 Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.
 The trainer, developer or uploader of this model does not assume any liability. Use it at your own risk.
 
-
 ## Training Details
 
 ### Training Data
 
-Nostr related info from web and nostr itself, bitcoin related info. Info on health domain.
+Nostr related info from web and nostr itself, bitcoin related info.
 Information that aligns well with humanity is preferred.
+About 80% comes from Nostr notes. The rest is my own curation.
 
 ### Training Procedure
 
-LLaMa-Factory is used to train on 2x3090! fsdp_qlora is the technique. 
+LLaMa-Factory is used to train on 2* RTX 3090! fsdp_qlora is the technique. 
 
 The Nostr training took ~200 hours.
+
+After training it for a while with notes, I used it to analyze and decide what notes to take in further for training. 
+
+The number in the filenames (like 9230) means the version. I take the training steps and add those to the version. There has been more than 9k training steps.