Initial

README.md

@@ -16,32 +16,33 @@ pipeline_tag: text-generation
 
 
 ## Model Details
-
-### Model Description
-
-<!-- Shivneri Marathi LLM is being built with the wish to bring the benefits of Generative AI to non-English (especially Marathi) speaking population of India.
+Shivneri Marathi LLM is being built with the wish to bring the benefits of Generative AI to non-English (especially Marathi) speaking population of India.
 Marathi has the third largest number of native speakers in India, after Hindi and Bengali. 
 Almost 83 million people speak the language. 
 This is a  preliminary version of our Marathi LLM (Large Language Model)!
-Built on the mighty Gemma 7B base model, Shivneri LLM can generate creative and informative text in both Marathi and English.  This is just the beginning – we're constantly improving Shivneri, and even more exciting features are on the horizon! -->
+Built on the mighty Gemma 7B base model, Shivneri LLM can generate creative and informative text in both Marathi and English.  This is just the beginning – we're constantly improving Shivneri, and even more exciting features are on the horizon!
+
+### Model Description
+
+<!--  -->
 
 This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
 - **Developed by:** Amit Ghadge
 - **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
+- **Shared by [optional]:** [Amit Ghadge]
+- **Model type:** [ Decoder-only large language model (LLM) with a transformer architecture]
+- **Language(s) (NLP):** [Marathi, English]
 - **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
+- **Finetuned from model [optional]:** [Gemma-7B]
 
 ### Model Sources [optional]
 
 <!-- Provide the basic links for the model. -->
 
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
+- **Repository:** [https://github.com/amitagh/shivneri-llm]
+- **Paper [optional]:** [https://medium.com/@amitagh/shivneri-marathi-llm-e823f0a045d8]
+- **Demo [optional]:** [Coming soon]
 
 ## Uses
 
@@ -89,11 +90,12 @@ Use the code below to get started with the model.
 
 <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
 
-[More Information Needed]
+[Continually Pretrained with Lora on AI4Bharat/Sangraha dataset]
 
 ### Training Procedure
 
 <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+Continually Pretrained with Lora
 
 #### Preprocessing [optional]
 
@@ -164,11 +166,11 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 
 ### Model Architecture and Objective
 
-[More Information Needed]
+[ Decoder-only large language model (LLM) with a transformer architecture]
 
 ### Compute Infrastructure
 
-[More Information Needed]
+[A100 80 GB]
 
 #### Hardware