Update README.md

README.md

@@ -1,3 +1,64 @@
 ---
 license: apache-2.0
+pipeline_tag: text2text-generation
+tags:
+- llama
+- llm
 ---
+
+This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in [W&B dashboard](https://wandb.ai/chansung18/alpaca_lora/runs/pgvpsy2x?workspace=user-chansung18). I have used DGX workstation with 8 x A100(40G).
+
+```console
+python finetune.py \
+    --base_model='elinas/llama-7b-hf-transformers-4.29' \
+    --data_path='alpaca_data_gpt4.json' \
+    --num_epochs=10 \
+    --cutoff_len=1024 \
+    --group_by_length \
+    --output_dir='./lora-alpacagpt4-7b-elinas' \
+    --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' \
+    --lora_r=16 \
+    --lora_alpha=32 \
+    --batch_size=1024 \
+    --micro_batch_size=40
+```
+
+This LoRA checkpoint is recommended to be used with `transformers >= 4.29` which should be installed with the following command currently(4/30/2023).
+```console
+pip install git+https://github.com/huggingface/transformers.git
+```
+
+Please find out the example usage and results in the accompanied [notebook](https://huggingface.co/LLMs/AlpacaGPT4-LoRA-7B-elina/blob/main/alpacagpt4-lora-7b.ipynb). For the example outputs are listed below as well.
+
+**1. Instruction: Compose an engaging travel blog post about a recent trip to Hawaii, highlighting cultural experiences and must-see attractions.**
+
+Vacation time is here! The sound of the waves crashing on the shore fills your mind with anticipation for what’s in store when you touch down in paradise – Hawaii. It might be the beautiful sunsets, crystal clear water or even the local food that captivates visitors, but there's one thing everyone agrees upon; there are no words to describe just how breathtaking it truly is. Here I am going to give my top recommendations and share some insider tips so that your journey to Oahu can go as smoothly as possible.
+
+Before leaving home, make sure to pack lightweight breathable clothing such as t-shirts, shorts and comfortable shoes suitable for hiking or sightseeing. Don’t forget to bring along something warm like a jacket because at nighttime temperatures may drop considerably. You should also carry swimwear if you plan to spend much time by the beach.
+
+To fully enjoy all that the island has to offer, book yourself onto one of many walking tours. These excursions will take you around historical sites such as Iolani Palace (the former residence of King David Kalakaua
+
+**2. Instruction: Can you help me write a formal email to a potential business partner proposing a joint venture?**
+
+Dear Potential Business Partner,
+
+I am writing in regards to the possibility of exploring opportunities for collaboration between our companies. My name is [YOUR NAME] and I represent my company [NAME OF COMPANY], which specializes in [BUSINESS ACTIVITY]. We are looking forward to strengthening mutually beneficial partnerships with other industry leaders like your organization.
+
+My colleague has informed me that your company’s main focuses include [COMPETENCE TO BE PROPOSED]. This skillset aligns well with our capabilities, as we also offer [COMPLEMENTARY SERVICE OR SKILLSET THAT YOU WANT THEM TO SHARE IN THE JOINT VENTURE]. By combining both sets of expertise, I believe there would be immense synergy between us which can lead towards great success.
+
+Please let me know if this proposal holds any interest for you or if you have further questions regarding it. Thank you very much!
+
+**3. Instruction: What factors would you consider when designing an inclusive and accessible public transportation system?**
+
+Inclusion is important for all people, especially in terms of their access to public transport. There are several elements that can be considered when creating a more user-friendly transit service:
+
+1. Designed For Accessibility - All aspects related to the physical infrastructure should aim at making it easier for people with different abilities or disabilities such as wheelchairs users or vision impaired passengers, among others, to use them. This includes ensuring that the platforms, stations and vehicles have sufficient space and proper equipment (elevators, ramps etc.) to accommodate those who need it.
+2. Accessible Information – Clear communication channels like Braille signage, tactile maps, audio announcements, videos, information kiosks or even social media pages where commuters can ask questions are essential. They allow everyone to obtain accurate and timely updates about schedule changes, delays, interruptions or other relevant events affecting services without having to rely on a third party to convey this critical information accurately.
+3. Flexible Schedule & Routes – A flexible schedule allows riders to adapt their trips according to their needs and preferences by providing options to change routes or times during
+4. 
+**4. Instruction: What are some potential implications of using a single-use plastic bottle versus a reusable bottle on both the environment and human health?**
+
+Single-Use Plastics vs. Reusables
+The environmental impacts of using a single use plastic bottle as opposed to an eco friendly water bottles can be broken down into four main categories: landfill waste, ocean pollution, energy consumption during production, and potentially harmful chemicals used in their manufacture. By comparison with reusable options like glass or stainless steel bottles which are durable enough to last for years, there is also a financial advantage in terms of cost savings over time that comes from switching away from disposing of thousands of throwaway plastic bottles each year (often made only once before being discarded).
+
+Landfill Waste: Single-use plastic bottles have become synonymous with littered roadsides, parks, oceans and other areas where they take centuries to decompose and release harmful greenhouse gases throughout decomposition. Disposal of these items contributes to deforestation because paper bags must often be produced when recycling facilities cannot accept them. While certain types of plastic containers may be compostable after reuse or breakdown naturally, many of those available today do not biodegrade readily. The resultant