add inference notes

README.md

@@ -1,25 +1,15 @@
 ---
-extra_gated_heading: Access Llama 2 on Hugging Face
-extra_gated_description: >-
-  This is a form to enable access to Llama 2 on Hugging Face after you have been
-  granted access from Meta. Please visit the [Meta website](https://ai.meta.com/resources/models-and-libraries/llama-downloads) and accept our
-  license terms and acceptable use policy before submitting this form. Requests
-  will be processed in 1-2 days.
-extra_gated_prompt: "**Your Hugging Face account email address MUST match the email you provide on the Meta website, or your request will not be approved.**"
-extra_gated_button_content: Submit
-extra_gated_fields:
-  I agree to share my name, email address and username with Meta and confirm that I have already been granted download access on the Meta website: checkbox
 language:
 - en
 pipeline_tag: text-generation
 inference: false
-arxiv: 2307.09288
 tags:
 - facebook
 - meta
 - pytorch
 - llama
 - llama-2
+- sharded
 ---
 # **llama-2-chat-7b-hf (sharded)**
 This is a sharded version of Meta's Llama 2 chat 7b model, specifically the hugging face version.
@@ -30,6 +20,12 @@ Colab notebook for sharding: https://colab.research.google.com/drive/1f1q9qc56wz
 
 Colab notebook for inference: https://colab.research.google.com/drive/1zxwaTSvd6PSHbtyaoa7tfedAS31j_N6m
 
+## Inference with Google Colab and HuggingFace 🤗
+
+Get started by saving your own copy of this [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing).
+
+You will be able to run inference using a free Colab notebook if you select a gpu runtime. See the notebook for more details.
+
 ~
 
 # **Llama 2**