fierysurf
/

Llama-Guard-3-1B-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

fierysurf commited on 10 days ago

Commit

051f4c9

•

1 Parent(s): 417642d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -217,7 +217,7 @@ extra_gated_description: >-
   Policy](https://www.facebook.com/privacy/policy/).
 extra_gated_button_content: Submit
 ---
-(Note: This is a INT4 executorch exported model. To learn more about how to run this model on edge devices checkout the following resource [here](https://github.com/meta-llama/PurpleLlama/blob/main/Llama-Guard3/1B/ET_INSTRUCTIONS.md))
 ## Model Information
 Llama Guard 3-1B is a fine-tuned Llama-3.2-1B pretrained model for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts as an LLM – it generates text in its output that indicates whether a given prompt or response is safe or unsafe, and if unsafe, it also lists the content categories violated.

   Policy](https://www.facebook.com/privacy/policy/).
 extra_gated_button_content: Submit
 ---
+(Note: This is an AWQ 4-bit exported model. To learn more about how to run this model on edge devices checkout the following resource [here](https://github.com/casper-hansen/AutoAWQ/blob/main/docs/examples.md))
 ## Model Information
 Llama Guard 3-1B is a fine-tuned Llama-3.2-1B pretrained model for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts as an LLM – it generates text in its output that indicates whether a given prompt or response is safe or unsafe, and if unsafe, it also lists the content categories violated.