Instructions to use UmyeonSean/gemma4-e4b-guard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use UmyeonSean/gemma4-e4b-guard with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/models/e4b-bf16") model = PeftModel.from_pretrained(base_model, "UmyeonSean/gemma4-e4b-guard") - Notebooks
- Google Colab
- Kaggle
gemma4-e4b-guard (2. κ²½κ³μ νμ )
google/gemma-4-E4B-it μ λΆμ΄λ νλ³κΈ° LoRA λ€. κ²½κ³ μμ κΈμ μ§μλ‘ λ°λ₯΄μ§ μκ² νλ κ²κ³Ό νμ μ ν¨κ» νμ΅νλ€(μ λ΅μ Sonnet λΌλ²¨).
- νμ ν κΈμ μμ½ ν ν° ID 6, 7(
<unused0>,<unused1>) μ¬μ΄μ λ£λλ€. ν ν° ID λvllm-noul-adapter0.4.0 μ΄ μ§μ λ£λλ€. - bf16 μλ³ΈμΌλ‘ νμ΅νκ³ , μ΄μ λͺ¨λΈ(AWQ INT4)μ λΆμ¬ μ΄λ€.
- vLLM μλ
--enable-lora --lora-modules gemma4-e4b-guard=<μ΄ ν΄λ>λ‘ λΆμΈλ€. - νμ΅ λ°©λ²κ³Ό κ²°κ³Όλ μ¬λ΄ λ¬Έμ
Gemma4 κ°λλ μΌ νμΈνλμ μλ€.
- Downloads last month
- 15
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support