Instructions to use halflucifer/et2-experimental with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use halflucifer/et2-experimental with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="halflucifer/et2-experimental", filename="stories110M-bf16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use halflucifer/et2-experimental with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf halflucifer/et2-experimental:BF16 # Run inference directly in the terminal: llama-cli -hf halflucifer/et2-experimental:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf halflucifer/et2-experimental:BF16 # Run inference directly in the terminal: llama-cli -hf halflucifer/et2-experimental:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf halflucifer/et2-experimental:BF16 # Run inference directly in the terminal: ./llama-cli -hf halflucifer/et2-experimental:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf halflucifer/et2-experimental:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf halflucifer/et2-experimental:BF16
Use Docker
docker model run hf.co/halflucifer/et2-experimental:BF16
- LM Studio
- Jan
- Ollama
How to use halflucifer/et2-experimental with Ollama:
ollama run hf.co/halflucifer/et2-experimental:BF16
- Unsloth Studio
How to use halflucifer/et2-experimental with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for halflucifer/et2-experimental to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for halflucifer/et2-experimental to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for halflucifer/et2-experimental to start chatting
- Atomic Chat new
- Docker Model Runner
How to use halflucifer/et2-experimental with Docker Model Runner:
docker model run hf.co/halflucifer/et2-experimental:BF16
- Lemonade
How to use halflucifer/et2-experimental with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull halflucifer/et2-experimental:BF16
Run and chat with the model
lemonade run user.et2-experimental-BF16
List all available models
lemonade list
License incompatibility
Hi,I'd like to report a conflict license in halflucifer/et2-experimental. I noticed that this model was quantized from meta-llama/Llama-2-7b-chat-hf, but it's currently published under the mit license. There’s a potential conflict here, as the LLaMA 2 Community License includes restrictions on redistribution, sublicensing, and acceptable use, which are not enforced by the MIT License. This can create confusion for downstream users about what they are allowed to do with the model.
⚠️ Key incompatibilities with LLaMA 2 Community License:
Clause 1.b.i – Redistribution and Use:
• No license file included (should contain the LLaMA 2 Community License)
Clause 1.b.iii – Required Notice:
• Missing the following required text in a "NOTICE" file:
“Llama 2 is licensed under the LLAMA 2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.”
Clause 1.iv – Acceptable Use Policy:
• Meta’s Acceptable Use Policy is not mentioned or passed along to users
Clause 2 – Sublicensing and Relicensing:
• LLaMA 2 license does not allow sublicensing under a more permissive license such as MIT
• The MIT License permits nearly unrestricted commercial use, which contradicts Meta’s limits and conditions (e.g. commercial MAU threshold)
The MIT License allows:
• Unrestricted commercial use
• Sublicensing under more permissive terms
• No obligation to preserve upstream restrictions
But the LLaMA 2 Community License explicitly prohibits relicensing, includes enforceable use restrictions (e.g., no surveillance, no discrimination, no legal decision-making), and requires strict downstream compliance — meaning it cannot be replaced or overridden by MIT.
🔹 Suggestion:
To resolve the mismatch, here are a few steps that might help bring things into alignment:
1. To make sure everything aligns with the LLaMA 2 terms, you might want to tweak the licensing setup a bit, like:
• Maybe include a copy of the LLaMA 2 Community License in the repo or model card
• Include this notice in a “NOTICE” file or the docs:
> “Llama 2 is licensed under the LLAMA 2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.”
• Maybe a quick note about usage restrictions, especially for folks using it in commercial settings
• A statement clarifying that use of the model must comply with Meta’s Acceptable Use Policy
2. Maybe we can just drop the mit tag and going with the LLaMA 2 Community License. This approach may help reduce potential confusion about redistribution rights and downstream usage conditions.
Hope this helps! 😊 Let me know if you have any questions or need more info.
Thanks for your attention!
Hi @xixi126
thank you for the detailed heads-up! 🙏
You’re absolutely right: the model tokenizer is a derivative of meta-llama/Llama-2-7b-chat-hf and must remain under the Llama 2 Community License.
I’ve just:
- Replace the MIT license with Llama2 license
- Added
LICENSE.txt(full Llama 2 License) - Added the required
NOTICEfile
Let me know if anything’s still missing – really appreciate the catch!