Instructions to use wallfacers/weft-lineage-extractor-jvm-1.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wallfacers/weft-lineage-extractor-jvm-1.5b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="wallfacers/weft-lineage-extractor-jvm-1.5b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("wallfacers/weft-lineage-extractor-jvm-1.5b") model = AutoModelForCausalLM.from_pretrained("wallfacers/weft-lineage-extractor-jvm-1.5b") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use wallfacers/weft-lineage-extractor-jvm-1.5b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "wallfacers/weft-lineage-extractor-jvm-1.5b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wallfacers/weft-lineage-extractor-jvm-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/wallfacers/weft-lineage-extractor-jvm-1.5b
- SGLang
How to use wallfacers/weft-lineage-extractor-jvm-1.5b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "wallfacers/weft-lineage-extractor-jvm-1.5b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wallfacers/weft-lineage-extractor-jvm-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "wallfacers/weft-lineage-extractor-jvm-1.5b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wallfacers/weft-lineage-extractor-jvm-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use wallfacers/weft-lineage-extractor-jvm-1.5b with Docker Model Runner:
docker model run hf.co/wallfacers/weft-lineage-extractor-jvm-1.5b
weft-lineage-extractor-jvm-1.5b — cross-language reproduction of a NEGATIVE RESULT
⚠️ RESEARCH ARTIFACT — the Scala/Java (JVM) point of a synthetic-only training study. Not a production tool.
✅ Resolved by real data: use weft-lineage-extractor-3b (real corpus, real precision 0.64). Full study: weft-lineage-extractor-1.5b.
The JVM (Scala/Java) point of a study showing that synthetic-only training induces a verbatim memorization leak in small ETL table-lineage models — and that the failure reproduces, worse, across languages. Synthetic held-out looks near-perfect (~0.99); on real Scala/Java ETL it drops to precision 0.165, with 40.8% of hallucinations being table names recited verbatim from the synthetic training pool — the highest leak of all scale/language points, because real JVM code is the most out-of-distribution.
Same recipe as the 1.5B main model
(LoRA on Qwen2.5-Coder-1.5B), extended with synthetic Scala/Java forms; task_type: SCALA | JAVA.
This point's numbers (table-level, Convention A)
| metric | synthetic held-out | real Scala/Java ETL (n=141, non-empty 28) |
|---|---|---|
| precision | ~0.99 | 0.165 |
| direction accuracy | — | 0.418 |
| verbatim memorization leak | — | 40.8% |
The leak metric is gold-independent and stable to full-file re-adjudication (verbatim
40.4% → 40.8%). Given a real SqlDao.java it cannot parse, the model emits training-pool names
like dws.dws_member_point_df — memorized generator vocabulary, not a label artifact.
Where it fits (scale / cross-language curve)
| point | real precision | real direction | verbatim leak |
|---|---|---|---|
| 0.5B (Py/Sh) | 0.243 | 0.369 | 37.4% |
| 1.5B (Py/Sh) | 0.270 | 0.496 | 22.4% |
| 3B (Py/Sh, synthetic) | 0.325 | 0.468 | 10.9% |
| 1.5B + JVM (this, real JVM) | 0.165 | 0.418 | 40.8% |
| 3B (real corpus) | 0.64 | — | ~0 |
"Add another language" does not fix the real-world gap; real training data does.
Intended use
- ✅ Reproducing / studying the cross-language reproduction of the memorization-leak failure.
- ❌ Not for production lineage — use the real-corpus 3B.
Usage, prompt format, training details, citation
Identical to the main model (this variant adds task_type: SCALA | JAVA and JVM system-prompt wording):
weft-lineage-extractor-1.5b.
- Dataset & reports: wallfacers/weft-script-lineage-synth
- Base model: Qwen/Qwen2.5-Coder-1.5B-Instruct
- Platform: Weft (data-weave)
- Downloads last month
- 169
Model tree for wallfacers/weft-lineage-extractor-jvm-1.5b
Base model
Qwen/Qwen2.5-1.5BDataset used to train wallfacers/weft-lineage-extractor-jvm-1.5b
Evaluation results
- Table precision (real JVM, out-of-distribution) on real Scala/Java ETL (human gold, n=141)self-reported0.165
- Read/write direction accuracy (real JVM) on real Scala/Java ETL (human gold, n=141)self-reported0.418