Instructions to use Kwai-AutoSQL/Kwai-AutoSQL-14B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Kwai-AutoSQL/Kwai-AutoSQL-14B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Kwai-AutoSQL/Kwai-AutoSQL-14B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Kwai-AutoSQL/Kwai-AutoSQL-14B") model = AutoModelForCausalLM.from_pretrained("Kwai-AutoSQL/Kwai-AutoSQL-14B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Kwai-AutoSQL/Kwai-AutoSQL-14B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Kwai-AutoSQL/Kwai-AutoSQL-14B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Kwai-AutoSQL/Kwai-AutoSQL-14B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Kwai-AutoSQL/Kwai-AutoSQL-14B
- SGLang
How to use Kwai-AutoSQL/Kwai-AutoSQL-14B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Kwai-AutoSQL/Kwai-AutoSQL-14B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Kwai-AutoSQL/Kwai-AutoSQL-14B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Kwai-AutoSQL/Kwai-AutoSQL-14B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Kwai-AutoSQL/Kwai-AutoSQL-14B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Kwai-AutoSQL/Kwai-AutoSQL-14B with Docker Model Runner:
docker model run hf.co/Kwai-AutoSQL/Kwai-AutoSQL-14B
File size: 3,891 Bytes
8e43fa3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 | # Generated at 2026-06-17T11:49:05+08:00
# Model name
NAME huggingface
# Model architecture (Generated from transformers_version in config.json)
ARCH transformer
# Model family (Generated from model_type in config.json)
FAMILY qwen3
# Config files (Generated from the files in the workspace directory)
# Supported file types: *.json, *.jsonl, *.json5, *.jsonc, *.yaml, *.yml, *.toml, *.ini, *.config, *.cfg, *.conf, *.properties, *.props, *.prop, *.xml, *.xsd, *.rng, *.modelcard, *.meta, *tokenizer.model*, config.json.*, *.hparams, *.params, *.hyperparams, *.wandb, *.mlflow, *.tensorboard
CONFIG added_tokens.json
CONFIG config.json
CONFIG generation_config.json
CONFIG model.safetensors.index.json
CONFIG special_tokens_map.json
CONFIG tokenizer.json
CONFIG tokenizer_config.json
CONFIG vocab.json
# Code files (Generated from the files in the workspace directory)
# Supported file types: *.py, *.ipynb, *.sh, *.patch, *.c, *.h, *.hxx, *.cpp, *.cc, *.cxx, *.c++, *.hpp, *.hh, *.h++, *.java, *.js, *.mjs, *.cjs, *.jsx, *.ts, *.tsx, *.go, *.rs, *.swift, *.rb, *.php, *.scala, *.kt, *.kts, *.r, *.R, *.m, *.mm, *.f, *.f90, *.f95, *.f03, *.f08, *.jl, *.lua, *.pl, *.pm, *.cs, *.vb, *.dart, *.groovy, *.elm, *.erl, *.hrl, *.ex, *.exs, *.hs, *.lhs, *.clj, *.cljs, *.cljc, *.cl, *.lisp, *.lsp, *.scm, *.ss, *.rkt, *.sql, *.psql, *.mysql, *.sqlite, *.zig, *.cu, *.cuh, *.bash, *.zsh, *.fish, *.csh, *.tcsh, *.ksh, *.ps1, *.psm1, *.psd1, *.bat, *.cmd, *.vbs, *.wsf, *.applescript, *.scpt, *.awk, *.sed, *.expect, *.env, *.env.*, .env*, Makefile*, *.dockerfile, Dockerfile*, *.mk, *.cmake, CMakeLists.txt, *.gradle, *.gradle.kts, build.gradle*, settings.gradle*, *.sbt, *.mill, *.bazel, *.bzl, BUILD*, WORKSPACE*, *.buck, BUCK*, *.ninja, *.gyp, *.gypi, *.waf, wscript*, package.json, package-lock.json, yarn.lock, pnpm-lock.yaml, requirements*.txt, Pipfile*, pyproject.toml, setup.cfg, tox.ini, poetry.lock, Cargo.toml, Cargo.lock, go.mod, go.sum, composer.json, composer.lock, Gemfile*, *.gemspec, mix.exs, mix.lock, rebar.config, rebar.lock, *.so, *.dll, *.dylib, *.lib, *.a
CODE chat_template.jinja
# Model files (Generated from the files in the workspace directory)
# Supported file types: *.safetensors, *.bin, *.pt, *.pth, *.mar, *.pte, *.pt2, *.ptl, *.tflite, *.h5, *.hdf, *.hdf5, *.pb, *.meta, *.data-*, *.index, *.gguf, *.ggml, *.ggmf, *.ggjt, *.q4_0, *.q4_1, *.q5_0, *.q5_1, *.q8_0, *.f16, *.f32, *.ckpt, *.checkpoint, *.dist_ckpt, *.tensor, *.weights, *.state, *.embedding, *.vocab, *.ot, *.engine, *.trt, *.onnx, *.msgpack, *.model, *.pkl, *.pickle, *.keras, *.joblib, *.npy, *.npz, *.nc, *.mlmodel, *.coreml, *.mleap, *.surml, *.llamafile, *.caffemodel, *.prototxt, *.dlc, *.circle, *.nb
MODEL model-00001-of-00007.safetensors
MODEL model-00002-of-00007.safetensors
MODEL model-00003-of-00007.safetensors
MODEL model-00004-of-00007.safetensors
MODEL model-00005-of-00007.safetensors
MODEL model-00006-of-00007.safetensors
MODEL model-00007-of-00007.safetensors
# Documentation files (Generated from the files in the workspace directory)
# Supported file types: *.txt, *.md, *.pdf, LICENSE*, README*, SETUP*, *requirements*, *.log, *.doc, *.docx, *.docm, *.dot, *.dotx, *.dotm, *.rtf, *.odt, *.ott, *.fodt, *.pages, *.wpd, *.xls, *.xlsx, *.xlsm, *.xlsb, *.xlt, *.xltx, *.xltm, *.ods, *.ots, *.fods, *.numbers, *.csv, *.ppt, *.pptx, *.pptm, *.pps, *.ppsx, *.ppsm, *.pot, *.potx, *.potm, *.odp, *.otp, *.fodp, *.key, *.epub, *.mobi, *.azw, *.azw3, *.fb2, *.fb3, *.lit, *.pdb, *.djvu, *.djv, *.html, *.htm, *.xhtml, *.mhtml, *.mht, *.xml, *.xsl, *.xslt, *.tex, *.latex, *.ltx, *.bib, *.rst, *.asciidoc, *.adoc, *.textile, *.wiki, *.mediawiki, *.org, *.texi, *.texinfo, *.info, *.man, *.chm, *.hlp, *.xps, *.jpg, *.jpeg, *.png, *.gif, *.bmp, *.tiff, *.ico, *.webp, *.heic, *.heif, *.hevc, *.svg, *.mp4, *.mov, *.avi, *.mkv, *.webm, *.m4v, *.flv, *.wmv, *.mpg, *.mpeg
DOC merges.txt
|