Instructions to use deepseek-ai/DeepSeek-V4-Pro-DSpark with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use deepseek-ai/DeepSeek-V4-Pro-DSpark with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="deepseek-ai/DeepSeek-V4-Pro-DSpark")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-DSpark")
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-DSpark", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use deepseek-ai/DeepSeek-V4-Pro-DSpark with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "deepseek-ai/DeepSeek-V4-Pro-DSpark"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-DSpark",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/deepseek-ai/DeepSeek-V4-Pro-DSpark

SGLang

How to use deepseek-ai/DeepSeek-V4-Pro-DSpark with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "deepseek-ai/DeepSeek-V4-Pro-DSpark" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-DSpark",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "deepseek-ai/DeepSeek-V4-Pro-DSpark" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-DSpark",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use deepseek-ai/DeepSeek-V4-Pro-DSpark with Docker Model Runner:
```
docker model run hf.co/deepseek-ai/DeepSeek-V4-Pro-DSpark
```

GeeeekExplorer commited on Jun 27

Commit

854ed2d

verified ·

1 Parent(s): a432277

Add files using upload-large-folder tool

Browse files

Files changed (18) hide show

.gitattributes +1 -0
model-00051-of-00066.safetensors +3 -0
model-00052-of-00066.safetensors +3 -0
model-00053-of-00066.safetensors +3 -0
model-00054-of-00066.safetensors +3 -0
model-00055-of-00066.safetensors +3 -0
model-00056-of-00066.safetensors +3 -0
model-00057-of-00066.safetensors +3 -0
model-00058-of-00066.safetensors +3 -0
model-00059-of-00066.safetensors +3 -0
model-00060-of-00066.safetensors +3 -0
model-00061-of-00066.safetensors +3 -0
model-00062-of-00066.safetensors +3 -0
model-00063-of-00066.safetensors +3 -0
model-00064-of-00066.safetensors +3 -0
model-00065-of-00066.safetensors +3 -0
model-00066-of-00066.safetensors +3 -0
model.safetensors.index.json +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text

model-00051-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:331d76311858a76c04e0b00a2a40ea1815ac1f703658c0e3ac3c49f2cc45f5fc
+size 13868524408

model-00052-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:221605d572092efc5a810042cc7b469936cae41189eb404bf2c67e49a9b48368
+size 13903805136

model-00053-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed041483ddac9a6951ec6ae6aec5fd073eeae90785b13d2b3aa9c25ea09020a2
+size 13868524408

model-00054-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4727490e4ba4bc13faccac2cb8a30a6867faf0ef84a6d81ddb0331eb4794c14
+size 13903805136

model-00055-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1163fd8d85f1794db2fd11d4589daa145a9a000401e58246ddfe5eda2150f5df
+size 13868524408

model-00056-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f014f918a285fc9f3e06b6852975d043a0583724a216f6a63b9a8b1f4dcdc82
+size 13903805136

model-00057-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20903117023029611e0b8e04b99f06fd5d1b0e99ae3b75463ee83a6783227a50
+size 13868524408

model-00058-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1af343b71b8656eef4afaa626dcf973db310d1642a446baf1aabb7b477dd23dd
+size 13903805136

model-00059-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6a684a4cffab28bed937d950cdb7a986c06b0b94bbe1687f8bf379d899425bbc
+size 13868524408

model-00060-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9d24a5c6f914042c23fa06392bd0dab3f2480d2b2019a9e518b48ad29a7d15e
+size 13903805136

model-00061-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0a1a0e2df76e45b51e9ef2bfd42965351628e77d3e3d697feccc8a6e61d6e1dd
+size 13868524408

model-00062-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0847b4247fb03c6b43cf479af4cf1ccb756b3a68c6d22e7b03162ccc43653064
+size 13903805136

model-00063-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0dfab2c9dca3e8503d1449cf4fe58313bf99addd069e3cfff30b89c762b0fe0f
+size 1853831588

model-00064-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e22da1363bf36c9e8d5500d1df3290917bedf461c0a5c2d33845b47507048d04
+size 14007736096

model-00065-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3147e18fa407746b5d883a334a7dfd6e39732d68ebc2a422a23ea1acad33cdc9
+size 13853571360

model-00066-of-00066.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b2e569fb2e683887396fe91f3dbc72a454e5baa5895152551d1690e355d5aca
+size 14118826460

model.safetensors.index.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2de2ac1e43134f8b03bf6156067715b7c3c73b1a507329e606023c601a56d30a
+size 11651606