Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
microsoft
/
MInference
like
56
Running
on
Zero
App
Files
Files
Community
3
main
MInference
/
minference
/
configs
1 contributor
History:
1 commit
iofu728
Feature(MInference): build demo
43a7079
2 months ago
Llama_3_8B_Instruct_262k_kv_out_v32_fit_o_best_pattern.json
50.1 kB
Feature(MInference): build demo
2 months ago
Phi_3_mini_128k_instruct_kv_out_v32_fit_o_best_pattern.json
61.2 kB
Feature(MInference): build demo
2 months ago
Yi_9B_200k_kv_out_v32_fit_o_best_pattern.json
75.3 kB
Feature(MInference): build demo
2 months ago
model2path.py
634 Bytes
Feature(MInference): build demo
2 months ago