Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
microsoft
/
MInference
like
56
Running
on
Zero
App
Files
Files
Community
3
27e09a4
MInference
/
minference
/
modules
1 contributor
History:
2 commits
iofu728
Feature(MInference): update the pycuda
24083d5
2 months ago
inf_llm.py
44.7 kB
Feature(MInference): build demo
2 months ago
minference_forward.py
40.7 kB
Feature(MInference): update the pycuda
2 months ago
snap_kv.py
16.6 kB
Feature(MInference): build demo
2 months ago