Original model is here. This model created by WAI0731.
Notice
This is an experimental conversion in Spaces using a homebrew script. serverless Inference API does not currently support torch float8_e4m3fn, so it does not work. I have not been able to confirm if the conversion is working properly. Please consider this as a test run only.
- Downloads last month
- 69
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.