Inference widget unavailable
The inference widget is explicitly disabled on this model.
I'm curious to know why?
132 billion reason! you should use the demo: https://huggingface.co/spaces/databricks/dbrx-instruct
(hit shift+enter too soon) - usually large models fail to be loaded in HF inference, so it's just ugly to see red alert saying it cannot load the model (like it's something wrong with the model) - so we all disable it if the model is above 1b or so.
https://huggingface.co/spaces/databricks/dbrx-instruct
I cannot access this demo. I cannot input anything into this model. Does this because heavy usage? Thanks.
I suspect it's under really heavy load here on launch day. I think some people are hitting it with a lot of requests for evals. It does work, but I also find it really slow right now
The space should be back up and running and now! Closing this thread