YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
LLM Probability Visualization
Setup
First, clone into it and install dependencies, Flask, Llama.cpp, flask_socketio, uuid, and PyTorch.
Then, in app.py add the models you want to use to the MODELS dictionary.
Finally, run the app with python app.py.
TODO: write a proper readme and clean up the project.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support