llm-bradley-terry / docs /arena /disclaimer.md
jerome-white's picture
Allow Alpaca and Arena results to be presented in the same space
d4dddf1
|
raw
history blame contribute delete
No virus
802 Bytes
# Disclaimer
This Space is primarily intended for exploration. For now its results
should be treated as points of reference rather than absolute
facts. Viewers are encouraged to study the pipeline and understand the
model to help put the results into context.
Suggestions for improving this Space from those familiar with Chatbot
Arena or Bayesian data analysis are welcome! Please use the
[community](https://huggingface.co/spaces/jerome-white/arena-bradley-terry/discussions)
to do so.
## Resources
* [Source code](https://github.com/jerome-white/alpaca-bda/tree/chatbot-arena) for
producing results
## TODO
* Extend the Stan model to incorporate ties and response presentation
ordering
* Add details of the MCMC chains
* Automate data processing
* Explicit documentation of the process