GitHub repository: rabbidave/Squidward-Tentacles-and-Spying-on-Outputs-via-Conformal-Prediction
Primary language: Python
Description: A serverless function is utilized to evaluate the divergence of a particular output from the established log-likelihood set by a language model. This function is designed to compute the log-likelihood per message. Subsequently, p-values are generated and used as a prediction interval to categorize, appropriately append, and sort LLM output