What are some approaches to prevent abuse of LLMs?


Here are some approaches to prevent abuse of LLMs:

1. Prevent users from submitting prompts that contain abusive phrases (a simple keyword ban could work for this).
2. Similar to the first point, prevent the LLM from returning responses that contain abusive phrases based on a simple keyword ban.
3. Provide users the option to upvote/downvote and flag responses from the LLM to collect feedback. An additional classification model could be trained on the responses that were flagged as inappropriate and then used to identify and filter out problematic responses from the LLM in the future before the user sees them.