1 4

qubite

Xdotnet

https://www.qubite.me/

qu-bite

AI & ML interests

Aspiring Civil Engineer | Passionate About Sustainable Infrastructure | Problem Solver| Tech enthusiasts

Recent Activity

Reacted to m-ric's post with 🚀 about 2 months ago

𝗔𝗱𝗱 𝘀𝗼𝘂𝗿𝗰𝗲 𝗵𝗶𝗴𝗵𝗹𝗶𝗴𝗵𝘁𝗶𝗻𝗴 𝘁𝗼 𝘆𝗼𝘂𝗿 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺! 📄💡 RAG systems are supposed to make your LLM's answer more trustworthy, by inserting in the prompt some supporting documents from a knowledge base : we say that we're "adding some context". 👎 But if you don't know which part of the answer has been generated based on which input tokens, it's hard to tell wether it was effectively grounded in the context knowledge or not! 🤔 I've been working on the question: is it possible to add notes to the answer linking to which part of the context they're generated from? And I've found a great solution: a great technique called Layer-wise Relevance Propagation (LRP), showcased in a paper at ICML `24 by Reduan Achtibat et al allows, allows to precisely score how important each input token was in generating your output! They've made it into a library called LXT. 📊 For each generated output token, LXT gives you attribution scores for each input token. ⚙️ So I've worked a bit more on aggregating these scores into meaningful spans between successive input and output tokens, and I finally obtained my desired result: RAG with source highlighting! Try the demo here 👉 https://huggingface.co/spaces/m-ric/rag_highlights Caveats: - It slows down generation (for now quite a lot, could hopefully be reduced a lot) - For now it supports only specific models: Llama models and Mixtral If there's enough interest in this solution, I can improve it further and spin it off into a specific library for RAG! 🚀

Reacted to davidberenstein1957's post with 🤗 about 2 months ago

Why is argilla/FinePersonas-v0.1 great for synthetic data generation? It can be used to synthesise realistic and diverse data of the customer personas your company is interested in! Dataset: https://huggingface.co/datasets/argilla/FinePersonas-v0.1 Example usage: https://distilabel.argilla.io/dev/sections/pipeline_samples/examples/fine_personas_social_network/

Reacted to victor's post with 🔥 about 2 months ago

🙋 Calling all Hugging Face users! We want to hear from YOU! What feature or improvement would make the biggest impact on Hugging Face? Whether it's the Hub, better documentation, new integrations, or something completely different – we're all ears! Your feedback shapes the future of Hugging Face. Drop your ideas in the comments below! 👇

View all activity

Organizations

Xdotnet's activity

New activity in BRICS/README about 1 year ago

BRICS

#1 opened about 1 year ago by

Xdotnet