[NEW] Assistants

#357
by victor HF staff - opened
Hugging Chat org
edited 26 days ago

image.png

Assistants on HuggingChat

Today we are releasing Assistants on HuggingChat!

Assistants are a fun way to package your prompts and share them with the world.

Browse featured Assistants here: https://huggingface.co/chat/assistants

Create your first Assistant

Create your first Assistant using this form: https://huggingface.co/chat/settings/assistants/new
All you have to do is choose a model, a name, and a system prompt and you are ready to go! Note that all Assistants are public by default with the author's name.

The most powerful feature of Assistants is that they are based on open source models (of course!), so don't hesitate to switch between one of the 6 available models to see which one better suits the type of Assistant you want!

Share your Assistants with the community

The easiest way to make people try your Assistant is simply to share its direct URL present in the Assistant setting.

If you want to share your Assistants with the community or give advice on how to create one, use the dedicated thread and get a chance to be featured on the Assistants page:

https://huggingface.co/spaces/huggingchat/chat-ui/discussions/356

Potential future features

A list of interesting features that could be added, add yours to this thread and I'll update this message.

  • Improve some UI + UX flows (main priority)
  • Add a /assistants/{username} route to see all Assistants for a given user name
  • Being able to change model params for assistants (temperature, repetition penalty, ...)
  • Improve assistant creation for beginners (maybe with a step-by-step wizard or an assistant that creates other assistants)
  • Having a better way to test your Assistants during creation/edition
  • Being able to see the current used token count while editing your Assistant
  • Edit your Assistants via API, so you can always push up-to-date information to them.
  • Generate your Thumbnail Assistant via AI
  • Add RAG (and web search) to Assistant?
  • Continually add new models to HuggingChat and Assistants
  • A way to suggest changes on other users Assistants
  • Fork/duplicate Assistants
  • Prompts versioning
  • Allow you to use your own models onto your assistant (longer term)

Terms of use

Please note that you can report Assistants from the Assistant Settings page. Any assistant who is not respectful will be banned from HuggingChat immediately. The goal is to keep the community as caring and respectful as it has always been.

victor pinned discussion

+1 on Add RAG (and web search)

+1 on Add RAG (and web search)

+2 🔥

Add function calling capability

Two features that would make assistants infinitely more useful:

  1. Function Calling - Capability w/User Defined functions endpoints. (ie. user could provide function calling schema + REST endpoints for function calling)
  2. RAG - Ability to upload documents (PDF, txt, URLs) that are chunked and stored into a VectorDB for RAG with the assistant.

How do Assistants work under the hood? Do they use OpenGPTs from Langchain?
Happy about a link to the docs or something

How do Assistants work under the hood? Do they use OpenGPTs from Langchain?
Happy about a link to the docs or something

Ok just checked out the source code, doesn't look like OpenGPTs but their own thing

Amazing!

Amazing! I created an Assistant but it isn't showing up on the list, does it only show popular ones?

It's great, I love this community. I created my GPT and it is working great.

I hope that in the nearer future it can be added to inclusion topics for those people who have some physical difficulty such as: vision, listening and speaking, they can use these technologies.

It’s amazing, would be great to be able to upload long documents similar to OAI GPTs, maybe using something like MemGPT?

What are the licenses on the actual Assistants created in
https://huggingface.co/chat/

Can I copy some of the assistants into my own hosted version of chat-ui?

If there are unknowns, what about at least the assistants created by the huggingface team? Can I use these? Since most of these starter assistants are created by members of huggingface.

It would just really help if I can at least get a couple of these starter ones.

A stretch goal, or further extension: Can there be a tool to let others import the assistants created under huggingchat, into our own chat-ui implementation? That would just be awesome!
Without it, it is like we are now all missing this amazing feature, and possible have a fragmented community if we ever have our own chat-ui.

thanks!

Add RAG to Assistant is surely a big deal for me.

On my own hosted version of chat-ui, a main added feature is my own RAG which I call "knowledge base" (it works the same as web search, just with RAG). Now if I can make use of this assistants feature to add my own RAG, that would be amazing!!! In fact, that is the most important next feature for my product.

thanks!

How do Assistants work under the hood? Do they use OpenGPTs from Langchain?
Happy about a link to the docs or something

Ok just checked out the source code, doesn't look like OpenGPTs but their own thing

How do Assistants work under the hood? Do they use OpenGPTs from Langchain?
Happy about a link to the docs or something

For now, it looks like its just a custom prompt. I hope RAG and Function Calling will come next.

This is fantastic! Definitely would like to be able to adjust the temperature. Asking the assistant "how are you?" gives 3 paragraphs of spiel.

Thought I lost my assistant.

Here it is. It is called "Coder". In case I lose it or you want to try it. I hope other functions are also added that are mentioned by other users.
Another Assistant I created is "Learn English With AI" here.

100% add RAG. Also, there should be an option to hide our custom instruction in the setting.

When can we have API for assistants?
When are you planning to expose on Vercel AI SDK ?

is Assistants on HuggingChat opensource?

Hugging Chat org

is Assistants on HuggingChat opensource?

Yes, https://github.com/huggingface/chat-ui

Will be so much bots name on future, you can add search name bots.

Consider adding category tags for easier searching

buscar.png
Hello, is it possible to add a search engine? to filter by the names of the created attendees.

I feel bit nude to share my own Bot System Prompt. I think it's good when Creator bot can choose to hidden their own System Instructions.

is it possible to save these customized models to the model hub?

Image generation would be a nice touch.

can the created assistant be available as REST Endpoint to access outside of hugging face ?

I feel bit nude to share my own Bot System Prompt. I think it's good when Creator bot can choose to hidden their own System Instructions.

isn't that against the purpose of open-source? I mean, for now the used techniques in the system-prompt are the only interesting thing about current assistants. to me, usage of assistants with their current abilities will be not of any direct value - the only interesting thing is the way people formulate their instructions. IMHO hiding these instructions, reduces the value of the assistants to zero.

Hugging Chat org

I feel bit nude to share my own Bot System Prompt. I think it's good when Creator bot can choose to hidden their own System Instructions.

We are thinking about whether or not to add an option to "hide" the prompt.

one of the reasons we are unsure for now (in addition to the spirit of open source and knowledge sharing as @LHind-RobG says) is that no LLM prompt is ever really "hidden" ie. any attempt at preventing retrieval is a bit hackish/non robust.

I created 3 assistants but only see the one I asked the last question of, how can I see all of my assistants that I created

Hugging Chat org
edited 22 days ago

I created 3 assistants but only see the one I asked the last question of, how can I see all of my assistants that I created

@Paul-Arista here: https://huggingface.co/chat/settings in the list on the left.

Given that we know that people remake diseased partners or loved ones in ai to talk to them again or throw confidential company structures/documentation into system prompts etc, is it really a good idea to enforce that every assistant is to be open and accessible to everyone?
Its obviously not great that company (or realistically trade-) secrets and very private personal information get thrown onto huggingchat servers but its a lot better than having that available to everyone who cares to look.
Since everything is open source I suppose you could just run everything local, but (as far as I can tell) I dont have the hardware and barely enough tech knowledge to set that up and I doubt most people even have that much.
But Im also not sure how you'd then prevent selfish use of everything here with the ability to make assistants private to the user who created them.
This is pretty tough and Im not sure there even is a good solution here, to be honest.

如何使用api 調用個人助理?

what he said was 'How to use the API to call a personal assistant'

what he said was 'How to use the API to call a personal assistant' 抱歉,我以為這裡有自動翻譯。
感謝您幫忙。

… is that no LLM prompt is ever really "hidden" ie. any attempt at preventing retrieval is a bit hackish/non robust.

All of the ChatGPT system prompts, the "very secret" Bing AI prompt, etc. have been leaked.

@guary I mean just opt-out from sharing your conversations and don't use assistants feature? You can use system prompt without making it public assistant.
Also you could check huggingchat privacy policy if you are really concerned about privacy:

"By default, your conversations may be shared with the respective models' authors to improve their training data and model over time. Model authors are the custodians of the data collected by their model, even if it's hosted on our platform.

If you disable data sharing in your settings, your conversations will not be used for any downstream usage (including for research or model training purposes), and they will only be stored to let you access past conversations. You can click on the Delete icon to delete any past conversation at any moment."

  1. What will happen to the Assistant if a model is taken down? Migrate to new llm with context token +prompt as we/bot authors can change sys prompt of the assistants anytime? unlikely ig. or we could have a migration system for our old chats.
  2. shall there be a "View Sys Prompt" just like in regular chats beside/below the bot button? As the assistant button at the top shows the latest prompt only while the chat might have started with another prompt. (doesn't change the already active chat really)(once it recognized the changed sys prompt upon me mentioning only a part of it)

I'm getting "must be logged in", though I am logged into Hugging Face, when trying to create a new assistant. Is there some additional way I need to log in?

Hugging Chat org

I'm getting "must be logged in", though I am logged into Hugging Face, when trying to create a new assistant. Is there some additional way I need to log in?

No that might be a bug but I cannot reproduce, do you see your username in the bottom navigation?

image.png

Je sais que la vie n'est pas si évidente que ça pour tout le monde mais étant dans le domaine de l'informatique si je peux vous être utile voir même participer financièrement pour que ces fonctionnalités restent gratuites et à porter de tout le monde : vous pouvez compter sur moi ! Et vivre le savoir et la technologie libre et pour tous !
Merci la communauté ❤️

More features that would make assistants infinitely more useful for ( non coders )

Auto Function Creator: A simple prompt could lead to the creation of custom functions.
It's about making programming accessible to all, empowering creativity without deep technical expertise

@victor It was properly bc I started in guest mode, but then couldn't find a way to leave that mode. After trying things out for some time a pop-up to log in appeared, and then I could solve my problem.

Je sais que la vie n'est pas si évidente que ça pour tout le monde mais étant dans le domaine de l'informatique si je peux vous être utile voir même participer financièrement pour que ces fonctionnalités restent gratuites et à porter de tout le monde : vous pouvez compter sur moi ! Et vivre le savoir et la technologie libre et pour tous !
Merci la communauté ❤️

@Batwilf HuggingFace est une boite avec un fond de +4 Milliard dollars 🤯 Mais il y a tjrs des communautés et des groupes qui travaillent dur et finallement publier leur traveaux open source et je pense que la majorite (meme tout le monde) ont tjrs besoin de ce type de support 💪🏻🔥 Merci pour ton engagement envers Open Science 🤗

How much text can you put into the custom instructions?

No description provided.

i have one request that might be a bit of a reach but would be an awesome feature. if there could be a way that we can make an api call or some other call out to a custom model, we could use the model for other applications.

I think it would be useful to be able to attach content to ground the assistant like PDF, word docs, spreadsheets etc.

Pls add (1) memory and (2) another layer with another model (or the same), to moderate, or to direct the first one (who can actually talk to users)

This comment has been hidden

Can we change the preview of an assistant for social media posts? It looks too much like another website's. Just a background color change would do the trick.

Do these models have guardrails built in already? Or do we need to include them in the prompt?

Do these models have guardrails built in already? Or do we need to include them in the prompt?

Depends on the model. For example, CodeLlama will have many guardrails, Nous Mixtral will not.

Do these models have guardrails built in already? Or do we need to include them in the prompt?

Depends on the model. For example, CodeLlama will have many guardrails, Nous Mixtral will not.

Mistral 7b? I’m only asking bc I haven’t been able to determine whether the models for the Assistants feature specifically include guardrails or not. Apologies, I wasn’t clear before.

Will there be a search feature for assistants?

Allow to create private assistants.

is there any API? What features do you need so that it can run on your PC?

Hugging Chat org

is there any API? What features do you need so that it can run on your PC?

Yes, check this: https://huggingface.co/chat/settings

Is there any api we can use to call from like a python script though?

People, today, February 22, I have been asked several times, the GPTs are still processing the response and the model I am using is mistralai/Mixtral-8x7B-Instruct-v0.1, could it be that many requests are being made to the server and not Is it enough? help !

It would be nice to be able to make the assistants private

Is there a feature that allows the assistants to be categorized? for example, I'm interested in health topics, is there a way to classify them or search the assistants?

Sign up or log in to comment