Spaces:

huggingchat

/

chat-ui

like 1.07k

Running

A preview of the incoming web search:

Possibility to add plugins? which is already available in open assistant but generic no authentication plugins like https://www.klarna.com/.well-known/ai-plugin.json

Editing past prompts, similar to ChatGPT. For instance, I ask a question, and it gives a response. Then I ask another question, and it gives a response. I can then go back and re-word my second question, in an attempt to get the AI to respond the way I wanted.

A continue feature, so that if the AI is cut off in the middle of a response, you can continue it. For instance, I ask it to write some code. The AI writes it, but gets cut off. I am unable to get the AI to continue the code. It also seems that the AI also has very little ability to build from past questions and responses, so asking it "Please continue" ends up with the AI changing topic, in my case, from Tensorflow code to a Flask webpage.

being able to edit prompts and reduce the max length would be useful

the main issue I am seeing with this model is that it often gives very verbose answers to simple questions and the more its memory fills with its own word vomit the more unhinged it gets

Ability for the user to change the generation parameters?

Possibility to add plugins? which is already available in open assistant but generic no authentication plugins like https://www.klarna.com/.well-known/ai-plugin.json

From my tests, plugins don't work very well with current open models, so I wouldn't rush into it. But I am open to your feedback on plugins.

being able to edit prompts and reduce the max length would be useful

Ability for the user to change the generation parameters?

Yes, I think it makes sense if it's not directly visible - maybe in the settings menu.

Ability to summarise and provide key points of a webpage from the URL provided by user.

Ability to connect to user's own vector store with documents and provide answers?

Might be overkill or irrelevant, but just saying.

Having control over model parameters would be super helpful. Sometimes I need exact, repetitive responses (like Instruct format), while other times I need creative ideas but get stuck with similar results due to pre-defined settings. Long conversations can also get repetitive.

It would be interesting if the AI could analyze applications, view images and we could also delete messages in the chat.

To do:
Add the ability to edit the ai's response.

https://aistudio.google.com/ did it, why not us?

could you add https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#constrained-output-with-grammars
json scheme

One thing I'd like to see is the AI being able to see the system time. Or a multiple of it so you can simulate a faster or slower time frame.

And maybe a tool so that it could store and retrieve information it might need later in chat, being able to update it each reply.

Also, when your reply fails, it'd be nice if you didn't have the chat entry field cleared so you could just try again. It got to the point where I'd just copy what I was going to send if it was long enough it'd be a pain to retype it, and then just paste it in again if it failed. A retry or an undo, maybe.

One thing I'd like to see is the AI being able to see the system time. Or a multiple of it so you can simulate a faster or slower time frame.

btw with dynamic prompt you could inject the current time (of the timezone you want) at inference query.

I tried to inject the time on LM Studio using Jinja, but couldn't get it to work. Figured I'd probably have to make a tool for it. After looking, it doesn't seem like it would be that difficult on huggingface. It's built-in to Kobold AI LIte, though.