Package: transformers-agent-ui
🤗 Transformers Agent UITHIS PROJECT IS CURRENTLY A PROOF OF CONCEPT. DON'T EXPECT EVERYTHING TO WORK! CHECK OUT THETODO LISTFOR MORE INFO.We want toMake it easy to use theHugging Face Transformers Agent.We providetheTransformersAgentUIcomponent which can be used in the notebook as a web appa deployment of the web app on Hugging Face SpacesYou can install and use the package as simple as.pipinstalltransformers-agent-uiIn a notebook just runimportpanelaspnfromtransformers_agent_uiimportTransformersAgentUIpn.extension("terminal","notifications",notifications=True,design="bootstrap")TransformersAgentUI()To serve as a web app create the fileapp.pyimportpanelaspnfromtransformers_agent_uiimportTransformersAgentUIifpn.state.served:pn.extension("terminal","notifications",notifications=True,design="bootstrap")TransformersAgentUI().servable()and runBOKEH_RESOURCES=cdnpanelserveapp.py'In order for you to run the inference you will have to provide tokens. Preferably via the
environment variablesHUGGING_FACE_TOKENOPEN_AI_TOKENAlternatively you can provide them on theSettings tabin the app.🚀 Get started in under a minuteInstalltransformers-agent-uiincluding theexamplesdependencies.pipinstalltransformers-agent-ui[examples]Explore the sample appspnhellotransformers-agent-uiYou can now find thereferenceandgallerynotebooks in theexamples/awesome-panel/transformers-agent-uifolder. Check them out by runningjupyter lab.📒 Explore the examples onlineClick one of the buttons⭐ SupportPlease supportPanelandawesome-panelby giving the projects a star on Github:holoviz/panel.awesome-panel/awesome-panel.Thanks❤️ ContributeIf you are looking to contribute to this project you can find ideas in theissue tracker. To get started check out theDEVELOPER_GUIDE.I would love to support and receive your contributions. Thanks..MonitorTodo ListImplement TokenManagerSave every run - also when cache is hitAdd notification if no token is availableDeploy to Pypi. DONE - SeelinkRenamerunningparameter tois_runningparameterMove use_cache from settings tab to editor tabSave run prints to storeRedirect log to Terminal AND to stdout for easier debuggingSupport dynamic arguments (text, image etc) to run functionAs inputs to .runCreate/ Update from fileCreate/ Update from outputDelete/ RemoveGet better feedback on run exceptions backTest it on lots of examplesAdd specific support for reading and writing more types. Currently most things are pickled.torch.Tensor is often returned and can be savedAdd three examples to make it easy to get startedSupport enabledremoteparameter setting. Currently we only supportremote.Don't save asset if from cache. Instead reuse.Make the Cache/ Store useful by providing an interfaceMulti user supportRestrict logs to user sessionSee alsohf #23354Restrict store to user sessionMake application non-blocking when used by multiple usersDeploy to Hugging Face. I probably wont be able to as the app needs a lot of power when
running locally.Build a sample store and collect data on runsEnable downloading the output valueHelp the app and/ or Panel display the outputs. For example when a tensor is returned PanelSpecifically test that the output of each tool is supported
does not know how to display that. And the agent fails if we ask it to return the value wrapped in
a HoloViz Panel Audio Pane. SeePanel #4836Profile therunand figure out if for example agents should be reused/ cachedPrompt seems to be cut of when displayed in the UI. Fix thisMaybe later listMake the project more specific by calling it hfagent-ui and providing HFAgentUI,Make the project more general as in agent-ui. We could provide HFAgentUI,
LangChainAgentUI etc. Or maybe even just AgentUI. Much of the code would be reusable.Run inference async to make app more performant if possibleSupport chat mode.