Package: amadeusgpt
🪄We turn natural language descriptions of behaviors into machine-executable code.We use large language models (LLMs) to bridge natural language and behavior analysis.This work is accepted toNeuRIPS2023!Read the paper,AmadeusGPT: a natural language interface for interactive animal behavioral analysisLike this project? Please consider giving us a star ⭐️!Install & Run AmadeusGPT🎻AmadeusGPT is a Python package hosted onpypi. You can create a virtual env (conda, etc, see below*) or Docker and run:pipinstall'amadeusgpt[streamlit]'Please note that you need anopenAI API key, which you can easily createhere.If you want theStreamlit Demo on your computer, you will also need demo files that are supplied in our repo (see below**), so please git clone the repo and navigate into theAmadeusGPTdirectory. Then in your conda env/terminal runpip install '.[streamlit]'. Then, to launch the Demo App execute in the terminal:makeappCitationIf you use ideas or code from this project in your work, please cite us  using the following BibTeX entry. 🙏@article{ye2023amadeusGPT,
     title={AmadeusGPT: a natural language interface for interactive animal behavioral analysis}, 
     author={Shaokai Ye and Jessy Lauer and Mu Zhou and Alexander Mathis and Mackenzie Weygandt Mathis},
     journal={Thirty-seventh Conference on Neural Information Processing Systems},
     year={2023},
     url={https://openreview.net/forum?id=9AcG3Tsyoq},arXiv preprint versionAmadeusGPT: a natural language interface for interactive animal behavioral analysisbyShaokai Ye,Jessy Lauer,Mu Zhou,Alexander Mathis&Mackenzie W. Mathis.Install tips*Make a new conda env:conda create --name amadeusGPT python=3.9then runconda activate amadeusGPTor you can also use our supplied conda if you git cloned the repo (navigate into the conda directory):conda env create -f amadesuGPT.ymlthen pip install amadeusGPT once created/launched.**Git clone this repo: so please open a terminal, we recommend to download into Documents (so typecd Documents) and rungit clone https://github.com/AdaptiveMotorControlLab/AmadeusGPT.gitThen go into the dir (cd AmadeusGPT)If you want to use SAM, you need to download the weights. Otherwise you will see the following message in the app:Cannot find SAM checkpoints. Skipping SAM. Download them and add to "static" directory: wgethttps://dl.fbaipublicfiles.com/segment_anything/sam_vit_b_01ec64.pthInstall trouble shooting:If you hit an error during installing on an M1/M2 Macbook with installing HDF5, runconda install h5pyin your conda env.If you launch the app and get an ffmpeg error,RuntimeError: No ffmpeg exe could be found. Install ffmpeg on your system, or set the IMAGEIO_FFMPEG_EXE environment variable.try runningconda install ffmpeg.If you have an M1/M2 chip and use CEBRA within AmadeusGPT, and you get this error:RuntimeError: Device type MPS is not supported for torch.Generator() apirunpip install --upgrade torch.LicenseAmadeusGPT is license under the Apache-2.0 license.🚨 Please note several key dependencies have their own licensing. Please carefully check the license information forDeepLabCut(LGPL-3.0 license),SAM(Apache-2.0 license),CEBRA(Non-Commercial), etc...News🤩 Dec 2023, code released!🔥 Our work was accepted to NeuRIPS2023🧙‍♀️ Open-source code coming in the fall of 2023🔮 arXiv paper and demo released July 2023🪄Contact us