Package: arey
areyArey (अरे, sanskrit) — ind. Interjection of calling.Arey is a simple large language model app.🤖 Use any llama.cpp or ollama model.💬 Chat with your favorite local models. CPU friendly 🍀🙋 Ask the AI model with a single command.📋 Supercharged in-context learning workflow ❤️ Edit your prompt inanyeditor
andareywill generate a completion on save.🔓 No telemetry, no internet, nothing to sell. Dedicated to the public domain.🚧 Much more to come... SeeRoadmapbelow.https://github.com/codito/arey/assets/28766/6b886e49-6124-4256-84d9-20449c783a34Installation# Install pipx if needed: `pip install pipx`# Ensure ~/.local/bin is available in system PATHpipxinstallareyPlease useWSLfor Windows installation. Troubleshooting notes arehere.Usage❯arey--help
Usage:arey[OPTIONS]COMMAND[ARGS]...Arey-asimplelargelanguagemodelapp.

Options:-v,--verboseBOOLEANShowverboselogs.--helpShowthismessageandexit.

Commands:askRunaninstructionandgenerateresponse.chatChatwithanAImodel.playWatchFILEformodel,promptandgenerateresponseonedit.On the first run,areywill create a configuration file in following location:~/.config/arey/arey.ymlfor Linux or Mac systems.~/.arey/arey.ymlfor Windows.Please update themodelssection in the config yml to your local model path.1. Ask Arey something!arey ask "Who is Seneca? Tell me one of his teachings"2. Chat with Areyarey chat3. Run Arey in play modeUse to fine-tune a prompt in your editor whileareykeeps completing your prompt on every save.❯areyplay/tmp/arey_playzl9igj3d.md

Welcometoareyplay!EdittheplayfilebelowinyourfavoriteeditorandI'llgeneratea
responseforyou.Use`Ctrl+C`toabortplaysession.

Watching`/tmp/arey_playzl9igj3d.md`forchanges...

─────────────────────────────────────2024-01-2117:20:01──────────────────────────────────────
✓Modelloaded.0.57s.

Lifeisshortbecauseitpassesbyquicklyandcanendatanymoment.Weshouldmakethemostof
ourtimehereonearthandliveavirtuouslifeaccordingtostoicism.

◼Canceled.

Watching`/tmp/arey_playzl9igj3d.md`forchanges...Development# Install arey locally in editable mode.>pipinstall-e.
>pipinstall-e.\[test\]# optional, if you wish to run tests# Install with samples dependency if you wish to run them>pipinstall-e.\[samples\]With OPENBLAS, loading time for models is much smaller and inference is about
4-5% faster. Here's how to installllama-cpp-pythonwith OPENBLAS support:>pipuninstallllama-cpp-python
>CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS"FORCE_CMAKE=1pipinstallllama-cpp-python--force-reinstall--upgrade--verboseIf you've a GPU, try the following installation instead.>pipuninstallllama-cpp-python
>CMAKE_ARGS="-DLLAMA_CUBLAS=ON"FORCE_CMAKE=1pipinstallllama-cpp-python--force-reinstall--upgrade--verboseRoadmapChat and task modes for interactive or batch queriesDefine new tasks with only a prompt, no code. See docs/samples directory
for examples.Markdown formatting for chat mode.Ollama support.Command support in chat. E.g., logs, change model, copy, clear, etc.Discover prompts from user directoryManage prompts and create new interactivelyDownload models and manage themRelease v0.1AddtextfxAdd offline knowledge bases and RAG. Seehttps://library.kiwix.org/#lang=engLicenseDedicated to the public domain withCC0.
We'll be delighted if this tool helps you positively 💖