Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
nicolay-rΒ 
posted an update about 16 hours ago
Post
412
πŸ“’ If you're aimed at quick experiment with LLM and known Chain-of-Thought (CoT) / prompt schema with no-string dependencies, then I have something relevant for you to share πŸ’Ž

So far I released the updated version πŸ“¦ bulk-chain-0.25.0 πŸ“¦, which is aimed at bringing accessible API for an instant LLM application towards massive data iterators using via predefined prompt schema 🎊

πŸ“¦: https://pypi.org/project/bulk-chain/0.25.0/
🌟: https://github.com/nicolay-r/bulk-chain
πŸ“˜: https://github.com/nicolay-r/bulk-chain/issues/26

The key updates of the most recent release are:
βœ… πŸͺΆ No-string (empty dependencies): you can use any framework / API for LLM.
βœ… 🐍 Python API support (see first screenshot πŸ“Έ).
βœ… πŸ’₯ Native try-catch wrapping to guarantee no-data-lost on using remote providers especially: OpenAI, ReplicateIO, OpenRouter, etc.
βœ… πŸ”₯ Batching mode support: you may wrap for handling batches to significantly boost the performance πŸš€ (see screenshot below for bath enabling πŸ“Έ)
βœ… πŸ”§ Fixed a lot of minor bugs

Quick start on GoogleColab:
πŸ“™: https://colab.research.google.com/github/nicolay-r/bulk-chain/blob/master/bulk_chain_tutorial.ipynb

πŸ“˜ The wiki of the project is available here:
https://github.com/nicolay-r/bulk-chain/wiki/Project-Documentation
In this post