text
📢 Having a massive amount of data to bulk  the remotely accessed LLM 🤖  with Chain-of-Though (CoT) 🔗 might result in connection loss.
📢 Having a massive amount of data to bulk  the remotely accessed LLM 🤖  with Chain-of-Though (CoT) 🔗 might result in connection loss.
new_line
text
The latter may lead to Python Exception 💥 and challenges with generated content restoration.
The latter may lead to Python Exception 💥 and challenges with generated content restoration.
new_line
text
To address on this problem, sharing the no-strings / tiny framework that exploits SQLite3 for caching each query. 
To address on this problem, sharing the no-strings / tiny framework that exploits SQLite3 for caching each query. 
new_line
text
Such caching allows smooth relaunch in the case of any data loss. ☕ 
Such caching allows smooth relaunch in the case of any data loss. ☕ 
new_line
text
With that, happy to share bulk-chain project and more on that within links below:
With that, happy to share bulk-chain project and more on that within links below:
new_line
new_line
text
⭐ github: 
⭐ github: 
link
https://github.com/nicolay-r/bulk-chain
https://github.com/nicolay-r/bulk-chain
new_line
text
📦 PyPI: 
📦 PyPI: 
link
https://pypi.org/project/bulk-chain/
https://pypi.org/project/bulk-chain/
new_line
new_line
text
There are three steps to quickstart 
There are three steps to quickstart 
new_line
text
(see them in attachment 👇):
(see them in attachment 👇):
new_line
text
✅ 1. Install library
✅ 1. Install library
new_line
text
✅ 2. Declare CoT-schema in json file 📄
✅ 2. Declare CoT-schema in json file 📄
new_line
text
✅ 3. Wrap your transformer or use existed adapters
✅ 3. Wrap your transformer or use existed adapters
new_line
link
https://github.com/nicolay-r/bulk-chain/tree/master/ext
https://github.com/nicolay-r/bulk-chain/tree/master/ext
new_line
new_line
text
For example, here is the provider for Replicate IO service (
For example, here is the provider for Replicate IO service (
link
https://replicate.com/
https://replicate.com/
text
):
):
new_line
link
https://github.com/nicolay-r/bulk-chain/blob/master/ext/replicate.py
https://github.com/nicolay-r/bulk-chain/blob/master/ext/replicate.py
new_line
text
that supports one of the largers publicly available LLaMA-3.1-405B:
that supports one of the largers publicly available LLaMA-3.1-405B:
new_line
resource
https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct
model
meta-llama/Llama-3.1-405B-Instruct
https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct
📢 Having a massive amount of data to bulk  the remotely accessed LLM 🤖  with Chain-of-Though (CoT) 🔗 might result in connection loss.
The latter may lead to Python Exception 💥 and challenges with generated content restoration.
To address on this problem, sharing the no-strings / tiny framework that exploits SQLite3 for caching each query. 
Such caching allows smooth relaunch in the case of any data loss. ☕ 
With that, happy to share bulk-chain project and more on that within links below:

⭐ github: https://github.com/nicolay-r/bulk-chain
📦 PyPI: https://pypi.org/project/bulk-chain/

There are three steps to quickstart 
(see them in attachment 👇):
✅ 1. Install library
✅ 2. Declare CoT-schema in json file 📄
✅ 3. Wrap your transformer or use existed adapters
https://github.com/nicolay-r/bulk-chain/tree/master/ext

For example, here is the provider for Replicate IO service (https://replicate.com/):
https://github.com/nicolay-r/bulk-chain/blob/master/ext/replicate.py
that supports one of the largers publicly available LLaMA-3.1-405B:
https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct
👀
John6666 den0620
🔥
jharshraj
/avatars/03206d89acfae19fa85f7e37d030d920.svg
harsh raj
jharshraj
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64e62d11d27a8292c3637f86/aptDeBHpCJxcREj6KPLN1.jpeg
Nicolay Rusnachenko
nicolay-r
user