Pipes
AI Pipes are specialized flows with persistent connections between tasks to enable low-latency LLM tasks. The pipes are persistent and multi-tenant pipes that scale and execute to suit high volume and high data requirement in real time. This is particularly useful for text-to-voice, voice-to-text and voice-to-voice LLM tasks.
AI Pipes Tasks
Section titled “AI Pipes Tasks”AI Flow Tasks are AI Pipe Tasks.
All AI Flow Tasks are available to pipes by default.
List of AI Pipe Tasks
Section titled “List of AI Pipe Tasks”| Name | Description |
|---|---|
| llm-chat-pipe | chat with llms local or remote, using standard Open AI chat completion API |
| llm-pipe-request | add a new request to the llm pipe |
| llm-pipe-response | get responses from the llm pipe |
| llm-pipe-memory | manage the memory |