LLM Flows

AI Pipes are specialized flows with persistent connections between tasks to enable low-latency LLM tasks. The pipes are persistent and multi-tenant pipes that scale and execute to suit high volume and high data requirement in real time. This is particularly useful for text-to-voice, voice-to-text and voice-to-voice LLM tasks.

AI Pipes Tasks

AI Flow Tasks are AI Pipe Tasks

All AI Flow Tasks are available to pipes by default.

List of AI Pipe Tasks

Name	Description
llm-chat-pipe	chat with llms local or remote, using standard Open AI chat completion API
llm-pipe-request	add a new request to the llm pipe
llm-pipe-response	get responses from the llm pipe
llm-pipe-memory	manage the memory