Ollama

Generate Text (Ollama)

Drives a chat turn against a locally served Ollama model from a user and system String, streaming the reply as String chunks and closing with a StreamEnd; for a bundled GPU sidecar prefer generate_text_sglang.

Extract Text Embedding (Ollama)

Sends each String to a co-located Ollama runtime and returns its embedding as an Embedding, optionally L2-normalised. Suited to fully local RAG backends where an Ollama service runs alongside the component.

Analyze Image (Ollama VLM)

Sends one or more images plus a String prompt to a vision-language model served by a local Ollama sidecar and returns the model's reply as a String. The image input is a oneof spanning a single image, an image-with-label, a batch, or labeled batch.

Extract Text (Ollama)

Sends each Image to a vision model served by a local Ollama runtime over its chat endpoint, then emits a joined String transcript or per-block regions with Polygon/Rectangle bounds and confidence.

Rerank Text (Ollama)

LLM-as-reranker over a local Ollama runtime. Sends the query and documents from a RerankInput to a chat model, parses its JSON relevance scores, sorts descending, optionally truncates, and emits [RerankResult] with each document, score and original index.