NVIDIA

Detect Objects (Triton)

Letterboxes and normalizes each Image, runs a Triton-hosted detector, NMS-filters the raw tensors into one per-detection record, then projects that record onto the connected output shape: boxes, geometry, labels, a count, or an overlay.

Transcribe Audio (Canary Qwen)

NVIDIA Canary-Qwen-2.5B (NeMo SALM) transcriber. Resamples each AudioFrame to 16 kHz mono, transcribes it in fixed-length windows, and emits a single joined String. English only, with punctuation and capitalization.

Locate Objects (Eagle LocateAnything)

Takes a scene Image and a description String, runs the NVIDIA Eagle LocateAnything grounding VLM, and emits one located instance per match in pixel coordinates; the sink picks the arm (BoundingBox, Rectangle, labelled box, count, or overlay).

Transcribe Audio (Parakeet)

NVIDIA Parakeet-TDT (NeMo) transcriber. Resamples each AudioFrame to 16 kHz and emits oneof t[String, [Subtitle]] — plain text or timed segments. The v2 checkpoint is English-only and v3 covers a European language set.

Estimate Optical Flow (Triton)

Dense optical flow from any 2-frame model served by NVIDIA Triton (RAFT, GMFlow, FlowFormer, SEA-RAFT and similar exports): takes Image frames and emits per-pixel OpticalFlow against a buffered reference frame, resized to the source dimensions.

Detect Landmarks (Triton)

Crops each box of a [BoundingBox] list from an Image and runs a Triton-served pose checkpoint per box, decoding heatmaps or SimCC into per-detection keypoints emitted as [[Landmark]].

Segment Image (Triton)

Image instance segmentation on an Image, served by a Triton inference service; the connected sink resolves the output arm (masks, boxes, parallel arrays, a merged mask, a count, or a colorized image).

Translate Audio (Canary)

NVIDIA Canary v2 speech-to-text translator. Resamples each AudioFrame to 16 kHz mono and runs the model between a configured source and target language, emitting the translated String (empty on silence). Covers a European language set under CC-BY-4.0 weights.

Classify Image (Triton)

Letterboxes and normalizes each Image, runs it through a Triton-hosted model, and projects one internal ranked result into the connected output arm: top-1 Classification, ranked [Classification], a String label, and more.