Hugging Face

Detect Text Language (HuggingFace)

Identifies the language of a String (or [String]) with a fine-tuned HuggingFace classifier and emits the model's own language code by output slot: a top-1 String, a per-segment [String], a Classification, or a [Classification].

Edit Image (HuggingFace)

Edits each input Image under a text prompt with a HuggingFace diffusers image-to-image checkpoint (default stabilityai/sdxl-turbo) and emits one edited Image at the same resolution. strength sets how far the edit departs from the source.

Recognize Named Entities NER (HuggingFace)

Runs zero-shot GLiNER named-entity recognition on each String and emits the spans that clear a confidence floor as either anonymous record spans or [NamedEntity] carriers, depending on the downstream connection.

Translate Text (HuggingFace)

Translates a String or [String] with a HuggingFace seq2seq model loaded in-process (default NLLB-200), forcing the target-language decode token, and returns a string, string list, or language-tagged record chosen from the resolved downstream port.

Answer Question (HuggingFace)

Extracts the answer to a question from a passage with a HuggingFace QA reader: takes a question String and a context String, finds the span of the context that answers it (default DeBERTa-v3-large SQuAD2.0), and emits the answer String or a QAAnswer record tagged with its char offsets + score.

Classify Text (HuggingFace)

Runs a fine-tuned text-classification model over a String and emits ranked [Classification], a single Classification, or raw [Double] scores in the model's label order, by output slot, when a trained model exists (sentiment, topic, intent).

Classify Image (HuggingFace)

Classifies an Image with a HuggingFace, timm, or Optimum network and projects one internal ranked result into the connected output arm: top-1 Classification, ranked [Classification], a String label, and more.

Classify Audio Event (HuggingFace)

Runs any HuggingFace audio-classification checkpoint on each AudioFrame; emits ranked [Classification], a top Classification, or the top label as String. Sigmoid (multi-label) vs softmax (single-label) is auto-picked per checkpoint.

Detect Objects (HuggingFace)

Detects objects in each Image with a HuggingFace or Ultralytics checkpoint chosen at load time from the repo contents and projects the detections onto the connected output shape: boxes, geometry, classes, a count, or an overlay. Filtered by confidence.

Generate Text (HuggingFace)

Generates a reply for each String prompt by running a HuggingFace causal LM in-process with transformers (no vLLM / Ollama / SGLang sidecar). The repo's own chat template formats each turn, with an optional system prompt, and emits the assistant text as a String.

Classify Audio Zero Shot (HuggingFace)

Zero-shot audio classifier: self-downloads a HuggingFace CLAP checkpoint and ranks a runtime label set against each AudioFrame by audio-text similarity. Emits [Classification], a top Classification, or raw [Double] scores. Model hot-swaps.

Extract Text Embedding (HuggingFace)

Encodes each String into a dense Embedding by loading any HuggingFace encoder directly in-process with AutoModel and AutoTokenizer, pooled by CLS or mean and optionally L2-normalised. No cloud API. Suited to retrieval, clustering, similarity, and RAG encoding.

Classify Text (SetFit)

Few-shot SetFit classifier that scores a String against a class set fitted from a handful of examples, emitting ranked [Classification], a single Classification, or [Double] in sorted class order. For few examples per class with no LLM endpoint.

Classify Speech Emotion (HuggingFace)

Runs any HuggingFace audio-classification checkpoint for speech affect over each AudioFrame, emitting the ranked emotion label/score pairs as [Classification] or only the single top emotion as a String.

Rerank Text (HuggingFace)

Cross-encoder reranking of retrieved passages with any HuggingFace reranker repo loaded in-process. Scores every query-document pair in a RerankInput via AutoModelForSequenceClassification, sorts by descending relevance, optionally truncates to top_n, and emits [RerankResult] carrying each document, score and original index.

Transcribe Audio (HuggingFace)

HuggingFace transformers Whisper transcriber. Resamples each AudioFrame to 16 kHz and decodes it via an ASR pipeline, emitting a String or timed [Subtitle] list. For production speed prefer transcribe_audio_faster_whisper.

Analyze Image (HuggingFace)

Answers a natural-language prompt about each Image using a HuggingFace image-text-to-text model loaded directly in-process with transformers (default Qwen2-VL-2B-Instruct, no vLLM/SGLang/Ollama sidecar) and emits the answer as a String.

Answer Table Question (HuggingFace)

Answers a natural-language question about a table with HuggingFace TAPAS: takes a JSON table String and a question String, selects the answer cells and an aggregation operator in one pass, and emits the answer String (SUM / AVERAGE / COUNT computed, NONE joined).

Summarize Text (HuggingFace)

Abstractive text summarizer that loads any HuggingFace seq2seq summarization model named by model in-process and condenses a String document into a shorter summary String, bounded by min_length and max_length. No cloud API.

Detect Objects Zero Shot (HuggingFace)

Detects objects named by labels text queries in each Image with an open-vocabulary HuggingFace detector (Grounding DINO / OWLv2) and projects detections onto the connected output shape: boxes, geometry, classes, a count, or an overlay.

Detect Landmarks (HuggingFace)

Crops each box of a [BoundingBox] list out of an Image and runs a HuggingFace pose/keypoint checkpoint (ViTPose, SuperPoint, or ONNX) to emit per-detection landmarks as [[Landmark]].

Estimate Depth (HuggingFace)

Monocular depth estimator over each Image that auto-selects a HuggingFace pipeline, eager transformers, or ONNX backend from the checkpoint and emits a deploy-time-resolved depth Image, a metric MetricDepthMap, or an unscaled relative depth map.

Segment Image (HuggingFace)

Image segmentation on an Image from a Hub model id, auto-routing to a Transformers, ONNX or Ultralytics YOLO backend by repo contents. The sink resolves one of nine projections, from [(Segmentation, BoundingBox)] to a count.

Generate Video (HuggingFace)

Synthesises a short video clip from each String prompt using an in-process HuggingFace diffusers text-to-video pipeline; emits one Image per frame so the output stream forms the generated video.