Capture webcam and microphone from browser via WebRTC

Use This When

• Building web-based video analytics applications without native app installation
• Creating remote inspection or quality assurance tools accessed via browser
• Implementing interactive demos where users test pipelines with their own camera
• Developing customer-facing applications needing camera/mic with minimal setup friction

What It Does

• Establishes WebRTC connection to capture video and audio from browser MediaDevices API
• Streams VideoFrames and AudioFrames to pipeline in real-time with configurable frame dropping
• Handles WebSocket signaling and peer connection management automatically
• Supports configurable resolution, FPS, audio frame duration, and separate video/audio enable flags
• Supports optional local WebRTC UDP port range constraints via webrtc_port_range

Works Best With

• This component → detect-objects → visualize → output-browser-video for live analytics
• Browser camera → this component → detect-voice-activity → transcribe-audio for web voice UI
• Integration with face detection or gesture recognition for interactive web applications
• Remote monitoring dashboards where browser acts as camera source

Caveats

• Requires HTTPS in production; browser security policies block insecure origins
• User must grant camera/microphone permissions; denial prevents capture
• Network jitter affects frame timing; drop_frames=true prevents backpressure but loses data
• Audio frame duration configurable but must align with downstream ASR requirements