Termsslug: multimodal-fusion

Multimodal Fusion

多模态融合

The technology of integrating and processing information from different modalities like text and images.

Curated Intelligence

6 items · Page 1/1
量子位 (微信公众号)T2·Tools
68 pts
Genspark Launches Media Studio Integrating Multi-Model Video Generation

Genspark officially launched Media Studio, a video agent workspace that orchestrates LLMs, image, and audio models to automate the workflow from script to final cut. The platform integrates over 70 model versions, supporting one-click replication of viral templates and multi-modal asset generation, significantly lowering the barrier to professional video production.

量子位 (微信公众号)T2·Industry
45 pts
iRTE2026 Highlights Real-Time Voice Interaction as OpenAI and Google Advance Conversational AI

The iRTE2026 conference highlights real-time intelligent interaction, marking a shift in conversational AI from single-turn generation to continuous participation in real exchanges. Leading products like OpenAI's GPT-Realtime and Google's Gemini Live are driving this evolution through full-duplex, multimodal, and tool-calling capabilities. While reflecting industry focus on low-latency voice agent infrastructure, the event lacks specific new technical parameters or breakthrough releases.

OpenRouter (@OpenRouter)T1·Models
68 pts
Cloudflare Launches Clef Omni: Native Multimodal Decision Model Outputting Probabilities Instead of Tokens

Cloudflare has released Clef Omni, a multimodal decision model that natively processes audio, video, images, and text in a single pipeline. Unlike standard LLMs, it outputs classification probabilities instead of generated tokens (e.g., 'hot dog' at 96.5%), now available on OpenRouter with pricing at $0.15/M input and free output.

IT之家 · 智能时代T2·Agents
42 pts
Apple HomeView Hub: Extends Third-Party Media via CarPlay-like Mechanism and Identifies Six Users Multimodally

Apple's new smart home hub HomeView extends third-party audio/video apps using a CarPlay-like mirroring mechanism via connected iPhones or iPads. It replaces Face ID with multimodal identification combining Center Stage facial recognition and voice analysis to distinguish up to six family members for personalized experiences.

量子位 (微信公众号)T2·Models
68 pts
Ant Group and ZJU Propose TRACE: Dynamic Confidence Assessment Boosts Streaming Emotion Accuracy to 69.47%

Ant Group Security Lab and Zhejiang University introduced TRACE, a streaming emotion understanding framework for real-time human-AI interaction, addressing latency and high multimodal inference costs in offline models. By continuously tracking judgment changes and dynamically assessing reliability, TRACE significantly reduces unnecessary multimodal calls. On the custom StreamMER dataset, it improved online audio-only accuracy from 59.87% to 69.47%, with the paper accepted at EMNLP 2026.

Qwen 官方博客 (通义)T1·Agents
68 pts
Qwen Launches DeepResearch with Dual Modes and Multimodal Fusion

Tongyi Qianwen launches Qwen DeepResearch to lower the barrier for deep inquiry. The feature offers dual modes (Normal/Advanced) and integrates local files like PDFs and images, utilizing a restructured search strategy to reduce hallucinations and automate report generation from inspiration to insight.