Termsslug: multimodal-interaction

Multimodal Interaction

多模态交互

Human-computer interaction combining visual, voice, and other sensory channels.

Curated Intelligence

12 items · Page 1/2
Rohan Paul (@rohanpaul_ai)T2·Agents
68 pts
Atmee v2 Launches Real-Time Video Avatars for AI Agents

Startup Atmanity released Atmee v2, a real-time avatar model that generates lifelike video-callable digital humans from just one photo and 10 seconds of audio. Available via API, the tool aims to provide visual interfaces for AI agents in education and support, marking a shift from text/voice to video interaction.

IT之家 · IT业界T2·Industry
68 pts
Google Expands AI Search Ads to Global Markets

Google is expanding its AI Mode advertising business to international markets to offset slowing growth in core search ads. While Q3 revenue rose 25% year-over-year, stock prices fell due to ad growth concerns. Early tests show sponsored lists in AI Mode match organic click-through rates, with AI queries averaging three times the length of traditional searches.

新智元 (微信公众号)T2·Models
72 pts
UTokyo Releases MIDA Benchmark Exposing Multimodal LLM Social Deception Blind Spots

A team from the University of Tokyo introduced the MIDA benchmark for multimodal interactive deception assessment, accepted at EMNLP 2026. Tests reveal that leading multimodal LLMs like GPT and Claude struggle to reliably distinguish truth from lies in social interactions, despite processing audio-visual-text inputs. The study highlights significant gaps in models' ability to 'read the room' and understand theory of mind.

IT之家 · 智能时代T2·Agents
68 pts
XPeng Begins Mass Production of IRON Humanoid Robots with Multimodal Interaction and Unified VLA Model

XPeng has activated the production line for its IRON humanoid robots, targeting mass production by late 2026 and deliveries in H1 2027. The robot features multimodal interaction with trilingual support and context memory, while XPeng's second-generation VLA model bridges L2 to L4 autonomous driving capabilities, now deployed in their Robotaxi service.

IT之家 · 智能时代T2·Industry
42 pts
Apple Teases Oct 13 Event for First Smart Home Hub with A18 Chip and Apple Intelligence Support

Apple has scheduled a 'Welcome Home' event for October 13, expected to unveil its first smart home hub featuring a 6-inch display. The device is rumored to use an A18 or higher chip to support Apple Intelligence, incorporating human detection, gesture recognition, and FaceTime-based identity verification as the central node for home automation.

The Verge AIT2·Industry
42 pts
Amazon's Alexa Plus One-Year Review: Smart Home Control Improves, Personal Assistant Lags

The Verge conducted a one-year deep-dive review of Amazon's Alexa Plus. The conclusion indicates that while the AI assistant performs reliably in smart home device integration (e.g., lights, coffee makers), it still suffers from significant shortcomings in long-term memory, personalized context understanding, and complex life task handling, with intrusive ads severely degrading user experience.

机器之心 (微信公众号)T2·Agents
58 pts
openJiuwen Launches WorkSwarm with Full-Duplex Multimodal Interaction

openJiuwen has launched WorkSwarm, enabling full-duplex multimodal agent interactions similar to a phone call. This solution allows users to interrupt or share visuals while the AI executes complex background tasks, addressing latency issues in traditional turn-based dialogue. The core innovation lies in the dual-rhythm coordination between real-time models and the Core Agent, with native affinity for Ascend computing power.