Termsslug: tactile-to-video-retrieval

Tactile-to-Video Retrieval

触觉到视频检索

Cross-modal benchmark retrieving matching video clips from tactile signals to gauge representation quality.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Open Source
71 pts
Robbyant Open Sources LingBot-Touch Tactile Model for Robots

Robbyant has open-sourced LingBot-Touch under Apache 2.0, converting fingertip tactile sensor readings into signals usable by robot control software and filling the gap where cameras cannot sense grip force or slip. The team trained three same-size encoders (5.46M parameters each) on identical touch data; at 4,000 hours, the JEPA variant that predicts masked regions in latent space reached 49.3% top-5 on tactile-to-video retrieval with MAE under 9%, versus just 3.1% for the VAE. The author attributes JEPA's edge to the sparsity and low signal-to-noise ratio of tactile data.