Researchers introduced RAVEL, a training-free evaluation method that utilizes stabilized PCA whitening and patch-level similarity scoring to address the performance degradation of existing cross-modal metrics in large candidate pools. Achieving a high Spearman correlation of 0.85 without additional training, RAVEL significantly outperforms traditional methods, offering a reliable baseline for efficient vision encoder selection in multimodal LLMs.
Spearman Correlation
Spearman 相关系数
A non-parametric measure of rank correlation that assesses how well the relationship between two variables can be described using a monotonic function.
Curated Intelligence
Addressing the disconnect between reconstruction metrics and generation quality in image models, researchers propose the Generation-Aware Reconstruction (GAR) framework. By injecting noise into encoded latents and simulating denoising, GAR creates a continuous evaluation path from reconstruction to generation. Experiments show that the resulting GAR-FID metric correlates strongly with final generation quality, achieving a Spearman correlation of 0.99 in specific settings, effectively resolving the weak or negative correlation seen with traditional rFID.
OpenMed released an end-to-end protein AI pipeline and open-sourced cross-species mRNA language models based on CodonRoBERTa-large-v2. Trained across 25 species in 55 GPU-hours for just $165, the model outperforms ModernBERT with a perplexity of 4.10 and higher Spearman CAI correlation.