Termsslug: causal-masking

Causal Masking

因果掩码

An attention constraint limiting the model to focus only on current and previous positions

Curated Intelligence

2 items · Page 1/1
Hugging Face BlogT1·Open Source
68 pts
Hugging Face Introduces Model Integration Contracts to Prevent Regressions

Hugging Face introduces 'Transformers Model Integration Contracts' (TMIC) to address hidden regressions caused by insufficient test coverage in the Transformers library. By defining standardized behavioral contracts and automated testing paths for each model, TMIC ensures critical logic errors—such as attention mask failures after enabling SDPA—are caught before merging. This initiative significantly enhances engineering stability and maintenance efficiency within the open-source ecosystem supporting over 750 models.

Qwen 官方博客 (通义)T1·Models
78 pts
Qwen Releases Open-Source Qwen-Image-2.1: Unified Generation & Editing in 7B

Alibaba's Qwen team has open-sourced Qwen-Image-2.1, a lightweight 7B-parameter model that unifies text-to-image generation and image editing within a single architecture. The model natively supports transparent image generation and editing, leveraging a mixed-granularity attention mechanism to optimize inference efficiency while enhancing fidelity in typography, lighting, and multi-reference local edits.