Termsslug: decoder-only

Decoder-only

解码器仅架构

A model architecture using only the Transformer decoder stack for autoregressive generation.

Curated Intelligence

1 items · Page 1/1
Hugging Face BlogT1·Models
78 pts
TII Releases Open-Source Falcon 3 Family with Mamba Variant

The Technology Innovation Institute (TII) has released the open-source Falcon 3 family of LLMs, ranging from 1B to 10B parameters. The series emphasizes enhanced capabilities in science, math, and code, notably introducing a 7B base model built on the Mamba architecture to improve training efficiency and inference performance.