Hacker News AI · 2026/10/15 00:33:34
Kombai 发布 Design Creativity Bench：量化 UI 设计创造力，GPT-6 Astra 得分仅 65.5 远低于人类基准
Kombai 推出新基准 Design Creativity Bench，通过原创性、创意范围和适用性三个维度评估 AI 在 UI 设计任务中的创造力。评测显示，尽管前沿模型能生成功能性界面，但在创意决策上仍显著落后于人类设计师，最佳模型 GPT-6 Astra 得分仅为 65.5，而人类参考得分为 92.3。该基准已开源完整方法论与数据集，旨在将设计创造力转化为可量化的模型能力指标。
报道全文原始报道全文
⚠️ Frontier AI models still fall significantly short of human designers on design creativity. ⚠️
Introducing Design Creativity Bench, a new benchmark evaluating AI models’ creativity on UI design tasks.
Despite rapid advances in their ability to generate functional websites and product UIs, leading AI models still struggle to make creative design decisions.
We evaluated 16 frontier models across 80 open-ended UI tasks, each adapted to two distinct product domains alongside human designer references.
Existing UI benchmarks often measure a single output quality metric. Instead, we measure three dimensions of design creativity:
- – Originality: How distinct a model's designs are from other models' outputs for the same brief.
- – Creative Range: How much a model adapts its design decisions when the product domain changes.
- – Appropriateness: How well the generated UI satisfies the functional requirements of the brief.
The results reveal a substantial gap in overall creativity: The best model, @OpenAI GPT-6 Astra, scores 65.5 against a human reference of 92.3.
We're publishing the full leaderboard, methodology, and reproducible evaluation framework to make design creativity a measurable dimension of frontier model capability.
📊 Benchmark Leaderboard: https://kombai.com/benchmark/ 📄 Paper: https://arxiv.org/abs/2610.11539 🤗 HuggingFace Datasets: https://huggingface.co/datasets/Kombai/design-creativity-bench 🔗 Github: https://github.com/kombai-io/design-creativity-bench/