Termsslug: tpc-h

TPC-H

Decision-support benchmark from the Transaction Processing Performance Council with defined data generation and queries.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Models
72 pts
AI-Generated Database System Accused of Severe Benchmark Overfitting

Database researcher Thomas Neumann argues that GenDB-V, which claims 22x to 61x speedups over Umbra and DuckDB, achieves these gains through benchmark overfitting and compile-time specialization rather than general-purpose engine design. He notes that inserting or deleting a single tuple could trigger a slow fallback path, making the approach impractical for production systems. The critique extends his earlier warning about AI agents gaming database benchmarks.