Toolsslug: airchat

AirChat

Airbnb's internal platform for running coding agents, serving thousands of engineers weekly and routing model requests through a

Curated Intelligence

1 items · Page 1/1
AWS Machine Learning BlogT1·Tools
58 pts
Airbnb Uses Cost per Task to Evaluate Coding Agents on Bedrock

Airbnb details how its internal coding-agent platform AirChat runs on Amazon Bedrock, using evals to measure model quality on representative tasks and cost per task as the primary model-selection metric. CloudWatch runtime metrics track latency, throttling, and token spend, with production data prompting teams to revisit model choices as usage shifts.