Hacker News AIT2·Models
58 pts
A controlled experiment across ten well-known AI systems found that, when asked for a concrete promotion plan for a professional literary translator, models systematically replaced the specific task with a statistically familiar generic scenario, a problem the author argues is more serious than isolated hallucination. The failure points to weak judgment about which knowledge applies to a given task, raising the question of whether these products are general assistants or convincing imitations of professional work.