Hacker News AIT2·Infra
78 pts
South Korean edge AI chip startup DeepX has taped out its second-generation accelerator, the DX-M2, using Samsung's custom processor-in-memory technology to run models of up to 100 billion parameters on-device at under 5 W, delivering 10 to 30 tokens per second. The key leap over the mass-produced, vision-focused DX-M1 is a tripling of memory bandwidth, targeting robots, drones and other generative AI edge devices.