Termsslug: cuda

CUDA

Nvidia's parallel computing platform and programming model, the key software barrier tying AI models to its GPUs.

Curated Intelligence

17 items · Page 1/2
Hacker News AIT2·Infra
78 pts
Anthropic's Claude Mythos Cuts AMD GPU Onboarding to Three Days

Anthropic told IPO investors that its Claude Mythos Preview model completed the low-level software work needed to run one of its models on AMD MI355X GPUs at useful performance in about three days, with basically no human intervention, versus six to 12 months and dozens of engineers previously. Mythos ported or wrote almost 100% of the kernels, a result that directly challenges Nvidia's CUDA moat.

Hacker News AIT2·Industry
62 pts
Nvidia Faces Leadership Crossroads After Jensen Huang Steps Down

Nvidia's board announced that Jensen Huang has resigned as CEO 33 years after co-founding the company, opening a succession process. The piece traces his three reinventions, CUDA as a general-purpose computing platform, the pivot to deep learning after ImageNet, and the Mellanox acquisition that moved Nvidia from GPU boards to integrated AI datacenter racks, and warns that visionary-led firms often coast on momentum after their founder departs. The board must decide whether the next CEO is hired to execute today's business, reinvent it, or both.

The DecoderT2·Infra
88 pts
Anthropic Says AI Cuts AMD Chip Migration From Months to Three Days

Anthropic co-founder Tom Brown says the company has escaped single-vendor dependence on Nvidia via a multi-chip strategy, training and serving Claude across all four major chip families as one interchangeable compute pool. Its frontier model Mythos reportedly wrote or ported nearly 100 percent of the kernels for an AMD GPU migration itself in just three days, versus the usual six to twelve months. The claim directly challenges Nvidia's CUDA moat, and Anthropic plans to deploy up to two gigawatts of AMD Instinct MI455X GPUs.

Hacker News AIT2·Tools
58 pts
Handwritten Notes and Six Hours of Video Teach LLM Inference From Scratch

A developer has open-sourced samir-vllm, a teaching project that builds a small LLM inference engine from scratch in C++ and CUDA, covering everything from loading SafeTensor weights to executing each transformer stage on GPU. It ships with 85 pages of handwritten notes and over six hours of video, explicitly written without AI assistance, making it a solid structured resource for engineers who want to understand inference internals.

IT之家 · IT业界T2·Tools
78 pts
Amazon Open-Sources TorchNeuron to Enable Zero-Modification PyTorch on Trainium Chips

Amazon has released TorchNeuron, an open-source tool that enables developers to run PyTorch code natively on its custom Trainium chips with only a configuration change and no code rewriting. Designed to challenge NVIDIA's CUDA ecosystem dominance, the tool aims to reduce migration costs and enhance hardware agnosticity, debuting at the North American PyTorch Conference.

TechCrunch AIT2·Infra
78 pts
AWS Launches TorchNeuron to Enable Seamless PyTorch Migration to Trainium

AWS released TorchNeuron, a new tool enabling PyTorch-based AI apps to run on Amazon's Trainium chips with just one configuration change and no code rewrite. This move directly targets Nvidia's software moat (CUDA) by decoupling PyTorch from Nvidia hardware, offering developers genuine choice and challenging Nvidia's dominance in AI infrastructure.

Hacker News AIT2·Tools
68 pts
rGPU Open-Sourced: Enables Remote NVIDIA GPU Execution for PyTorch Tensors and CUDA Binaries

rGPU is an open-source tool that offloads computation to remote NVIDIA GPUs while keeping applications local. It offers two integration paths: a native PyTorch device backend supporting `rgpu`, and a CUDA shim intercepting low-level APIs for existing binaries. This solution addresses remote training and inference needs in scenarios with limited local compute or resource isolation requirements.

新智元 (微信公众号)T2·Models
68 pts
HKUST Releases AccelEval: Benchmarking AI for CPU-to-GPU Acceleration

HKUST researchers introduced AccelEval at NeurIPS 2026, the first benchmark evaluating LLMs' ability to convert correct CPU code into efficient GPU implementations. Covering 6 domains, 42 tasks, and 3 input scales, it integrates 43 CUDA optimization strategies to analyze acceleration principles. The study aims to verify if AI can achieve significant end-to-end performance gains while maintaining correctness.