Toolsslug: litellmOfficial Website

LiteLLM

Open-source LLM gateway and SDK unifying multiple model providers behind an OpenAI-compatible interface.

Curated Intelligence

2 items · Page 1/1
AWS Machine Learning BlogT1·Tools
62 pts
NVIDIA Open Sources Switchyard to Route Coding Agents by Task Cost

NVIDIA has open sourced NeMo Switchyard, a library that dynamically picks which model handles each coding-agent request on Amazon Bedrock, with LiteLLM integration offering strategies such as stage routing. The post argues routing should be judged by cost per solved task rather than per-token price, since agent tasks span many turns and retries.

AWS Machine Learning BlogT1·Tools
52 pts
Building a Self-Service LLM Gateway with Amazon Bedrock and LiteLLM

An AWS blog post shows how to build a self-service LLM gateway using Amazon Bedrock Application Inference Profiles with LiteLLM on AWS Fargate, abstracting Bedrock behind an OpenAI-compatible API. Developers get a single key to access foundation models, while platform teams gain per-user cost attribution, latency and error observability, and consistent access controls.

LiteLLM | Today for AI