Termsslug: openai-compatible-api

OpenAI-compatible API

OpenAI 兼容 API

Third-party model calling protocols that adhere to OpenAI's standard interface specifications.

Curated Intelligence

3 items · Page 1/1
Simon Willison 博客T2·Tools
45 pts
LLM CLI v0.37 Adds Multimodal Embeddings and Endpoint Config

Simon Willison's LLM CLI tool and Python library released version 0.37, introducing a command to easily configure OpenAI-compatible endpoints. The update switches the default model to the cheaper gpt-6-luna and enhances embedding support for multimodal binary content including text, audio, and images. The author also notes that while the project receives many AI-assisted pull requests, large language models are effectively used to triage and review these contributions.

AWS Machine Learning BlogT1·Tools
42 pts
AWS SageMaker Integrates llama.cpp for Quantized Decision Model Deployment and SemIf Extensions

Amazon SageMaker AI introduces a llama.cpp-based Deep Learning Container for serving quantized decision models on CPU or GPU infrastructure. The solution provides an OpenAI-compatible interface via InvokeEndpoint and integrates SemIf to enhance scoring capabilities for fixed-choice tasks like request routing and policy assignment.

Hugging Face BlogT1·Tools
48 pts
Run vLLM Server on HF Jobs in One Command

Hugging Face enables one-command deployment of private, OpenAI-compatible vLLM endpoints on HF Jobs via the `huggingface_hub` CLI. This serverless, pay-per-second solution eliminates infrastructure provisioning for quick testing and batch generation, complementing the production-oriented Inference Endpoints.