Termsslug: context-engine

Context Engine

上下文引擎

Orchestrator that selects, filters, ranks, compresses, and secures information before it reaches the LLM inference endpoint.

Curated Intelligence

2 items · Page 1/1
量子位官网T2·Infra
58 pts
Shishi Tech Claims 2.48x Faster AI Video Inference with Adaptive Caching

Shishi Tech released a multimodal model serving product that combines residual-based adaptive caching, SGLang cache management, modality-aware token compression and a Context Engine to speed up video generation. Under its own test setup it reports a 2.48x end-to-end speedup versus a dense baseline while preserving output quality, trading cache reuse against error recalibration rather than simply cutting steps.

InfoQ 中文T2·Agents
62 pts
Context Engine Emerges as Core Infrastructure for Agentic AI

The article argues that the bottleneck in agentic AI has shifted from retrieval to context governance, proposing a split of context, memory, and knowledge into three distinct components orchestrated by a 'context as control plane' paradigm. Its core claim: the model generates, while a surrounding context engine decides what the model can see, suppressing hallucination and cost blowup at the architectural level.