Decentralized Inference

A computing paradigm distributing LLM inference tasks across edge devices or node networks rather than relying on single large d