Introduction
A backend-agnostic inference-acceleration layer for large language models.
Praecise Engine sits between an application and an inference backend and speeds up token generation — through speculative decoding, hardware-aware tuning, and a uniform serving surface — without the application needing to know which backend is underneath. llama.cpp is the first supported backend.
It is as agnostic about silicon as it is about backends. NVIDIA, AMD, Intel, Apple, Qualcomm, Arm, Huawei and the rest are each reached by a route that is named, built and tested as far as it can be without the device, and none is the default. docs/hardware.md says what is supported on each and how far each claim has been proved; docs/silicon-coverage.md is the plan behind it.