llama-cpp-sys-2 — low-level FFI; pulls the llama.cpp backend (the Praecise
fork, synced with upstream llama.cpp 1.0.0 of 2026-11-13; that sync is
built on the CPU only, and no GPU backend has been compiled against it).
llama-cpp-2 — safe Rust bindings, including the speculative-decode primitives.
praecise-hardware — the hardware layer: which accelerators a machine has
(every vendor, read from the operating system), which backend drives each,
what a confined engine needs to reach them, the memory and bandwidth of the
systems worth planning for, and the praecise-hw binary. No dependencies.
praecise-runtime — the backend-agnostic acceleration runtime and inference API.
praecise-host — runtime hosts and the engine set: confined, supervised
engines, one per model, within one memory budget; job engines and the
praecise-job binary.
praecise-remote — generation on an inference API outside the machine
(Groq, Cerebras, SambaNova or any OpenAI-compatible endpoint), in the
runtime's types. Opt-in: nothing opens a connection unless the application
depends on this crate and the operator permits the host.
praecise-ffi — the stable C ABI over the runtime's backend-agnostic types
(config, result, stop reason, error), for callers in other languages.
praecise-diffusion — flow-matching image, video, audio and 3D generation on
the same ggml backend, device and memory budget as the language-model family.
praecise-provenance — signed C2PA content credentials embedded in generated
PNG, WAV and MP4 files, and their verification.
praecise-train — the training substrate: the deterministic replayable step,
the hash-linked step log, content-hashed checkpoints with lineage, objectives,
optimizers and parameter-delta primitives.
praecise-codec — in-process video coding: H.264, H.265 and AV1 decoding
from MP4 and Matroska/WebM, H.264 and AV1 encoding to MP4 (AV1 also to
WebM) with an Opus soundtrack. Generated videos are written as MP4.
praecise-perception — video in, object tracks out: detection on every
decoded frame, ByteTrack, nv.Frame output; the praecise-track binary.
praecise-onnx — the ONNX model families: speech-to-text, object
detection, promptable and text-prompted segmentation, image encoders,
time-series forecasting and text embedding. Sessions register the execution
provider the machine's GPU needs (CUDA and TensorRT, MIGraphX, OpenVINO,
QNN, CANN, CoreML, or DirectML and WebGPU on any vendor's GPU) and refuse a
model they cannot accelerate rather than running it on the CPU. A neural
processor is used when the operator asks for it.
praecise-moe — expert-parallel mixture-of-experts execution: expert FFNs
and gating from safetensors blobs, GGUF block-quantized expert weights, a
memory and disk residency cache, and the combine step, on the CPU
(AVX-512-VNNI, AVX-VNNI, the Arm dot-product extension), CUDA or any other
GPU through wgpu. The cuda feature builds for the CUDA toolkit
that nvcc reports (12 or 13); cuda-12 and cuda-13 pin the version on a
build host without a toolkit.