laya-vllm-cpp
Laya is a multilingual, non-autoregressive System 1 decision model.
Given a state (text, email, ticket, or JSON) and typed questions, it
returns typed answers with mathematically calibrated probabilities in a
single forward pass. It never generates text, so there is nothing to
parse and nothing to hallucinate.
In LocalAI, serve via POST /v1/systemone with this model. The vllm.cpp
engine runs the full decision pipeline (choice, noul, score question
types) through the vllm_decide C ABI, returning the complete
kev-compatible JSON response. ModernBERT-large backbone, 421M params,
512-token context. F16 weights, ~804 MB.