Filter by type:
Filter by tags:
laya-vllm-cpp
Laya is a multilingual, non-autoregressive System 1 decision model.
Given a state (text, email, ticket, or JSON) and typed questions, it
returns typed answers with mathematically calibrated probabilities in a
single forward pass. It never generates text, so there is nothing to
parse and nothing to hallucinate.
In LocalAI, serve via POST /v1/systemone with this model. The vllm.cpp
engine runs the full decision pipeline (choice, noul, score question
types) through the vllm_decide C ABI, returning the complete
kev-compatible JSON response. ModernBERT-large backbone, 421M params,
512-token context. F16 weights, ~804 MB.
Repository: localaiLicense: apache-2.0
laya-vllm-cpp
Laya is a multilingual, non-autoregressive System 1 decision model. Given a state (text, email, ticket, or JSON) and typed questions, it returns typed answers with mathematically calibrated probabilities in a single forward pass. It never generates text, so there is nothing to parse and nothing to hallucinate. In LocalAI, serve via POST /v1/systemone with this model. The vllm.cpp engine runs the full decision pipeline (choice, noul, score question types) through the vllm_decide C ABI, returning the complete kev-compatible JSON response. ModernBERT-large backbone, 421M params, 512-token context. F16 weights, ~804 MB.
Links
Tags