Filter by type:
Filter by tags:
qwen3.6-35b-a3b-uncensored-genesis-hermes-v6
# Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
> **Join the Discord** for updates, roadmaps, projects, or just to chat.
Qwen3.6-35B-A3B uncensored by HauhauCS. **0/465 Refusals.**
> **HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants** — it may show fewer files than actually exist. Click **"View +X variants"** or go to **Files and versions** to see all available downloads.
## About
No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended - just without the refusals.
These are meant to be the best lossless uncensored models out there.
## Aggressive Variant
Stronger uncensoring — model is fully unlocked and won't refuse prompts. May occasionally append short disclaimers (baked into base model training, not refusals) but full content is always generated.
For a more conservative uncensor that keeps some safety guardrails, check the Balanced variant when it's available.
## Downloads
All quants generated with importance matrix (imatrix) for optimal quality preservation on abliterated weights.
## What are K_P quants?
...
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-q8
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry uses the higher-quality Q8_0 GGUF quantization.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-quality
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-balanced
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-compact
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-mini
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-quality
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-balanced
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-compact
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
qwen3.6-27b-fable-fusion-711-uncensored-heretic-nm-dau-neo-max-mtp
Important: This is the first fine tune to exceed 700 "arc-c" (The OpenAI, Claude and Gemini "zone of intelligence") in both 8 bit and 4 bit. This repo contains both "regular" and "MTP" Neo MAX Imatrix quants.
Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF
The strongest, smartest open source multi-stage model fine tune for consumer hardware ever and BUILT on consumer hardware via Unsloth.
The first model of this size/type to breach "700" ARC-C in both 8 bit and 4 bit; hench the "711" in the name.
This model (both 4 bit and 8 bit) exceeds the base Qwen 3.6 27B in 6 out of 7 benchmarks, and matches it on the 7th AND exceeds all 7 benchmarks for Qwen3.6-35B-A3B.
The 700 "intelligence club" is reserved for OpenAI, Claude and Gemini closed source models.
This is the one they fear.
This is a multi-stage fine tune, multi-fine tune, and multi-stage merge.
A Colab between myself (multiple fine tunes, including multi-stage), Nightmedia (merge/benching), TeichAI (Polaris Dataset), armand0e (Light fable 5 traces) and trohrbaugh (heretic'ing the model).
...
Repository: localaiLicense: apache-2.0
bonsai-8b-1bit
Bonsai 8B (PrismML) is an end-to-end 1-bit language model built on the Qwen3-8B dense
architecture (GQA, SwiGLU, RoPE, RMSNorm, 36 layers, 65,536 context). Every weight is a
single sign bit (`-scale` / `+scale`) with one FP16 scale per group of 128 weights, for
an effective 1.125 bits/weight and a ~1.15 GB footprint (14.2x smaller than FP16) while
matching full-precision 8B instruct models at ~70.5 average across 6 benchmark
categories.
The Q1_0 quantization is only decodable by the PrismML llama.cpp fork, so this entry
runs on LocalAI's `bonsai` backend (that fork), not the stock `llama-cpp` backend.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-8b
Ternary Bonsai 8B (PrismML) is a 1.58-bit ternary language model on the Qwen3-8B dense
architecture. Each weight takes a value from {-1, 0, +1} with one shared FP16 scale per
group of 128 weights (GGUF Q2_0, ~2.18 GB deployed, 7.5x smaller than FP16). The extra
zero state recovers more of the full-precision model than the 1-bit build: it ranks 2nd
among compared 6-9B models at 75.5 average despite being ~1/8th their size.
Q2_0 is the recommended, ternary-lossless variant. The Q2_0 kernels are only in the
PrismML llama.cpp fork, so this runs on LocalAI's `bonsai` backend. License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-8b-q2-g64
Ternary Bonsai 8B (PrismML), GGUF Q2_0 with group-64 packing (each FP16 scale shared
across 64 weights instead of 128). Slightly larger (~2.31 GB) but matches llama.cpp's
native 64-value Q2_0 block layout. Runs on LocalAI's `bonsai` backend. License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-8b-pq2
Ternary Bonsai 8B (PrismML), GGUF PQ2_0 (packed Q2_0) ternary variant (~2.18 GB).
Same {-1, 0, +1} weight alphabet as Q2_0. Runs on LocalAI's `bonsai` backend.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
bonsai-27b-1bit
Bonsai 27B (PrismML) is a full 27B-class reasoning model in end-to-end 1-bit weights,
derived from the Qwen3.6-27B hybrid-attention backbone (~75% linear attention, 262K
context). At a true 1.125 bits/weight it deploys in ~3.9 GB (~14.2x smaller than FP16)
while retaining 89.5% of FP16 intelligence across 15 thinking-mode benchmarks (math
91.66, coding 81.88). Ships an optional 4-bit vision tower (mmproj) for image input,
included here.
The Q1_0_g128 weights and hybrid-attention kernels are only in the PrismML llama.cpp
fork, so this runs on LocalAI's `bonsai` backend. A GPU is recommended. License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-27b
Ternary Bonsai 27B (PrismML) is the quality-oriented operating point of the Bonsai 27B
family: full 27B-class reasoning in ternary {-1, 0, +1} weights on the Qwen3.6-27B
hybrid-attention backbone (262K context). At a true 1.71 bits/weight it deploys in
~7.2 GB (GGUF Q2_0_g128) and retains 95% of FP16 intelligence (80.49 average across 15
thinking-mode benchmarks) - a higher score than a conventional IQ2_XXS build at less
than two-thirds its footprint. Ships an optional 4-bit vision tower (mmproj), included.
The Q2_0 weights and hybrid-attention kernels are only in the PrismML llama.cpp fork,
so this runs on LocalAI's `bonsai` backend. A GPU is recommended. License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-27b-pq2
Ternary Bonsai 27B (PrismML), GGUF PQ2_0 (packed Q2_0) ternary variant (~7.17 GB) with
the 4-bit vision tower (mmproj) included. Runs on LocalAI's `bonsai` backend.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
ternary-bonsai-27b-q2-g64
Ternary Bonsai 27B (PrismML), GGUF Q2_0 with group-64 packing (~7.59 GB), matching
llama.cpp's native 64-value Q2_0 block layout, with the 4-bit vision tower (mmproj)
included. Runs on LocalAI's `bonsai` backend. License: Apache 2.0.
Repository: localaiLicense: apache-2.0
qwen-agentworld-35b-a3b
# Qwen-AgentWorld-35B-A3B
📑 Technical Report |
📖 Blog |
🤗 Hugging Face |
🤖 ModelScope |
💻 GitHub |
🖥️ Demo
> [!Note]
> This repository contains the model weights and configuration files for **Qwen-AgentWorld-35B-A3B**, a native language world model trained for agentic environment simulation.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, etc.
**Qwen-AgentWorld** is the first language world model to cover seven agent interaction domains within a single model. It simulates agentic environments via long chain-of-thought reasoning, predicting the next environment state given an agent's action and interaction history. Trained through a three-stage pipeline — CPT injects environment knowledge, SFT activates next-state-prediction reasoning, RL sharpens simulation fidelity — Qwen-AgentWorld is a **native world model**: environment modeling is the training objective from the CPT stage onward, not a post-hoc add-on.
## Highlights
...
Repository: localaiLicense: apache-2.0
qwen3-4b-dflash
Qwen3-4B paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend. This is the canonical DFlash pairing documented upstream (`z-lab/Qwen3-4B-DFlash` + `Qwen/Qwen3-4B`).
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The Q4_K_M file carries the full Qwen3-4B target; the ~0.5 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0 (Qwen3-4B target) / MIT (z-lab DFlash drafter).
Repository: localaiLicense: apache-2.0
Page 1