Filter by type:
Filter by tags:
pocket-26b
POCKET-26B is an Apache-2.0 Gemma 4 26B-A4B mixture-of-experts model from
FINAL-Bench/VIDRAFT, tuned for Korean and packaged for stock llama.cpp.
This entry uses the quality-oriented Q4_K_M GGUF quantization.
Repository: localaiLicense: apache-2.0
pocket-26b-q2
POCKET-26B is an Apache-2.0 Gemma 4 26B-A4B mixture-of-experts model from
FINAL-Bench/VIDRAFT, tuned for Korean and packaged for stock llama.cpp.
This entry uses the smaller Q2_K GGUF quantization.
Repository: localaiLicense: apache-2.0
privacy-filter-multilingual
A multilingual PII token-classification model: a fine-tune of
openai/privacy-filter by OpenMed. It labels every token with a BIOES tag
over 54 PII categories (217 classes) across 16 languages (ar, bn, de, en,
es, fr, hi, it, ja, ko, nl, pt, te, tr, vi, zh), spanning identity, contact,
address, financial, vehicle, digital, and crypto entities.
In LocalAI this is a PII detector for the NER redactor tier: set
known_usecases to [token_classify] (as below), and any model opts into
redaction by listing this one under pii.detectors. The detection policy
(which categories to mask vs block, and the score threshold) lives on this
model's own pii_detection block - see the overrides below. It runs locally
with no Python, served by the standalone privacy-filter backend's
TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset
entity spans).
Architecture: gpt-oss-style sparse MoE (8 layers, 128 experts top-4, ~50M
active per token), bidirectional banded attention, o200k tokenizer; served
via the openai-privacy-filter architecture. F16, ~2.7 GB.
Repository: localaiLicense: apache-2.0
kokoro-multi-lang-v1.0-sherpa
Kokoro multi-lingual TTS (v1.0, int8) served through the sherpa-onnx backend with native streaming TTS. A single model covers many languages and speakers (English, Italian, Spanish, French, German and more) via a built-in voices bank; espeak-ng data and per-language lexicons ship with it. Select a speaker with the `voice` parameter (numeric speaker id) and optionally pass `language=` to hint the language.
Repository: localaiLicense: apache-2.0
supertonic-3
Supertonic multilingual text-to-speech (Supertone/supertonic-3), served through the native supertonic backend via ONNX Runtime. Lightning-fast on-device flow-matching TTS with 44.1 kHz output, 31 languages, and 10 preset voice styles (F1-F5, M1-M5). No espeak-ng dependency. Defaults to voice F1; override per request with the OpenAI `voice` field, and optionally pass `language=` (e.g. en, ko, ja, it; "na" for language-agnostic).
Repository: localaiLicense: mit
magpie-tts-cpp-357m-q8_0
Magpie TTS Multilingual 357M (C++/ggml, magpie-tts.cpp), Q8_0 (~624 MB), near-lossless
and the fastest decode. Native C++ text-to-speech for NVIDIA's Magpie TTS Multilingual
(encoder + autoregressive decoder over NanoCodec tokens) from one self-contained GGUF
(model, codec, tokenizer, G2P dictionaries). 22.05kHz mono, 5 baked voices (set `voice`
to Aria, Jason, John, Leo, Sofia or 0-4), 9+ languages (en, es, de, fr, it, pt-BR, hi,
vi, ko, plus Arabic variants). Parity-gated per component against the NeMo reference.
Repository: localaiLicense: other
glm-4.7-flash-derestricted
This model is a quantized version of the original GLM-4.7-Flash-Derestricted model, derived from the base model `koute/GLM-4.7-Flash-Derestricted`. It is designed for restricted use, featuring tags like "derestricted," "uncensored," and "unlimited." The quantized versions (e.g., Q2_K, Q4_K_S, Q6_K) offer varying trade-offs between accuracy and efficiency, with the Q4_K_S and Q6_K variants being recommended for balanced performance. The model is optimized for fast inference and supports multiple quantization schemes, though some advanced quantization options (like IQ4_XS) are not available. It is intended for use in environments with specific constraints or restrictions.
Repository: localaiLicense: mit
aurore-reveil_koto-small-7b-it
Koto-Small-7B-IT is an instruct-tuned version of Koto-Small-7B-PT, which was trained on MiMo-7B-Base for almost a billion tokens of creative-writing data. This model is meant for roleplaying and instruct usecases.
Repository: localaiLicense: mit
kokoro
Kokoro is an open-weight TTS model with 82 million parametrs. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects.
Repository: localaiLicense: apache-2.0
kokoros
Kokoros is a pure Rust TTS backend using the Kokoro v1.0 ONNX model (82M parameters).
Fast, streaming TTS with high quality. American English with af_heart voice.
Repository: localaiLicense: apache-2.0
kokoros-ja
Kokoros Rust TTS - Japanese. Uses the Kokoro v1.0 ONNX model with Japanese phonemization.
Repository: localaiLicense: apache-2.0
kokoros-cmn
Kokoros Rust TTS - Mandarin Chinese.
Repository: localaiLicense: apache-2.0
kokoros-de
Kokoros Rust TTS - German.
Repository: localaiLicense: apache-2.0
openbuddy_openbuddy-r1-0528-distill-qwen3-32b-preview0-qat
OpenBuddy distillation of Qwen3-32B from DeepSeek-R1, featuring 40K context window and multilingual support (zh, en, fr, de, ja, ko, it, fi). GGUF quantized version optimized for local inference with llama.cpp.
Repository: localaiLicense: apache-2.0
l3.3-prikol-70b-v0.2
A merge of some Llama 3.3 models because um uh yeah
Went extra schizo on the recipe, hoping for an extra fun result, and... Well, I guess it's an overall improvement over the previous revision. It's a tiny bit smarter, has even more distinct swipes and nice dialogues, but for some reason it's damn sloppy.
I've published the second step of this merge as a separate model, and I'd say the results are more interesting, but not as usable as this one. https://huggingface.co/Nohobby/AbominationSnowPig
Prompt format: Llama3 OR Llama3 Context and ChatML Instruct. It actually works a bit better this way
Repository: localaiLicense: llama3.3
nohobby_l3.3-prikol-70b-v0.4
I have yet to try it UPD: it sucks, bleh
Sometimes mistakes {{user}} for {{char}} and can't think. Other than that, the behavior is similar to the predecessors.
It sometimes gives some funny replies tho, yay!
Repository: localaiLicense: llama3.3
nohobby_l3.3-prikol-70b-v0.5
99% of mergekit addicts quit before they hit it big.
Gosh, I need to create an org for my test runs - my profile looks like a dumpster.
What was it again? Ah, the new model.
Exactly what I wanted. All I had to do was yank out the cursed official DeepSeek distill and here we are.
From the brief tests it gave me some unusual takes on the character cards I'm used to. Just this makes it worth it imo. Also the writing is kinda nice.
Repository: localaiLicense: llama3.3
nohobby_l3.3-prikol-70b-extra
After banging my head against the wall some more - I actually managed to merge DeepSeek distill into my mess! Along with even more models (my hand just slipped, I swear)
The prose is better than in v0.5, but has a different feel to it, so I guess it's more of a step to the side than forward (hence the title EXTRA instead of 0.6).
The context recall may have improved, or I'm just gaslighting myself to think so.
And of course, since it now has DeepSeek in it - tags!
They kinda work out of the box if you add to the 'Start Reply With' field in ST - that way the model will write a really short character thought in it. However, if we want some OOC reasoning, things get trickier.
My initial thought was that this model could be instructed to use either only for {{char}}'s inner monologue or for detached analysis, but actually it would end up writing character thoughts most of the time anyway, and the times when it did reason stuff it threw the narrative out of the window by making it too formal and even adding some notes at the end.
Repository: localaiLicense: llama3.3
loki-v2.6-8b-1024k
The following models were included in the merge:
MrRobotoAI/Epic_Fiction-8b
MrRobotoAI/Unaligned-RP-Base-8b-1024k
MrRobotoAI/Loki-.Epic_Fiction.-8b
Casual-Autopsy/L3-Luna-8B
Casual-Autopsy/L3-Super-Nova-RP-8B
Casual-Autopsy/L3-Umbral-Mind-RP-v3.0-8B
Casual-Autopsy/Halu-L3-Stheno-BlackOasis-8B
Undi95/Llama-3-LewdPlay-8B
Undi95/Llama-3-LewdPlay-8B-evo
Undi95/Llama-3-Unholy-8B
ChaoticNeutrals/Hathor_Tahsin-L3-8B-v0.9
ChaoticNeutrals/Hathor_RP-v.01-L3-8B
ChaoticNeutrals/Domain-Fusion-L3-8B
ChaoticNeutrals/T-900-8B
ChaoticNeutrals/Poppy_Porpoise-1.4-L3-8B
ChaoticNeutrals/Templar_v1_8B
ChaoticNeutrals/Hathor_Respawn-L3-8B-v0.8
ChaoticNeutrals/Sekhmet_Gimmel-L3.1-8B-v0.3
zeroblu3/LewdPoppy-8B-RP
tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
jeiku/Chaos_RP_l3_8B
tannedbum/L3-Nymeria-Maid-8B
Nekochu/Luminia-8B-RP
vicgalle/Humanish-Roleplay-Llama-3.1-8B
saishf/SOVLish-Maid-L3-8B
Dogge/llama-3-8B-instruct-Bluemoon-Freedom-RP
MrRobotoAI/Epic_Fiction-8b-v4
maldv/badger-lambda-0-llama-3-8b
maldv/llama-3-fantasy-writer-8b
maldv/badger-kappa-llama-3-8b
maldv/badger-mu-llama-3-8b
maldv/badger-lambda-llama-3-8b
maldv/badger-iota-llama-3-8b
maldv/badger-writer-llama-3-8b
Magpie-Align/MagpieLM-8B-Chat-v0.1
nbeerbower/llama-3-gutenberg-8B
nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
nbeerbower/llama-3-spicy-abliterated-stella-8B
Magpie-Align/MagpieLM-8B-SFT-v0.1
NeverSleep/Llama-3-Lumimaid-8B-v0.1
mlabonne/NeuralDaredevil-8B-abliterated
mlabonne/Daredevil-8B-abliterated
NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
nothingiisreal/L3-8B-Instruct-Abliterated-DWP
openchat/openchat-3.6-8b-20240522
turboderp/llama3-turbcat-instruct-8b
UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
Undi95/Llama-3-LewdPlay-8B
TIGER-Lab/MAmmoTH2-8B-Plus
OwenArli/Awanllm-Llama-3-8B-Cumulus-v1.0
refuelai/Llama-3-Refueled
SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha
NousResearch/Hermes-2-Theta-Llama-3-8B
ResplendentAI/Nymph_8B
grimjim/Llama-3-Oasis-v1-OAS-8B
flammenai/Mahou-1.3b-llama3-8B
lemon07r/Llama-3-RedMagic4-8B
grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B
grimjim/Llama-Nephilim-Metamorphosis-v2-8B
lemon07r/Lllama-3-RedElixir-8B
grimjim/Llama-3-Perky-Pat-Instruct-8B
ChaoticNeutrals/Hathor_RP-v.01-L3-8B
grimjim/llama-3-Nephilim-v2.1-8B
ChaoticNeutrals/Hathor_Respawn-L3-8B-v0.8
migtissera/Llama-3-8B-Synthia-v3.5
Locutusque/Llama-3-Hercules-5.0-8B
WhiteRabbitNeo/Llama-3-WhiteRabbitNeo-8B-v2.0
VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
iRyanBell/ARC1-II
HPAI-BSC/Llama3-Aloe-8B-Alpha
HaitameLaf/Llama-3-8B-StoryGenerator
failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
Undi95/Llama-3-Unholy-8B
ajibawa-2023/Uncensored-Frank-Llama-3-8B
ajibawa-2023/SlimOrca-Llama-3-8B
ChaoticNeutrals/Templar_v1_8B
aifeifei798/llama3-8B-DarkIdol-2.2-Uncensored-1048K
ChaoticNeutrals/Hathor_Tahsin-L3-8B-v0.9
Blackroot/Llama-3-Gamma-Twist
FPHam/L3-8B-Everything-COT
Blackroot/Llama-3-LongStory
ChaoticNeutrals/Sekhmet_Gimmel-L3.1-8B-v0.3
abacusai/Llama-3-Smaug-8B
Khetterman/CursedMatrix-8B-v9
ajibawa-2023/Scarlett-Llama-3-8B-v1.0
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/physics_non_masked
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/electrical_engineering
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/college_chemistry
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/philosophy_non_masked
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/college_physics
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/philosophy
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/formal_logic
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/philosophy_100
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/conceptual_physics
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/college_computer_science
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/psychology_non_masked
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/psychology
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Blackroot/Llama3-RP-Lora
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Llama-3-LimaRP-Instruct-LoRA-8B
MrRobotoAI/Unaligned-RP-Base-8b-1024k + nothingiisreal/llama3-8B-DWP-lora
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/world_religions
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/high_school_european_history
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/electrical_engineering
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Llama-3-8B-Abomination-LORA
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Llama-3-LongStory-LORA
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/human_sexuality
MrRobotoAI/Unaligned-RP-Base-8b-1024k + surya-narayanan/sociology
MrRobotoAI/Unaligned-RP-Base-8b-1024k + ResplendentAI/Theory_of_Mind_Llama3
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Smarts_Llama3
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Llama-3-LongStory-LORA
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/Nimue-8B
MrRobotoAI/Unaligned-RP-Base-8b-1024k + vincentyandex/lora_llama3_chunked_novel_bs128
MrRobotoAI/Unaligned-RP-Base-8b-1024k + ResplendentAI/Aura_Llama3
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Azazelle/L3-Daybreak-8b-lora
MrRobotoAI/Unaligned-RP-Base-8b-1024k + ResplendentAI/Luna_Llama3
MrRobotoAI/Unaligned-RP-Base-8b-1024k + nicce/story-mixtral-8x7b-lora
MrRobotoAI/Unaligned-RP-Base-8b-1024k + Blackroot/Llama-3-LongStory-LORA
MrRobotoAI/Unaligned-RP-Base-8b-1024k + ResplendentAI/NoWarning_Llama3
MrRobotoAI/Unaligned-RP-Base-8b-1024k + ResplendentAI/BlueMoon_Llama3
Repository: localaiLicense: llama3.1
llmevollama-3.1-8b-v0.1-i1
This project aims to optimize model merging by integrating LLMs into evolutionary strategies in a novel way. Instead of using the CMA-ES approach, the goal is to improve model optimization by leveraging the search capabilities of LLMs to explore the parameter space more efficiently and adjust the search scope based on high-performing solutions.
Currently, the project supports optimization only within the Parameter Space, but I plan to extend its functionality to enable merging and optimization in the Data Flow Space as well. This will further enhance model merging by optimizing the interaction between data flow and parameters.
Repository: localaiLicense: llama3.1
hamanasu-adventure-4b-i1
Thanks to PocketDoc's Adventure datasets and taking his Dangerous Winds models as inspiration, I was able to finetune a small Adventure model that HATES the User
The model is suited for Text Adventure, All thanks to Tav for funding the train.
Support me and my finetunes on Ko-Fi https://ko-fi.com/deltavector
Repository: localaiLicense: llama3.1
Page 1