Model Gallery

3 models from 1 repositories

Filter by type:

Filter by tags:

mellum2-12b-a2.5b-instruct
Mellum2-12B-A2.5B-Instruct is an Apache-2.0 mixture-of-experts model from JetBrains with 12 billion total parameters, 2.5 billion activated per token, and a 131,072-token context window. This entry uses the Q4_K_M GGUF quantization.

Repository: localaiLicense: apache-2.0

mellum2-12b-a2.5b-instruct-q8
Mellum2-12B-A2.5B-Instruct is an Apache-2.0 mixture-of-experts model from JetBrains with 12 billion total parameters, 2.5 billion activated per token, and a 131,072-token context window. This entry uses the higher-quality Q8_0 GGUF quantization.

Repository: localaiLicense: apache-2.0

llama-3.2-sun-2.5b-chat
Base Model Llama 3.2 1B Extended Size 1B to 2.5B parameters Extension Method Proprietary technique developed by MedIT Solutions Fine-tuning Open (or open subsets allowing for commercial use) open datasets from HF Open (or open subsets allowing for commercial use) SFT datasets from HF Training Status Current version: chat-1.0.0 Key Features Built on Llama 3.2 architecture Expanded from 1B to 2.47B parameters Optimized for open-ended conversations Incorporates supervised fine-tuning for improved performance Use Case General conversation and task-oriented interactions

Repository: localaiLicense: llama3.2