Model Gallery

54 models from 1 repositories

Filter by type:

Filter by tags:

Attention: Trust Remote Code is required for this model
wemm-embedding-9b
WeMM-Embedding-9B is Tencent's largest Apache-2.0 multilingual embedding model built on Qwen3.5. This entry serves the original bfloat16 safetensors with LocalAI's Transformers backend and produces 4,096-dimensional normalized embeddings for text retrieval, semantic search, and RAG. The upstream model can also embed images and videos. LocalAI currently exposes text input through its embeddings API for this backend.

Repository: localaiLicense: apache-2.0

ornith-1.0-9b-q4
Ornith-1.0-9B is an MIT-licensed Qwen3.5 model from Ornith AI for agentic coding, reasoning, repository-level software tasks, and tool use. It supports text and image input with a context window of 262K tokens. This default entry uses the Q4_K_M GGUF and F16 vision projector. A higher-quality Q8_0 model is available as a variant.

Repository: localaiLicense: mit

ornith-1.0-9b-q8
Ornith-1.0-9B in the higher-quality Q8_0 GGUF format, with the shared F16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-q4
Ornith-1.5-9B is an MIT-licensed Qwen3.5 model from Ornith AI for agentic coding, reasoning, repository-level software tasks, and tool use. It supports text and image input with a context window of 262K tokens. This default entry uses the Q4_K_M GGUF and BF16 vision projector. Q5_K_M, Q6_K, and Q8_0 models are available as variants.

Repository: localaiLicense: mit

ornith-1.5-9b-q5
Ornith-1.5-9B in the Q5_K_M GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-q6
Ornith-1.5-9B in the Q6_K GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-q8
Ornith-1.5-9B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-obliterated-q4
Ornith-1.5-9B OBLITERATED is a refusal-removed derivative for alignment research, red teaming, coding, reasoning, and agentic tasks. Its safety guardrails are removed, and the publisher reports some capability loss compared with the original model. This default entry uses the Q4_K_M GGUF and BF16 vision projector. The linked variant uses the higher-quality Q8_0 quantization.

Repository: localaiLicense: mit

ornith-1.5-9b-obliterated-q8
Ornith-1.5-9B OBLITERATED in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector. Its safety guardrails are removed, and the publisher recommends this quantization for better behavior fidelity.

Repository: localaiLicense: mit

qwen3.8-9b-q4
Qwen3.8-9B is Empero AI's full-parameter distillation of Qwen3.8 2.4T A95B into the dense Qwen3.5-9B architecture. It targets reasoning, mathematics, coding, instruction following, and tool use, and supports a native 262K-token context window. This default entry uses Q4_K_M weights; a higher-quality Q8_0 build is available as a variant.

Repository: localaiLicense: apache-2.0

qwen3.8-9b-q8
Qwen3.8-9B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.5-9b-defiant-fable-mtp
Qwen3.5 9B Defiant Fable is an Apache-2.0 multimodal fine-tune for reasoning, coding, creative writing, and roleplay. It retains the 256K context window and vision support of Qwen3.5 while reducing refusals. This default entry uses the NEO-imatrix Q4_K_M build with multi-token prediction enabled for faster generation.

Repository: localaiLicense: apache-2.0

qwen3.5-9b-defiant-fable
Qwen3.5 9B Defiant Fable in the plain NEO-imatrix Q4_K_M GGUF format. This fallback offers the same multimodal reasoning, coding, and creative capabilities without enabling multi-token prediction.

Repository: localaiLicense: apache-2.0

qwen3.5-9b-defiant-fable-q8-mtp
Qwen3.5 9B Defiant Fable in Q8_0 GGUF format for multimodal reasoning, coding, and creative writing. Includes the matching BF16 vision projector. Enables multi-token prediction with the MTP weights.

Repository: localaiLicense: apache-2.0

qwen3.5-9b-defiant-fable-q8
Qwen3.5 9B Defiant Fable in Q8_0 GGUF format for multimodal reasoning, coding, and creative writing. Includes the matching BF16 vision projector. Uses ordinary decoding without multi-token prediction.

Repository: localaiLicense: apache-2.0

qwen3.8-9b-distill-q4
Qwen3.8 9B Distill is an Apache-2.0, text-only Qwen3.5 9B fine-tune distilled from Qwen3.8 2.4T A95B reasoning traces. It targets mathematics, coding, instruction following, and function calling with a 262K native context window. This entry uses the balanced Q4_K_M GGUF quantization; the Q8_0 variant offers higher fidelity.

Repository: localaiLicense: apache-2.0

qwen3.8-9b-distill-q8
Qwen3.8 9B Distill in the higher-fidelity Q8_0 GGUF format. This text-only Qwen3.5 9B fine-tune targets reasoning, coding, instruction following, and function calling with a 262K native context window.

Repository: localaiLicense: apache-2.0

qwythos-9b-v2
Empero AI # Qwythos-9B-v2 — the new and improved Qwythos The next iteration of Qwythos: **all the reasoning of Qwythos-9B, with the looping behavior fixed.** v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use. - 🔁 **Looping behavior eliminated** — repetition/degeneration under greedy or low-temperature decoding dropped from **6.7% → 0%**. You can serve it *without* leaning on `repetition_penalty` as a band-aid. - 🧠 **Reasoning fully preserved** — MMLU, GSM8K, GPQA, ARC and HumanEval are all held at (or above) the v1 level. This is a *hygiene* upgrade, not a capability regression. - 🧩 **MTP head restored** — the native multi-token-prediction module (dropped in the previous export) is back, so config and weights agree and speculative-decoding setups work. - 🪪 **Cleaner identity** — the model no longer prefaces unrelated answers with its identity; it introduces itself only when you actually ask. - 🔓 **Still intentionally uncensored** for research, cybersecurity, red-teaming, biology, chemistry, pharmacology and clinical work. - 📜 **St ...

Repository: localaiLicense: apache-2.0

ornith-1.0-9b-mtp
[](https://deep-reinforce.com/ornith.html) # Ornith-1.0-9B Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. Highlights: - **State-of-the-Art Coding Agents**: Available in 9B-Dense, 31B-Dense, 35B-MoE, and 397B-MoE (post-trained on top of Gemma 4 and Qwen 3.5), achieving state-of-the-art performance among open-source models of comparable size on coding benchmarks such as Terminal-Bench 2.1, SWE-Bench, NL2Repo and OpenClaw. - **Self-Improving Training Framework**:  Ornith-1.0 employs RL to learn to generate not only solution rollouts, but also the scallfold that drive those rollouts. By jointly optimizing the scaffold and the resulting solution, the model discovers better search trajectories and generates higher-quality solutions. - **Licence**: MIT licensed, globally accessible, and free from regional limitations. ## Ornith 1.0 9B This model card documents **Ornith-1.0-9B**, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. ### Benchmarks Ornith-1.0-9B Qwen3.5-9B Qwen3.5-35B Gemma4-12B Gemma4-31B Agentic Coding ...

Repository: localaiLicense: mit

ornith-1.0-9b
[](https://deep-reinforce.com/ornith.html) # Ornith-1.0-9B-GGUF Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. Highlights: - **State-of-the-Art Coding Agents**: Available in 9B-Dense, 31B-Dense, 35B-MoE, and 397B-MoE (post-trained on top of Gemma 4 and Qwen 3.5), achieving state-of-the-art performance among open-source models of comparable size on coding benchmarks such as Terminal-Bench 2.1, SWE-Bench, NL2Repo and OpenClaw. - **Self-Improving Training Framework**:  Ornith-1.0 employs RL to learn to generate not only solution rollouts, but also the scallfold that drive those rollouts. By jointly optimizing the scaffold and the resulting solution, the model discovers better search trajectories and generates higher-quality solutions. - **Licence**: MIT licensed, globally accessible, and free from regional limitations. ## Ornith 1.0 9B This model card documents **Ornith-1.0-9B**, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. ### Benchmarks Ornith-1.0-9B Qwen3.5-9B Qwen3.5-35B Gemma4-12B Gemma4-31B Agentic Coding ...

Repository: localaiLicense: mit

qwen3.5-9b-hauhaucs-aggressive
Qwen3.5 9B Aggressive is HauhauCS's refusal-removed fine-tune of the multimodal Qwen3.5 9B model. It retains the base model's reasoning, tool use, image and video understanding, and 262K-token native context window. This entry uses the balanced Q4_K_M GGUF quantization and includes the matching BF16 multimodal projector. The Q8_0 variant offers higher fidelity.

Repository: localaiLicense: apache-2.0

Page 1