prismml

Here are 7 public repositories matching this topic...

carlosfundora / llama.cpp-1-bit-turbo

HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE speculative decoding, and full Wave32 kernel optimizations.

hip quantization bonsai rocm amd-gpu llama-cpp gguf rdna2 turboquant prismml gfx1030

Updated Jun 23, 2026
C++

carlosfundora / sglang-1-bit-turbo

Star

AMD ROCm (gfx1030) inference fork with RotorQuant/TurboQuant KV compression, PHANTOM-X zero-copy draft speculation, EAGLE3 speculative decoding, 12 RDNA2 crash fixes, and PrismML Bonsai Q1_0_G128 1-bit GGUF support.

triton hip bonsai rocm amd-gpu gguf speculative-decoding sglang rdna2 eagle3 turboquant prismml gfx1030 p-eagle radix-cache

Updated Aug 6, 2026
Python

sbenjam1n / Neagari

Star

Navigable Degeneracy in the Roots of 1-Bit Language Models

machine-learning bonsai llms 1-bit-llm prismml

Updated Apr 18, 2026
Jupyter Notebook

eSlider / bonsai-ollama

Sponsor

Star

Ollama-facing HTTP proxy for PrismML Bonsai 1.7B (Q1_0 GGUF) via llama-server; stock Ollama cannot load Q1_0 yet.

golang machine-learning inference bonsai llm llama-cpp llm-inference ollama gguf qwen3 prismml

Updated Apr 22, 2026
Go

Basearchio / Easy-bonsai

Star

One-click Windows setup & launcher for PrismML Bonsai-demo — pick a model, everything else is automated.

windows launcher batch-script bonsai one-click-installer llm llama-cpp local-llm prismml

Updated Jul 23, 2026
Batchfile

Kxrbx / BonsaiCLI

Star

Terminal workspace for chatting with Bonsai AI models locally using the PrismML custom runtime.

cli tui bonsai chatui local-ai prismml

Updated Apr 14, 2026
Go

Kxrbx / BonsaiDesk

Star

Local chat app for running Bonsai GGUF models with streaming responses, built-in Prism runtime management, model switching, runtime diagnostics, and saved conversation history.

react windows prism bonsai chat-ui vite fastapi llama-cpp local-ai gguf prismml

Updated Apr 13, 2026
TypeScript

Add this topic to your repo

To associate your repository with the prismml topic, visit your repo's landing page and select "manage topics."

Learn more