Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
-
Updated
Jul 5, 2026 - C++
#
open-llm
Here are 13 public repositories matching this topic...
✨ Kubectl plugin to create manifests with LLMs
kubernetes ai openai k8s kubectl gpt hacktoberfest kubectl-plugins openai-api gpt-4 llm chatgpt open-llm localllama
-
Updated
Jan 27, 2025 - Go
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
docker kubernetes ai inference nvidia openai llama gpt gemma mistral fine-tuning finetuning buildkit large-language-models llm chatgpt open-llm open-source-llm localllama mixtral
-
Updated
Aug 31, 2026 - Go
Make local LLM inference faster with chunk-level KV cache reuse
-
Updated
Jul 22, 2026 - Python
The code for HerO: a fact-checking pipeline based on open LLMs (the runner-up in AVeriTeC)
-
Updated
Mar 18, 2025 - Python
400+ free LLM models — Llama, Qwen, DeepSeek, Gemma, Mistral, GLM, Kimi, Nemotron, Command A+, MiniMax. Free API access, daily updated. Compare context windows, rate limits, modalities (text, vision, audio, code).
llama glm gemma mistral kimi open-models ai-models foundation-models llm large-language-model open-llm qwen llm-models deepseek nemotron llm-comparison free-models model-directory llm-catalog llm-list
-
Updated
Aug 10, 2026
Modular, AI-powered IT Operations Platform
agent docker kubernetes ai self-hosted assistant opnsense proxmox homelab infrastructure-automation llm ai-ops open-llm local-ai ollama lm-stu agentic-workflow agentic-ai
-
Updated
Jul 30, 2026 - Python
Nano-Qwen ⚡🧠 - A from-scratch implementation of a light weight Qwen-style transformer designed for clarity and experimentation. Includes an efficient Mixture-of-Experts (MoE) architecture, plus built-in support for parallel and distributed training to scale models from a minimal codebase.
deep-learning optimization routing pytorch transformer moe distributed-training mixture-of-experts parallel-training llm open-llm qwen
-
Updated
Feb 23, 2026 - Python
Add this topic to your repo
To associate your repository with the open-llm topic, visit your repo's landing page and select "manage topics."