Open infrastructure for local AI systems: Kubernetes, GPU inference, observability, automation, and deterministic memory.
Pinned Loading
Repositories
- llm-runtime Public
Production-oriented Kubernetes platform for shared local LLM inference, featuring vLLM, OpenAI-compatible APIs, GPU-backed model-serving tiers, observability, network policies, deployment automation, and reusable runtime contracts for multiple AI systems.
- memory-steward Public
A local-first memory admission and context virtualization service for AI systems.
- cluster-info Public
Read-only Kubernetes HTTP API exposing cluster metadata, CRDs, Flux and Helm status, External Secrets, Karpenter resources, Prometheus alerts, and operational data for CI/CD, GitOps automation, and policy tooling.
- anything-llm Public Forked from Mintplex-Labs/anything-llm
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Most used topics
Loading…