Skip to content
#

llmproxy

Here are 8 public repositories matching this topic...

A production-inspired AI platform framework, built module by module: a FastAPI Gateway in front of a provider-agnostic model layer, an agentic Runtime with tool-calling and persisted memory, span-based tracing, an offline evaluation harness, and a containerized, CI-tested deployment path.

  • Updated Jul 23, 2026
  • Python

该组件为基于 Go 构建的高性能 HTTP 反向代理,专用于将客户端请求透明转发至兼容 OpenAI 或 Anthropic 协议的上游服务。在转发的同时,代理以无侵入方式完整捕获每次会话的请求与响应,包括流式传输中产生的所有数据分片,并以 JSONL 格式实时持久化至本地存储。这一机制使每一轮交互均可被精确追溯,从而满足合规审计、行为分析及训练语料构建等需求。系统还提供可选的按日历日合并导出功能,可将当日全部会话记录重组织为统一的行式数据集,直接服务于监督微调、偏好对齐等训练数据的准备工作

  • Updated Jul 16, 2026
  • Go

Add this topic to your repo

To associate your repository with the llmproxy topic, visit your repo's landing page and select "manage topics."

Learn more