LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
-
Updated
Oct 22, 2026 - Python
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
🐋MindChat(漫谈):漫谈人生路, 笑对风霜途
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
这是一个基于 Next.js 构建的多语言 AI 模型评估平台,支持多模型对比和实时流式响应。A multilingual AI model evaluation platform built with Next.js, allowing users to compare responses from multiple models and receive a final judgment.
A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬
Collection of Basic Prompt Templates for Various Chat LLMs (Chat LLM 的基础提示模板集合)
AgriMind: The smart LLM application that every farmer truly needs
internlm funetuning
一个Node.js+MySQL后端,React.js前端,Python-Flask调用开源大模型InternLM2-Chat-7B的简单全栈项目
Inference stack that keeps LLM weights packed in NF4 for the whole run. Not a new codebook: QLoRA-family NF4, packed once into CHR0. On the GPU each GEMM reconstructs a tile in registers and discards it, a dense layer is never resident. Overflow: two copy slots plus a pinned host tail. Measured on RTX 3080 12 GB.
OCT 眼科影像智能报告生成系统:ViT + LLM (Qwen3/InternLM2.5) 实现疾病分类、病灶可视化与中文诊断报告生成,含 RAG 检索增强与 Gradio 界面
To associate your repository with the internlm topic, visit your repo's landing page and select "manage topics."