Pinned Loading

1. LLM-Evaluation-Framework LLM-Evaluation-Framework Public

   Production-grade LLM Evaluation & Benchmarking Framework - GPT-4, Claude, Gemini, Mistral. Accuracy, latency, cost, hallucination, reasoning metrics.

   Python 17

2. BerriAI/litellm BerriAI/litellm Public

   The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…

   Python 57.7k 11.1k

3. tenstorrent/tt-metal tenstorrent/tt-metal Public

   🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

   C++ 1.7k 621

4. rustkvd rustkvd Public

   A distributed key-value store written from scratch in Rust — Raft consensus, an LSM storage engine, consistent hashing, MVCC, and a gRPC API.

   Makefile 5

5. samber/mo samber/mo Public

   🦄 Monads and popular FP abstractions, powered by Go 1.18+ Generics (Option, Result, Either...)

   Go 3.4k 118

6. hymie122/RAG-Survey hymie122/RAG-Survey Public

   Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

   1.8k 123