Pinned Loading

1. OpenMOSS/Llamascopium OpenMOSS/Llamascopium Public

   A framework for training, analyzing, and visualizing sparse autoencoders and related interpretability methods

   Python 227 29

2. OpenMOSS/Lorsa OpenMOSS/Lorsa Public

   Low-rank sparse attention decomposition for LLM interpretability; active development continues in Llamascopium

   Python 30

3. Diffusion-BERT Diffusion-BERT Public

   ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

   Python 343 27

4. decoderesearch/SAELens decoderesearch/SAELens Public

   Training Sparse Autoencoders on Language Models

   Python 1.5k 266

5. TransformerLensOrg/TransformerLens TransformerLensOrg/TransformerLens Public

   A library for mechanistic interpretability of GPT-style language models

   Python 3.8k 679

6. OpenMOSS/MOSS OpenMOSS/MOSS Public

   An open-source, tool-augmented conversational language model from Fudan University

   Python 12.2k 1.1k