Skip to content
#

internlm

Here are 32 public repositories matching this topic...

deep-fold

Inference stack that keeps LLM weights packed in NF4 for the whole run. Not a new codebook: QLoRA-family NF4, packed once into CHR0. On the GPU each GEMM reconstructs a tile in registers and discards it, a dense layer is never resident. Overflow: two copy slots plus a pinned host tail. Measured on RTX 3080 12 GB.

  • Updated Sep 18, 2026
  • Python

Add this topic to your repo

To associate your repository with the internlm topic, visit your repo's landing page and select "manage topics."

Learn more