๐ 6 ร 80GB A100s ร 4.5 hours to improve BAGEL on the reported generation and editing benchmarks. See the results and training settings below.
-fcd022?style=for-the-badge&logo=huggingface&logoColor=000){kind=icon}
Improving image generation through visual understanding. Reconstruction Alignment (RecA) is a self-supervised post-training method for pretrained unified multimodal models (UMMs). It trains a model to reconstruct images from its own visual understanding features, using the original images as targets instead of image-specific captions. This semantic reconstruction objective transfers to text-to-image generation and image editing while preserving the model's original inference interface.
๐ Want to try RecA on your own architecture? Please read our Reproduction Guide or its Chinese Version first! It contains crucial details and insights that are essential for successful reproduction.
- 2026.1.9: RecA is verified on MMaDA! Many thanks to Lin Xu!
- 2025.12.6: Show-o training code is released! And we add a reproduction guide for people to better understand RecA!
- 2025.12.5: ๐ฅ We evaluate our fine-tuned model on T2I-Compbench. Many thanks to Weiyang!
- 2025.12.5: OpenUni training code is released!
- 2025.9.15: ๐ฅ Add NF4, INT8, DF11 version of BAGEL-RecA! Thank to @theunlikely!
- 2025.9.14: ๐ฅ Add ComfyUI guide! Try BAGEL-RecA in ComfyUI!
- 2025.9.11: Harmon training code is released!
- 2025.9.10: BAGEL training code is released! Harmon training code will be released soon.
- 2025.9.9: Our finetuned weights and arXiv paper are available! We expect to release the training code tomorrow.
- Method Overview
- ๐ง Quick Start
- ๐ Model Zoo
- ๐ญ Results
- ๐จ Edit Comparison
- ๐ง TODO
- ๏ฟฝ Acknowledgments
- ๐ License
- ๏ฟฝ๐ฎ Contact
- ๐ Citation
- Online Demo: Try out our enhanced BAGEL-RecA demo on Hugging Face Spaces!
- ComfyUI: see ComfyUI-BAGEL. The usage is totally the same as the original ComfyUI-BAGEL but you should replace the BAGEL weight
models/bagel/BAGEL-7B-MoT/ema.safetensorswith RecA-tuned one. The ComfyUI-BAGEL repo already supports the NF4 and INT8 conversion of BAGEL.
wget https://huggingface.co/sanaka87/BAGEL-RecA/blob/main/model_bf16.safetensors
mv model_bf16.safetensors models/bagel/BAGEL-7B-MoT/ema.safetensorsYou can also download weight of NF4 and INT8 version of BAGEL in BAGEL-RecA. DF11 version BAGEL-RecA (heartfelt thank to @theunlikely !!!).
-
Local Setup: Follow the instructions in the BAGEL Installation Guide to set up the environment, and run
BAGEL/inference.ipynbto test the model locally! -
Full Training & Evaluation: For detailed instructions on installation, training, and evaluation, please refer to the respective repository READMEs:
-
Benchmark Evaluation Guide: Multi-benchmark evaluation scripts and setup instructions.
-
BAGEL Installation Guide: Complete guide for BAGEL model training and evaluation.
-
Harmon Installation Guide: Comprehensive instructions for Harmon model training and evaluation.
-
OpenUni Training Guide: Detailed training and evaluation guide for OpenUni models.
-
Show-o Training Guide: Comprehensive training guide for Show-o models with CLIP and VQGAN variants.
A collection of RecA models on Hugging Face with benchmark performance:
| Model Name | Parameters | GenEval | DPGBench | ImgEdit | GEdit |
|---|---|---|---|---|---|
| BAGEL-RecA (support INT8, NF4) | 14B | 82.4 (+3.6) | 85.29 (+1.26) | 3.75 (+0.37) | 7.27 (+0.33) |
| Harmon-0.5B-RecA | 0.5B | 78.7 (+11.1) | 84.67 (+4.55) | - | - |
| Harmon-1.5B-RecA | 1.5B | 85.7 (+12.8) | 87.21 (+6.28) | - | - |
| Show-o-RecA (CLIP) | 1.3B | 61.9 (+5.3) | 75.70 (+5.05) | - | - |
| Show-o-512x512-RecA (CLIP) | 1.3B | 72.3 (+6.1) | 84.94 (+2.73) | - | - |
| Harmon-1.5B-RecA-plus | 1.5B | 90.0 | 88.15 | - | - |
| OpenUni-1-0.6B-RecA | 1.6B | 70.4 (+14.4) | 80.45 (+4.16) | - | - |
| OpenUni-2-1.6B-RecA | 3.6B | 74.1 (+12.2) | 82.75 (+3.73) | - | - |
Unlocking the Massive Zero-shot Potential in Unified Multimodal Models through Self-supervised Learning.
Harmon-1.5B with RecA achieves GenEval 0.86 and DPGBench 87.21 without GPT-4o distillation data or reinforcement learning. A separate two-stage experiment, using GPT-4o-Image distillation data for supervised fine-tuning before RecA, reaches 0.90 and 88.15, respectively. BAGEL-RecA improves generation and editing scores as listed in the Model Zoo. These are separate model configurations; see the paper for baselines, evaluation protocols, and per-model training costs.
The paper reports generation improvements on Show-o, OpenUni, Harmon, and BAGEL. Understanding evaluations and architecture-specific limitations are discussed in the paper and Reproduction Guide.
Qualitative image-editing comparisons with ICEdit, FLUX-Kontext, and GPT-4o are shown below. For aggregate editing scores and evaluation settings, see Table 3 of the paper.
- Release our model weights on Hugging Face.
- Release BAGEL training code.
- Release Harmon training code.
- Add ComfyUI guide.
- Release Show-o and OpenUni training code.
- Further scale-up BAGEL training.
- Add support for new UMM architectures like Janus-Pro (TODO) and Show-o2.
This project is built upon several excellent open-source projects: BAGEL, Harmon, OpenUni, Show-o. We sincerely thank the authors for their contributions:
We are grateful to the broader research community for their open-source spirit and collaborative efforts.
The majority of RecA is licensed under the Apache License, however portions of the project are available under their own license terms: BAGEL and Show-o are licensed under Apache, Harmon and OpenUni are licensed under S-Lab license; If you later add other third party code, please keep this license info updated, and please let us know if that component is licensed under something other than Apache, CC-BY-NC, MIT, or CC0.
For feedback, or collaboration opportunities, feel free to reach out!
If you have any general questions, feel free to email us at sanaka@berkeley.edu and xdwang@eecs.berkeley.edu. If you have code or implementation-related questions, please feel free to send emails to us or open an issue in this codebase (We recommend that you open an issue in this codebase, because your questions may help others).
If you find our work inspiring or use our codebase in your research, please consider giving a star โญ and a citation.
The CITATION.cff file provides machine-readable citation metadata and identifies the ICLR 2026 paper as the preferred citation.
@article{xie2025reconstruction,
title={Reconstruction Alignment Improves Unified Multimodal Models},
author={Xie, Ji and Darrell, Trevor and Zettlemoyer, Luke and Wang, XuDong},
journal={arXiv preprint arXiv:2509.07295},
year={2025}
}
@inproceedings{xie2026reconstruction,
author = {Xie, Ji and Darrell, Trevor and Zettlemoyer, Luke and Wang, XuDong},
booktitle = {International Conference on Learning Representations},
editor = {C. Vondrick and B. Hariharan and C. Raffel and L. Pinto and D. Yang and A. Faust},
pages = {120095--120137},
title = {Reconstruction Alignment Improves Unified Multimodal Models},
volume = {2026},
year = {2026},
url = {https://openreview.net/forum?id=ppQWp8yrm7}
}โญ If you find this project helpful, please consider giving it a star! โญ