Hi @longyuewangdcu @Fantabulous-J @lpq29743 @Sniper970119 @junchaoIU ,
Thanks for releasing Marco-MoE models on Hugging Face and the detailed README.
I noticed the repo currently has model weights and documentation, but no training or inference code (e.g., Drop-Upcycling, pre-training, SFT/OPD, or inference examples).
Do you plan to open-source the training and inference code? If so, any rough timeline?
Thanks! 😄
Hi @longyuewangdcu @Fantabulous-J @lpq29743 @Sniper970119 @junchaoIU ,
Thanks for releasing Marco-MoE models on Hugging Face and the detailed README.
I noticed the repo currently has model weights and documentation, but no training or inference code (e.g., Drop-Upcycling, pre-training, SFT/OPD, or inference examples).
Do you plan to open-source the training and inference code? If so, any rough timeline?
Thanks! 😄