have you ever try to train swin large?

[Dongshengjiang]

I found swin_large_patch4_window7_224.yaml config file in your code. Here is an interesting question that how about the performance for larger mode?

[jensenzhoujh]

Hi ChunyuanLI Jianwei Yang (@jwyang), I'm also wondering about the linear probe accuracy of DINO/EsViT with Swin-L. Have you ever run any related experiments?

[ChunyuanLI]

I ran the experiments on EsViT (Swin-L) once, but did not get better results than the best number 81.3% reported in our paper.

[Dongshengjiang]

can you provide the final results of swin-L for 300 epoch, I got knn 74.6 at epoch 180 of 300 which is lower than msg_small at same epoch. I suspected there could be two reason, one is the 1k data is not enough for the big model to coverage; second, maybe swin_large need bigger drop path?