Tiny Dino performance?

[skill-diver]

Hi Author,

Thanks for sharing. Have you ever tried the performance of using tiny dino in the encoder part?

[Parskatt]

Is there a tiny DINOv2? I know there is a ViT-S. The performance for the smaller versions typically degrade the performance, but not to badly. The main issue is that most compute is spent on the refinement for high resolution inputs so benefit of smaller backbone goes away.