[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

The official repo for [NeurIPS'21] "ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias" and [IJCV'22] "ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond"

Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"

A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling?"

SimpleNetV1 Implementation in Pytorch

[NeurIPS 2024] official code release for our paper "Revisiting the Integration of Convolution and Attention for Vision Backbone".

[PR 2024] Official PyTorch Code for "Dual Teachers for Self-Knowledge Distillation"

PONAS: Progressive One-shot Neural Architecture Search for Very Efficient Deployment

Automated cleanup of ImageNet 1k and ImageNetV2 datasets

The tools for translate the pretrained TensorFlow model checkpoint to the torch model

Training classification model for generating backbone