CoAtNet for Tensorflow2

This is an implementation of "CoAtNet" on Keras and Tensorflow.

The implementation is based on paper[1].

Model

• Model
  • CoAtNet-0
  • CoAtNet-1
  • CoAtNet-2
  • CoAtNet-3
  • CoAtNet-4
  • CoAtNet-5
  • CoAtNet-6
  • CoAtNet-7
• Pre-trained weight
  • X

Requirements

• Python 3
• tensorflow 2.4▲

Reference

1. CoAtNet: Marrying Convolution and Attention for All Data Sizes, Zihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing Tan, https://arxiv.org/abs/2106.04803v2

Contributor

• Hyungjin Kim(flslzk@gmail.com)