Layer

Input Size

Output Size

Fully Connected

Seq * Token

16 * Token

ReLU + Dropout

16 * Token

16 * Token

Fully Connected

16 * Token

1 * Token

Squeeze

1 * Token

Token

Fully Connected

Token

128

ReLU + Dropout

128

128

Fully Connected

128

num_classes