Transpose (Feedforward)

Applies Feedforward to penultimate dimension.

Feedforward(
    dim=196,
    plugins=[
        Transpose(),
    ],
)

This plugin can be used to implement token-mixer from MLP-Mixer (opens in a new tab)