Plugins
DropActivation

DropActivation (Feedforward)

Apply dropout after activation layer.

Feedforward(
    dim=768,
    plugins=[
        DropActivation(p=0.1),
    ],
)
SubNormDropProjectionIn