Plugins
DropProjection

DropProjection (Attention)

Apply dropout after projection layer.

Attention(
    dim=768,
    plugins=[
        DropProjection(p=0.1)
    ],
)
DropAttentionRelativePositionBias