Plugins
DropAttention

DropAttention (Attention)

Apply dropout for attentions.

Attention(
    dim=768,
    plugins=[
        DropAttention(p=0.1)
    ],
)
CausalMaskDropProjection