DropProjectionIn (Feedforward)
Apply dropout after first linear layer.
Feedforward(
dim=768,
plugins=[
DropProjectionIn(p=0.1),
],
)
Apply dropout after first linear layer.
Feedforward(
dim=768,
plugins=[
DropProjectionIn(p=0.1),
],
)