DropProjectionOut (Feedforward)
Apply dropout after activation layer.
Feedforward(
dim=768,
plugins=[
DropProjectionOut(p=0.1),
],
)
Apply dropout after activation layer.
Feedforward(
dim=768,
plugins=[
DropProjectionOut(p=0.1),
],
)