SinusoidalEmbedding
Sinusoidal Positional embeddings in Attention is all you need (opens in a new tab)
SinusoidalEmbedding(dim=768)Forward
(x: jaxtyping.Float[Tensor, '... n d']) -> jaxtyping.Float[Tensor, 'n d']Sinusoidal Positional embeddings in Attention is all you need (opens in a new tab)
SinusoidalEmbedding(dim=768)(x: jaxtyping.Float[Tensor, '... n d']) -> jaxtyping.Float[Tensor, 'n d']