position_layer

Layer for transformer

Classes

PositionalEmbedding(*args, **kwargs)	Positional embedding layer that adds positional information to input embeddings.
PositionalEncoding(*args, **kwargs)	Positional encoding layer that adds positional information to input embeddings.
RelativePositionEmbedding(*args, **kwargs)	Relative position embedding layer that adds relative positional information.
RotaryPositionEmbedding(*args, **kwargs)	Rotary position embedding layer that adds rotary positional information.