mask_layer#

Layer for transformer

Classes

CausalMask(*args, **kwargs)

Casual Mask is used for transformer decoder, used in first self-attention for decoder feature

ProbMask(B, H, L, index, scores)

ProbMask for informer