attention_layer

Layer for transformer autoformer

Classes

Attention(*args, **kwargs)	Multi-head attention layer
FastAttention(*args, **kwargs)
ProbAttention(*args, **kwargs)
SelfAttention(*args, **kwargs)
SparseAttention(*args, **kwargs)	SparseAttention implementation