gated attention for large language models non-linearity sparsity and attention-sink-free

gated attention for large language models non-linearity sparsity and attention-sink-free v1.8.42 版，大小 13.25MB，研究大语言模型注意力机制时，gat工具能帮助用户理解门控注意力、稀疏性和注意力汇聚问题的核心逻辑。适合重视界面清晰的用户。