1234567891011121314151617#(/root/miniconda3/envs/xDiT/lib/python3.10/site-packages/yunchang/kernels/attention.py)# ORGINAL CODE# try:# from flash_attn.flash_attn_interface import _flash_attn_forwa 2024-12-27
Broadcasting on Meshes with Wormhole Routing Broadcasting on Meshes with Wormhole Routing 2024-12-17 Paper Reading #blog
ZeRO, ZeRO-Offload, ZeRO-Infinity Paper reading of ZeRO. 2024-12-11 Paper Reading #Distributed Training
Error When Install nodejs by Scoop Bugs caused when installing nodejs by scoop. 2024-11-24 Bugs #scoop
USP-A Unified Sequence Parallelism Approach for Long Context Generative AI Paper reading of Pyramid Attention Broadcast. 2024-11-14 Paper Reading #Distributed Training
Comparsion of Parallelsim Metods in ViT Paper reading of Pyramid Attention Broadcast. 2024-11-13 Paper Reading #Distributed Training
Real-Time Video Generation With Pyramid Attention Broadcast Paper reading of Pyramid Attention Broadcast. 2024-11-13 Paper Reading #Distributed Training