Thank you for your work on flash-attention. I noticed numerical differences between flash_attn_varlen_kvpacked_func and vanilla implementation of x-attention below. In autoregressive normalizing flows, this difference is large enough to ...
feat = flash_attn.flash_attn_varlen_qkvpacked_func( AttributeError: module 'flash_attn' has no attribute 'flash_attn_varlen_qkvpacked_func'