address https://github.com/lucidrains/vit-pytorch/issues/292 1年前 .gitignore Initial commit 5年前 LICENSE Initial commit 5年前 MANIFEST.in include tests in package for conda 3年前 README.md readme 2年前 se
Reformer (https://github.com/lucidrains/reformer-pytorch) Informer (https://github.com/zhouhaoyi/Informer2020) FlashAttention (https://github.com/shreyansh26/FlashAttention-PyTorch) Autoformer (https://github.com/thuml/Autoformer) Stationary (https://github.com/thuml/Nonstationary_Transformers)...
lucidrains enforce later pytorch for meshgrid Mar 14, 2022 c3c471e·Mar 14, 2022 History 231 Commits .github/workflows remove patreon Jul 5, 2021 deep_daze enforce later pytorch for meshgrid Mar 14, 2022 instruction_images/Windows How to use program on Windows ...
https://github.com/AILab-CVC/SEED a. 训练 tokenizer:先训练 Causal Q-Former,使用 SD 的 Text Encoder 进行对比 Loss。然后进行 Visual Quantization and De-tokenization 学习,将 Genearation Embedding 和 SD 的 Text Encoder 的输入靠近,其中 ViT Encoder 和 SD Decoder 参数不参与学习。 b. LLM 阶段训练...
Thanks to @Narsil and @lucidrains for this contribution. Performance We present expected speedup (combined forward + backward pass) and memory savings from using FlashAttention against PyTorch standard attention, depending on sequence length, on different GPUs (speedup depends on memory bandwidth - we...
google前段时间发布了Imagen,一个text2image的模型,和之前我介绍过的Disco diffusion和DALL·E2做的事情一样。没想到这么快就有人用pytorch重现了。链接 发布于 2022-05-30 18:48 赞同22 分享收藏 写下你的评论... 还没有评论,发表第一个评论吧登录...
git config --global user.name userName git config --global user.email userEmail 使用HTTPS 协议时,命令行会出现如下账号密码验证步骤。基于安全考虑,Gitee 建议配置并使用私人令牌替代登录密码进行克隆、推送等操作 Username for 'https://gitee.com': userName ...
git config --global user.name userName git config --global user.email userEmail 使用HTTPS 协议时,命令行会出现如下账号密码验证步骤。基于安全考虑,Gitee 建议配置并使用私人令牌替代登录密码进行克隆、推送等操作 Username for 'https://gitee.com': userName ...
Reformer (https://github.com/lucidrains/reformer-pytorch) Informer (https://github.com/zhouhaoyi/Informer2020) FlashAttention (https://github.com/shreyansh26/FlashAttention-PyTorch) Autoformer (https://github.com/thuml/Autoformer) Stationary (https://github.com/thuml/Nonstationary_Transformers)...
Reformer (https://github.com/lucidrains/reformer-pytorch) Informer (https://github.com/zhouhaoyi/Informer2020) FlashAttention (https://github.com/shreyansh26/FlashAttention-PyTorch) Autoformer (https://github.com/thuml/Autoformer) Stationary (https://github.com/thuml/Nonstationary_Transformers)...