Convolution Reverb 卷积混响 TheConvolverNodelets you make things sound like you're in a physical space like a room, a music hall, or a cave. There's no shortage of options given the huge amount of impulse responsesfreely available online. In games you can emulate different physical spaces. ...
这个trick在经典transformer上的效果一般,但是在Hyena等convolution模型上似乎效果很好: 难道长卷积比transformer在序列长度上更敏感?其实从TNN这篇文章里可以初见眉目: TNN的作者指出,长卷积的本质就是一组参数化的相对位置编码对序列做卷积。 显然,和transformer最大的区别就是,这组位置编码被参数化过,也就是存在可学习...
Zihang Dai, Hanxiao Liu, Quoc V . Le, and Mingxing Tan. Coatnet: Marrying convolution and attention for all data sizes. Priya Goyal, Mathilde Caron, Benjamin Lefaudeux, Min Xu,Pengchao Wang, Vivek Pai, Mannat Singh, Vitaliy Liptchin-sky, Ishan Misra, Armand Joulin, and Piotr Bojanowski...