迄今为止,具有外部记忆的神经网络局限于具有记忆相互作用的有损表示的单个记忆。记忆片段之间关系的丰富表现促进了高阶和分离的关系记忆。在本文中,我们建议将个体经验的存储(item记忆)和它们的发生关系(关系记忆)分开。这一思想是通过一种新颖的自注意联想记忆(SAM)算子实现的。在外积的基础上,SAM形成了一组联想记忆,...
The idea is implemented through a novel Self-attentive Associative Memory (SAM) operator. Found upon outer product, SAM forms a set of associative memories that represent the hypothetical high-order relationships between arbitrary pairs of memory elements, through which a relational memory is ...
The idea is implemented through a novel Self-attentive Associative Memory (SAM) operator. Found upon outer product, SAM forms a set of associative memories that represent the hypothetical high-order relationships between arbitrary pairs of memory elements, through which a relational memory is ...
source code for Self-attentive Associative Memory arXiv version: https://arxiv.org/abs/2002.03519 code reference for NTM tasks: https://github.com/thaihungle/NSM code reference for NFarthest: https://github.com/L0SG/relational-rnn-pytorch code reference for associative retrieval: https://githu...