从负样本的角度来看,论文提出了一种扰动策略,以生成挑战性负样本,以充分探索模态之间的相关性,并确保每个模态在学习表征中的有效贡献。 参考文献:Multi-modal Graph Contrastive Learning for Micro-video Recommendation
ImageGraph和IMGpedia进一步扩展到多模态知识图谱领域,分别通过Web爬虫和视觉描述符支持视觉语义查询。GAIA和VisualSem进一步整合文本和视觉知识提取,生成一致的多模态知识图谱。 近期发展:多模态知识图谱社区的焦点从构建转向应用,强调表示学习、获取、融合、推理和驱动应用领域。Baumgartner等人使用多模态检测器和语义网方案...
Keywords: micro-video recommendation, multi-modal, graph contrastive learning, self-supervised URLs:https://doi.org/10.1145/3477495.3532027, GitHub: None 摘要: a.本文的研究背景: 提出了一种新颖的多模态图对比学习方法,即MMGCL,以增强微视频推荐中的多模态表示学习。 b.以往的方法,问题,和动机: 已有的方...
To this end, we propose an end-to-end Multi-modal Graph Learning framework (MMGL) for disease prediction with multi-modality. To effectively exploit the rich information across multi-modality associated with the disease, modality-aware representation learning is proposed to aggregate the features of...
Representation learningMulti-modal information fusionTraditional knowledge graphs (KG) representation learning focuses on the link information between entities, and the effectiveness of learning is influenced by the complexity of KGs. Considering a multi-modal knowledge graph (MKG), due to the introduction...
Multi-modal Graph learning for Disease Prediction (IEEE Trans. on Medical imaging, TMI2022) License MIT license 93stars15forksBranchesTagsActivity Star Notifications main BranchesTags Code Folders and files Latest commit 66 Commits MMGL_inductive ...
Traditional knowledge graphs (KG) representation learning focuses on the link information between entities, and the effectiveness of learning is influenced by the complexity of KGs. Considering a multi-modal knowledge graph (MKG), due to the introduction of considerable other modal information(such as...
In recent years, deep learning (DL)-based approaches have shown initial success in annotating enzyme active sites. For example, Gligorijević et al.18proposed a graph convolutional neural network for protein function prediction based on structures. Although it was not explicitly trained on active ...
A deep learning approach for generalized speech animation. ACM Trans Graph , 2017 , 36: 1 -11 CrossRef Google Scholar [36] Liu X, Guo D, Liu H. Multi-Agent Embodied Visual Semantic Navigation With Scene Prior Knowledge. IEEE Robot Autom Lett , 2022 , 7: 3154 -3161 CrossRef ...
Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of CVPR2023年为数不多的跟医学图像相关的文章~ 单位:英属哥伦比亚大学 源码:https://github.com/raminnakhli/AMIGO(没有源码) 翻译过来的中文题目:AMIGO:用于千兆像素图像表示学习的基于共享上下文处理的稀疏多模态图...