Due to the powerful representation ability with multiple levels of abstraction, deep learning-based multimodal representation learning has attracted much attention in recent years. In this paper, we provided a
Wang, “Deep multimodal representation learning: A survey,” IEEE Access, 2019. [62] B. P. Yuhas, M. H. Goldstein, and T. J. Sejnowski, “Integration of acoustic and visual speech signals using neural networks,” IEEE Communications Magazine, 1989. [63] A. A. Lazarus et al., Mu...
The current survey aims to unify the fields of VL representation learning and knowledge graphs, and provides a taxonomy and analysis of knowledge-enhanced VL models.doi:10.1007/s10462-024-10825-zLymperaiou, MariaStamou, GiorgosSpringer NetherlandsArtificial Intelligence Review...
5、联合学习(Co-learning):在模态、它们的表示和它们的预测模型之间转移知识(transfer knowledge between modalities, their representation, and their predictive models) 协同训练co-training 零样本学习zero shot learning 三、任务 四、表征 Representation
Multimodal Machine Learning:A Survey and Taxonomy 多模态机器学习:综述与分类,程序员大本营,技术文章内容聚合第一站。
multimodal learning, namely: multimodal data representation, multimodal fusion (i.e., both traditional and deep learning-based schemes), multitask learning, multimodal alignment, multimodal transfer learning, and zero-shot learning. We also survey current multimodal applications and present a collection ...
该笔记基于:Multimodal Machine Learning:A Survey and Taxonomy 该论文是一篇对多模态机器学习领域的总结和分类,且发表于2017年,算是相当新的综述了。老师在课上推荐阅读,我花了三天大体看了一边,其中有很多实际的方法或者技术对我来说是全新的领域,也是未来学习的方向,但是对这个领域和其想解决的问题有了大致的了解...
Kline, Adrienne et al. 2022. ‘Multimodal Machine Learning in Precision Health: A Scoping Review’. npj Digital Medicine 5(1): 171. Lin, Yi-Ming et al. 2023. ‘Federated Learning on Multimodal Data: A Comprehensive Survey’. Machine Intelligence Research 20(4): 539–53. ...
through geometric relationships. Diverse datasets are combined using graphs and fed into sophisticated multimodal architectures, specified as image-intensive, knowledge-grounded and language-intensive models. Using this categorization, we introduce a blueprint for multimodal graph learning, use it to study ...
P. Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 41, 423–443 (2019). Article Google Scholar Yan, K. K., Zhao, H. & Pang, H. A comparison of graph- and kernel-based -omics data integration algorithms for classifying complex traits. BMC...