We propose a new regularization strategy called DropMI, which is a generalization of Dropout for the regularization of networks that introduces mutual information (MI) dynamic analysis. The standard Dropout randomly drops a certain proportion of neural units, according to the Bernoulli distribution, ...
[18] proposed a contrastive learning framework, ContrastNet, which prevents few-shot model overfitting and learns discriminative text representation through instance-level and task-level contrastive regularization. However, they overlooked the representation information in text that plays an important role ...
the native contacts of two interacting proteins were shown to store the strongest mutual information (MI) signal to discriminate MSA concatenations with the largest fraction of correct pairings
correlation. On the other hand,mutual information(MI), which plays an important role in information theory [13], enables us to detect general nonlinear dependencies. Letxandybe a set of gene expressions and a set of known gene functions. A variant of MI based on the squared loss is defined...
20. Learning deep representations by mutual information estimation and maximization会议:ICLR 2019.作者:R. Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Philip Bachman, Adam Trischler, Yoshua Bengio链接:openreview.net/pdf?21. Soft Q-Learning with Mutual-Information Regularization会议...
To determine if a feature is relevant for the accurate updating of a particular parameter, the mutual information (MI) [17] score between a feature and a parameter is calculated using the training data. Then, a user-defined number of features with the highest MI scores is selected. An ...
We estimate the MI for two normal distributed random variables with varying correlation. We combine MINE with Generative Adversarial Networks by adding a regularization term to the GAN value function which measures the mutual information between the generated samples and the image labels. The generator...
miSFM take merits of both Mutual Information (MI) and Social Force Model (SFM). More specifically, MI of interacting agents is adopted to determine the level of order within a crowd during an evacuation. In such a way, SFM can be improved by adapting the forces involved at microscopic ...
Mutual information (MI) is a well-accepted similarity measure for image registration in medical systems. However, MI-based registration faces the challenge... D Li,H Li,H Wan,... - 《Physics in Medicine & Biology》 被引量: 0发表: 2012年 Infrared and visual image registration based on mu...
MI regularized Bayesian restoration: To explicitly enforce the independent noise constraint, mutual information is incorporated into the conventional Bayesian framework as a regularization term. The regularized Bayesian restoration can be described as: S ^ = arg min S ^ C (...