Therefore, for all further experiments we set the weight λMMI to 0.1 and the margin M to 0.1. Opposed to the MMI-MM-loss, we find that when the switch and its loss are used, it is essential to set its weight high. We decided not to make it larger than one since the main ...