Win + . opens the Emoji Panel, then Symbols and scroll down to Latin Symbols. Just the ¨ Umlaut ¨ It’s possible to type just the umlaut ‘two dots’ without any letter below. It’s Unicode 00A8 officially called “Diaeresis”. In Word for Windows, type A8 followed by Alt + X...