Interesting, so the tokens must be subtly off with the existing tokenizer? Contributor bakkot commented Mar 20, 2023 Not really subtly, as reported in e.g. #167. Honestly it's impressive that it does as well as it does with the broken tokenizer it's currently using. Collaborator Author...