History for transformers src transformers tokenization_utils.py onmain User selector Datepicker Commits on Nov 4, 2024 zucchini-nlp and ArthurZucker authoredNov 4, 2024 · Verified 187439c Commits on Oct 16, 2024 alpertunga-bile authoredOct 16, 2024 ...
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. - transformers/src/transformers/tokenization_utils_base.py at v4.29.1 · huggingface/transformers
Fix typo in tokenization_utils_base.py Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
使用BERT做中文文本相似度计算与文本分类. Contribute to niukaifeng/bert-utils development by creating an account on GitHub.
from .tokenization_utils_base import ( ENCODE_KWARGS_DOCSTRING, ENCODE_PLUS_ADDITIONAL_KWARGS_DOCSTRING, INIT_TOKENIZER_DOCSTRING, AddedToken, BatchEncoding, EncodedInput, EncodedInputPair, PreTokenizedInput, PreTokenizedInputPair, PreTrainedTokenizerBase,...
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. - transformers/src/transformers/tokenization_utils_base.py at v4.37.2 · huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. - History for src/transformers/tokenization_utils_base.py - huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. - transformers/src/transformers/tokenization_utils_fast.py at v4.37.2 · huggingface/transformers
一行代码使用BERT生成句向量,BERT做文本分类、文本相似度计算. Contribute to Xiaojia1234/bert-utils development by creating an account on GitHub.