OpenNMT/CTranslate2最新发布版本:v4.2.1(2024-04-24 18:04:01)New features Update the Transformers converter with new architectures: CodeGen GPTBigCode LLaMa MPT Update the OpenNMT-py converter to support some recent options: layer_norm="rms" max_relative_positions=-1 (rotary embeddings) max...
OpenNMT/CTranslate2最新发布版本:v4.3.0(2024-05-17 16:20:20)New features Support conversion of GPT-NeoX models with the Transformers converter Extend the end_token argument to also accept a list of tokens Add option return_end_token to include the end token in the results of the methods ...
CTranslate2 is a C++ and Python library for efficient inference with Transformer models. The project implements a custom runtime that applies many performance optimization techniques such as weights quantization, layers fusion, batch reordering, etc., to accelerate and reduce the memory usage of Trans...
Breadcrumbs CTranslate2 / CHANGELOG.mdTop File metadata and controls Preview Code Blame 1656 lines (1117 loc) · 74.8 KB Raw [Unreleased]New featuresFixes and improvementsv4.4.0 (2024-09-09)Removed: Flash Attention support in the Python package due to significant package size increase with min...
1.训练分词模型 下载sentencepiece进入根目录 spm_train --input=/home/cspm_train --input=/home//tmp/fr-zh.fr --model_prefix=/tmp/spm_fr --vocab_size=32000 train_extremely_large_corpus=truehenqiulin/tmp/fr-zh.fr --model_prefix=/tmp/spm_fr --vocab_size=32000 train_extremely_large_corpus...
(b)可视化基于特征的前端，除了视觉测距外，还执行多物体跟踪。(c)显示了从相机视角的动态地图，突出...
脚本中的max_size似乎也缩短了实际的built_batches,因此在测试中max_size的顺序是递减的。这里是：
OpenNMT/CTranslate2最新发布版本:v4.2.1(2024-04-24 18:04:01)New features Support T5 models, including the variants T5v1.1 and mT5 Support loading the model files from memory: Python: see the files argument in the constructor of classes loading models C++: see the models::ModelMemoryReader...
OpenNMT/CTranslate2最新发布版本:v4.2.1(2024-04-24 18:04:01)New features Support "sliding window" and "chunking input" for Mistral Fixes and improvements Take into account the "generation_config.json" and fix "lang_ids" getter for Whisper converter Accept callback even on "generate_tokens"...
Note: The Ctranslate2 Python package now supports CUDNN 9 and is no longer compatible with CUDNN 8. New features Support Phi3 (#1800) Support Mistral Nemo (#1785) Support Wav2Vec2Bert ASR (#1778) Fixes and improvements Upgrade to CUDNN9 (#1803) Fix logits vocab (#1786 + #1791) ...