2.3 支持的硬件 文本嵌入推理支持可用于CPU,图灵(T4, RTX 2000系列,…),安培80 (A100, A30),安培86 (A10, A40,…),Ada Lovelace (RTX 4000系列,…)和Hopper (H100)架构。 该库不支持CUDA计算能力< 7.5,这意味着不支持V100, Titan V, GTX 1000系列等。要利用您的gpu,
根据官方代码仓库的容器镜像说明,支持 CPU 架构的标签为 cpu-1.5 如下图: 提供了不同架构下的镜像支持。这里选择 CPU 架构的进行部署和测试。 (1)拉取镜像 (base)ailearn@gpts:~$ docker pull ghcr.io/huggingface/text-embeddings-inference:cpu-1.5 cpu-1.5: Pulling from huggingface/text-embeddings-inferen...
CPUghcr.io/huggingface/text-embeddings-inference:cpu-1.1 VoltaNOT SUPPORTED Turing (T4, RTX 2000 series, ...)ghcr.io/huggingface/text-embeddings-inference:turing-1.1 (experimental) Ampere 80 (A100, A30)ghcr.io/huggingface/text-embeddings-inference:1.1 ...
System Info hi, on the page it mentioned the availability of the 1.6 for cpu: ghcr.io/huggingface/text-embeddings-inference:cpu-1.6 for some reason i cant access it or its not available, can you confirm? I Can see and access the cuda but...
feat/python_cpu feat/hfe_compatibility 克隆/下载 HTTPSSSHSVNSVN+SSH 该操作需登录 Gitee 帐号,请先登录后再操作。 提示 下载代码请复制以下命令到终端执行 为确保你提交的代码身份被 Gitee 正确识别,请执行以下命令完成配置 使用HTTPS 协议时,命令行会出现如下账号密码验证步骤。基于安全考虑,Gitee 建议配置并使用...
"raw-cpuid", "rayon", "seq-macro", ] [[package]] name = "gemm-f32" version = "0.17.1" source = "registry+https://github.com/rust-lang/crates.io-index" checksum = "e9a69f51aaefbd9cf12d18faf273d3e982d9d711f60775645ed5c8047b4ae113" dependencies = [ "dyn-stac...
在本地CPU使用TEI# 操作系统Ubuntu 24.04, CPU架构x86_64。 1sudo apt install pkg-config23sudo apt install intel-mkl45cargo install --path router -F mkl cargo install --path router -F mkl -F是 cargo 命令的一个选项,用于启用某个特性(feature)。-F是--features的缩写形式,意思是为构建过程启用特...
System Info ghcr.io/huggingface/text-embeddings-inference:cpu-1.5 Information Docker The CLI directly Tasks An officially supported command My own modifications Reproduction docker run command docker run --name bge_rrk_6201 -d -p 6201:80...
System Info Hello, i'm trying to use a downloaded reranker model in my deploy but when attempting to perform a query it's seems loaded as embedder. I'm currently using cpu-1.4 docker image and was able to replicate the issue also with BA...
feat/python_cpu feat/add_bloom_models feat/hfe_compatibility v1.6.1 v1.6.0 v1.5.1 v1.5.0 v1.4.0 v1.3.0 v1.2.3 v1.2.2 v1.2.1 v1.2.0 v1.1.0 v1.0.0 v0.6.0 v0.5.0 v0.4.0 v0.3.0 v0.2.2 v0.2.1 v0.2.0 v0.1.0 text-embeddings-inference / CODE_OF_CONDUCT.md CODE...