llm_hf_model_file: yi-34b-chat.Q4_K_M.gguf embedding_hf_model_name: BAAI/bge-small-en-v1.5 prompt_style: "tag" sagemaker: llm_endpoint_name: huggingface-pytorch-tgi-inference-2023-09-25-19-53-32-140 embedding_endpoint_name: huggingface-pytorch-inference-2023-11-03-07-41-36-479 opena...
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.1-GGUF llm_hf_model_file: yi-34b-chat.Q4_K_M.gguf embedding_hf_model_name: BAAI/bge-small-en-v1.5 prompt_style: "tag" sagemaker: llm_endpoint_name: huggingface-pytorch-tgi-inference-2023-09-25-19-53-32-140 embedding_endpoint_name: ...
llm_hf_repo_id: TheBloke/Mistral-7B-Instruct-v0.1-GGUF llm_hf_model_file: mistral-7b-instruct-v0.1.Q4_K_M.gguf embedding_hf_model_name: BAAI/bge-small-en-v1.5 chatglm: llm_hf_repo_id: THUDM/chatglm3-6b-32k #llm_hf_model_file: mistral-7b-instruct-v0.1.Q4_K_M.gguf #embeddi...
36行:tokenizer: hfl/chinese-alpaca-2-7b 51行:llm_hf_repo_id:hfl/chinese-alpaca-2-7b-gguf 52行:llm_hf_model_file:ggml-model-q4_k.gguf 53行:embedding_hf_model_name: BAAI/bge-large-zh-v1.5
embedding_hf_model_name: nomic-ai/nomic-embed-text-v1.5 rag: similarity_top_k: 5 rerank: enabled: false model: cross-encoder/ms-marco-MiniLM-L-2-v2 top_n: 3 data: local_data_folder: ../KBs/demo vectorstore: database: qdrant ...
(Default: 1.1) embedding: # Should be matching the value above in most cases mode: huggingface ingest_mode: simple embed_dim: 384 # 384 is for BAAI/bge-small-en-v1.5 huggingface: embedding_hf_model_name: BAAI/bge-small-en-v1.5 access_token: ${HUGGINGFACE_TOKEN:} vectorstore: database...
" 36行:tokenizer: hfl/chinese-alpaca-2-7b 51行:llm_hf_repo_id:hfl/chinese-alpaca-2-7b-gguf 52行:llm_hf_model_file:ggml-model-q4_k.gguf 53行:embedding_hf_model_name: BAAI/bge-large-zh-v1.5
self.embedding_model = HuggingFaceEmbedding( model_name=settings.local.embedding_hf_model_name, cache_folder=str(models_cache_path), ) 1 change: 1 addition & 0 deletions 1 private_gpt/components/llm/__init__.py Show comments View file Edit file Delete file This file contains bidirectional...
embedding_hf_model_name: BAAI/bge-small-en-v1.5 llm_hf_repo_id: ${PGPT_HF_REPO_ID:TheBloke/Mistral-7B-Instruct-v0.1-GGUF} llm_hf_model_file: ${PGPT_HF_MODEL_FILE:mistral-7b-instruct-v0.1.Q4_K_M.gguf} embedding_hf_model_name: ${PGPT_EMBEDDING_HF_MODEL_NAME:BAAI/bge-small-...
Environment Operating System: Macbook Pro M1 Python Version: 3.11 Description I'm encountering an issue when running the setup script for my project. The script is supposed to download an embedding model and an LLM model from Hugging Fac...