--cache-dir CACHE_DIR Path to the directory where to save the downloaded files. --local-dir LOCAL_DIR If set, the downloaded file will be placed under this directory either as a symlink (default) or a regular file. Check out https://huggingface.co/docs/huggingface_hub/guides/download#dow...
安装 pip install -U huggingface_hub 1. 使用 下载模型 huggingface-cli download --resume-download gpt2 --local-dir gpt2 1. 下载数据 huggingface-cli download --repo-type dataset --resume-download wikitext --local-dir wikitext 1. 默认cache 位置 $HOME/.cache/huggingface/hub 1. 加速 export HF...
$ huggingface-cli download --repo-type [repo_type] [repo_id] [filename1 filename2 ...] Upload an entire folder or a file to Hugging Face $ huggingface-cli upload --repo-type [repo_type] [repo_id] [path/to/local_file_or_directory] [path/to/repo_file_or_directory] Scan cache to...
If file is tracked as regular: download the remote file into the cache using hf_hub_download. Compute the sha of the local file and the cached file. If different, we want to upload it. Downloading regular files shouldn't be a problem in most cases (only "small" files and not a lot...
/Users/example/.cache/huggingface/CompVis/stable-diffusion-v-1-4-original/sd-v1-4-full-ema.ckpt Describe alternatives you've considered It seems possible to write this script separately using thehf_hub_downloadfunction, but why not make it part of the existing CLI?
主要是一个简单记录,方便后续使用 安装 pipinstall-Uhuggingface_hub 使用 下载模型 huggingface-clidownload--resume-downloadgpt2--local-dirgpt2 下载数据 huggingface-clidownload--repo-typedataset--resume-downloadwikitext--local-dirwikitext 默认cache 位置 ...
exclude="*.zip" Fetching 206 files: 100%|████████████████████████████████████████████| 206/206 [02:31<2:31, ?it/s] /home/wauplin/.cache/huggingface/hub/datasets--bigcode--the-stack/snapshots/9ca8fa6acdbc8ce920a0cb58adcdafc4...
EDIT: I deleted the caching as it's not executed anywhere else and terminated after running so the cache is not saved. Let me know if that works for you or if it needs changes. Thanks for the opportunity to contribute.Sign up for free to join this conversation on GitHub. Already have ...