- Flax version (CPU?/GPU?/TPU?): not installed (NA) - Jax version: not installed - JaxLib version: not installed - Using GPUinscript?: False - Using distributed or parallel set-upinscript?: False Who can help? @patrickvonplaten Information The official example scripts My own modified sc...
Huggingface_hub version: 0.9.0 PyTorch version (GPU?): 1.12.1 (True) Tensorflow version (GPU?): not installed (NA) Flax version (CPU?/GPU?/TPU?): not installed (NA) Jax version: not installed JaxLib version: not installed Using GPU in script?: Using distributed or parallel set-up ...
https://huggingface.co/Qwen/Qwen-14B-Chat-Int4/blob/main/config.json#L40 模型的默认配置是2048,你去模型权重的目录里的配置文件改一下这个配置试试 Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment Assignees No one assigned Labels gpu question...