I have the same issue when running pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" --global-option="--deprecated_fused_adam" --global-option="--xentropy" --global-option="--fast_multihead_attn" ./ from fairseq https://github.com/facebook...
and then use pip to install deepspeed. I tried one more time with the latest cuda-toolkit as well, with the same results as I will now describe.
Has been an error:ModuleNotFoundError: No module named 'fused_adam_cuda'。 git clonehttps://github.com/NVIDIA/apex $ cd apex $ pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./ $` pip install -v --no-cache-dir ./ ...