When I run the example given in readme: model = esm.pretrained.esmfold_v1() model = model.eval().cuda() model.set_chunk_size(128) sequence = "MKTVRQERLKSIVRILERSKEPVSGAQLAEELSVSRQVIVQDIAYLRSLGYNIVATPRGYVLAGG" with torch.no_grad(): output...
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - DeepSpeed Monitor Module (Master) (#2013) · Marcus-Arcadius/DeepSpeed@c87f6ee
Thanks for this great deepspeed feature. I am also running into the same error both for DistilBertForSequenceClassification' object has no attribute 'backward' and for BertForSequenceClassification object has no attribute 'backward' here is the full error: AttributeError Traceback (most recent call...
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - DeepSpeed Monitor Module (Master) (#2013) · deepspeedai/DeepSpeed@c87f6ee