mp_size field is deprecated in flavor of tensor_parallel/tp https://github.com/microsoft/DeepSpeed/blob/master/deepspeed/inference/engine.py so update related docs that are still sticking to mp_size update doc to migrate init_inference from mp_size to `tensor_para… … Verified 5f7f6fa yu...