Allow pipeline-parallel-size to be configurable in the vLLM example Related issue number Related to #2354 Checks I've made sure the tests are passing. Testing Strategy Unit tests Manual tests This PR is not tested :( andrewsykim mentioned this pull request Sep 10, 2024 [Bug] Unable to...
pipeline_parallel_sizeto docs since it was missing. cc@strangiato 👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack athttps://slack.vllm.aito discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in...
Why are these changes needed? Allow pipeline-parallel-size to be configurable in the vLLM example Related issue number Related to#2354 Checks