As Python 3.8 reaches EOL, this PR would be a starting point to remove potential code branch on 3.8 only. I'm still working through all of the code, but this would be a starting point for CI. Depends on #8469, and wait til PyTorch drop 3.8 support PR Checklist (Click to Expand) ...
After the PR is assigned, the reviewer will provide status update every 2-3 days. If the PR is not reviewed within 7 days, please feel free to ping the reviewer or the vLLM team. After the review, the reviewer will put an action-required label on the PR if there are changes required...