Fix crash ingptManagerBenchmark#649 Fix Blip2 build error #695 Add pickle support forInferenceRequest#701 Fix Mixtral-8x7b build failure with custom_all_reduce #825 Fix INT8 GEMM shape #935 Minor bug fixes Performance [BREAKING CHANGES]Increase defaultfreeGpuMemoryFractionparameter from 0.85 to ...
Fix crash ingptManagerBenchmark#649 Fix Blip2 build error #695 Add pickle support forInferenceRequest#701 Fix Mixtral-8x7b build failure with custom_all_reduce #825 Fix INT8 GEMM shape #935 Minor bug fixes Performance [BREAKING CHANGES]Increase defaultfreeGpuMemoryFractionparameter from 0.85 to ...
Fix crash in gptManagerBenchmark #649 Fix Blip2 build error #695 Add pickle support for InferenceRequest #701 Fix Mixtral-8x7b build failure with custom_all_reduce #825 Fix INT8 GEMM shape #935 Minor bug fixes Performance [BREAKING CHANGES] Increase default freeGpuMemoryFraction parameter fro...