针对你提出的错误“error raised by inference api http code: 404, {"error":"model "quentinz/bge”",这里有几个可能的解决步骤: 确认错误信息来源和内容: 错误信息表明,在调用推理API时,服务器返回了HTTP 404状态码,这通常意味着请求的资源在服务器上未找到。 具体错误信息指出模型"quentinz/bge"
Auto inference task submitted. The auto inference task has been submitted. Wait until the task is complete. 200 ModelArts.4952 Auto inference task executed. The auto inference task has been executed. Proceed with follow-up operations. 200 ModelArts.4960 Auto grouping task submitted. The auto group...
stats=self.triton_client_.get_inference_statistics( 131+ model_name,"1") 132+ self.assertEqual(len(stats.model_stats),1,"expect 1 model stats") 133+ actual_exec_cnt=stats.model_stats[0].execution_count 134+ ifactual_exec_cnt==exec_count: ...
File "/home/xx/anaconda3/envs/xin12/lib/python3.10/site-packages/xinference/model/llm/vllm/utils.py", line 30, in _async_wrapper return await fn(self, *args, **kwargs) File "/home/xx/anaconda3/envs/xin12/lib/python3.10/site-packages/xinference/model/llm/vllm/core.py", line 840...
If an error code starting with APIGW is returned after you call an API, rectify the fault by referring to the instructions provided in API Gateway Error Codes.