When using APIhttp://0.0.0.0:5000how to continue the chat session before? Any idea? TiagoTiagocommentedMay 31, 2024 I think in that case, keeping up history would depend on the client app used; not sure OTGWUI records anything that comes thru that way. I could be wrong though. ...
I feel i make some mistake and now I want to uninstall it completely. How to do that? Contributor Brawlence commented May 5, 2023 Hmmm. Complete uninstallation would include: removing the text-gen-web-UI folder removing the venv folder (probably) removing torch hub local cache dir in you...
importautogen#Use the local LLM server same as beforeconfig_list=[{"model":"mistral-instruct-7b",#the name of your running model"api_base":"http://127.0.0.1:5001/v1",#the local address of the api"api_type":"open_ai","api_key":"sk-111111111111111111111111111111111111111111111111",# just ...
Under WIndows and without WSL I have successfully compiled deepspeed (deepspeed-0.9.3+unknown-cp310-cp310-win_amd64.whl). So how to install this specific file it in the current conda environment to be able to use the command "deepspeed -...