https://github.com/SnowMasaya/text-generation-webui/tree/deepl/extensions/deepl_translateoobabotAnother Discord bot, with both command-line and GUI modes. Easy setup, lots of config options, and customizable characters!oobabot -- command-line mode, uses Oobabooga's API module oobabot-plugin ...
webui\text-generation-webui\modules\GPTQ_loader.py", line 114, in load_quantized model = load_quant(str(path_to_model), str(pt_path), shared.args.wbits, shared.args.groupsize, kernel_switch_threshold=threshold) File "F:\WBC\text-generation-webui\text-generation-webui\modules\GPTQ_...
Screenshot Logs To create a public link,set`share=True`in`launch()`.Closing server running on port: 7860Loading the extension"gallery"... Ok.Starting streaming server at ws://127.0.0.1:5005/api/v1/streamExceptioninthread Thread-3 (_run_server):Traceback (most recent call last):File"/ho...
webui/installer_files/env/lib/python3.11/site-packages/gradio/blocks.py", line 1786, in process_api result = await self.call_function( ^^^ File "/media/nabab/NVME2/AI/text-generation-webui/installer_files/env/lib/python3.11/site-packages/gradio/blocks.py", line 1350, in call_function pr...
Describe the bug When I start the webui, the API is never on, even when turning it on on restarting the webui through the UI Is there an existing issue for this? I have searched the existing issues Reproduction Just try enable the API in...
I'm getting a similar problem using the built-in API and the Api tester modal that shows after clicking on the "Use via API" in the webui footer. Api is enabled in the settings: Error message I'm getting from theserver.py:
Describe the bug After update API was not working, throwing error when loading extension/openai that sse_starlette not available. Since I'm too lazy to fork and to PR: diff --git a/requirements.txt b/requirements.txt index 62bf22b..1410a...
When using APIhttp://0.0.0.0:5000how to continue the chat session before? Any idea? TiagoTiagocommentedMay 31, 2024 I think in that case, keeping up history would depend on the client app used; not sure OTGWUI records anything that comes thru that way. I could be wrong though. ...
Starting the web UI conda activate textgen cd text-generation-webui python server.py Then browse to http://localhost:7860/?__theme=dark Optionally, you can use the following command-line flags: Basic settings FlagDescription -h, --help Show this help message and exit. --notebook Launch ...
The problem started when you changed the int8 multiplication to something unsupported. The fix for that is too slow so I have been using 0.4.2. I am unable to use the --rwkv-cuda-on option, as I get this error: File "E:\oobabooga\text-generation-webui\server.py", line 241, in...