superboogav2.parameters as parameters from extensions.superboogav2.utils import ( create_context_text, create_metadata_source ) from modules import chat, shared from modules.text_generation import get_encoded_length from modules.logging_colors import logger from modules.chat import load_character_mem...
I'm on Nobara 37. Thanks Is there an existing issue for this? I have searched the existing issues Reproduction Just following thesetupfor 4 bit mode mkdir repositories cd repositories git clone https://github.com/oobabooga/GPTQ-for-LLaMa.git -b cuda cd GPTQ-for-LLaMa python setup_cuda....