base_model_2 = merge(base_model_1 and LoRA_weights_2) ... If you want to have multiple outputs for each LoRA weights set, then merging is not an option. You will have to change the code inlit_gpt/lora.pyin such a way that there is not a single set oflora_Aandlora_Bweights, ...