FedJudge: Federated Legal Large Language Model 近期Large Language Model(LLM)卓越表现推动了其在智慧司法领域的应用。目前已经涌现出许多优秀的法律大模型(Legal LLM),如Lawyer LLaMA和ChatLaw等。然而,尽管Legal LLM在集中式数据训练的环境中取得了显著的成果,却少有人深入探究其在联邦学习场景下的应用。
[ACL2023]FEDLEGAL: The First Real-World Federated Learning Benchmark for Legal NLP 用分散的数据提升大模型的性能 利用联邦学习的分布式特性,有机会有效利用分散的小规模数据来改进大模型。虽然大模型通常是在大规模集中数据集上进行训练的,但它们可能存在领域差距,对真实数据分布的覆盖存在限制。联邦学习可以通过...
LAiW: A Chinese legal large language models benchmark Preprint at arXiv (2023), 10.48550/arXiv.2310.05620 Google Scholar 15 R. Taylor, M. Kardas, G. Cucurull, T. Scialom, A. Hartshorn, E. Saravia, A. Poulton, V. Kerkez, R. Stojnic Galactica: A large language model for science Pre...
Carlini N, Tramer F, Wallace E, Jagielski M, Herbert-Voss A, Lee K, Roberts A, Brown T, Song D, Erlingsson U, et al (2021) Extracting training data from large language models. In: USENIX security symposium, pp 2633–2650 Che T, Liu J, Zhou Y, Ren J, Zhou J, Sheng VS, Dai...
320 FedJudge: Federated Legal Large Language Model Linan Yue, Qi Liu, Yichao Du, Weibo Gao, Ye Liu, Fangzhou Yao 2023-09-15 arXiv https://github.com/yuelinan/FedJudge http://arxiv.org/abs/2309.08173v3 321 FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization...
Efficient Federated Learning with Pre-Trained Large Language Model Using Several Adapter Mechanisms:[160] highlights a method to enhance federated learning efficiency by integrating adapter mechanisms into pre-trained large language models. The study emphasizes the benefits of using smaller transformer-based...
摘要To protect user privacy and meet legal regulations, federated learning (FL) is attracting significant attention. Training neural machine translation (NMT) models with traditional FL algorithm (e.g., FedAvg) typically relies on multi-round model-based interactions. However, it is impractical and ...
their exchange among the various stakeholders is challenging fromsecurity aspects. The authors of this paper presented the FL model as one of the key role players in assuring the security of health records and reviewed the various FL technologies in this particular domain. Applications of FL in ot...
327 FedJudge: Federated Legal Large Language Model Linan Yue, Qi Liu, Yichao Du, Weibo Gao, Ye Liu, Fangzhou Yao 2023-09-15 arXiv https://github.com/yuelinan/FedJudge http://arxiv.org/abs/2309.08173v3 328 FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization...
FEDLEGAL: The First Real-World Federated Learning Benchmark for Legal NLP [pdf] [code] Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New Algorithms [pdf] [code] Client-Customized Adaptation for Parameter-Efficient Federated Learning [pdf] [code] Communication Efficient ...