$ git clone https://github.com/llm-jp/llm-jp-eval-inference $ cd llm-jp-eval-inference/inference-modules/vllm && uv sync # 推論の実行 $ cd llm-jp-eval-inference/inference-modules/vllm && uv run inference.py --confi
.github configs scripts src tests .gitignore .pre-commit-config.yaml CITATION.cff DATASET.md LICENSE README.md README_en.md REFERENCES.md poetry.lock pyproject.toml requirements.txtBreadcrumbs llm-jp-eval/ pyproject.tomlLatest commit Cannot retrieve latest commit at this time. HistoryHistory ...
GitHub Copilot Write better code with AI Security Find and fix vulnerabilities Actions Automate any workflow Codespaces Instant dev environments Issues Plan and track work Code Review Manage code changes Discussions Collaborate outside of code Code Search Find more, search less Explore A...
GitHub Copilot Enterprise-grade AI features Premium Support Enterprise-grade 24/7 support Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Provide feedback We read every piece of feedback, and take your input very seriously. Include my email address...
Contribute to llm-jp/llm-jp-eval development by creating an account on GitHub.
What The WikiCorpus dataset is split inconsistently across different Python environments. Version llm-jp-eval: v1.3.0 To reproduce Clone the repo. $ git clone git@github.com:llm-jp/llm-jp-eval.git Install the dependencies. $ python3 -m v...
https://github.com/llm-jp/eval-tuning-wg/issues/103 例えば回答の形式を予め決めておくと、改行に頼らず安定して回答だけをParseすることが出来ますね。 こう言ったふうに、Parseの際の(意図してない)作動が評価スコアに影響を与えているのは、 例えばコード生成のタスクだと今まさに大問題を...
["pygit2"] github = ["requests"] gs = ["gcsfs"] gui = ["panel"] hdfs = ["pyarrow (>=1)"] http = ["aiohttp (!=4.0.0a0,!=4.0.0a1)", "requests"] libarchive = ["libarchive-c"] oci = ["ocifs"] s3 = ["s3fs"] sftp = ["paramiko"] smb = ["smbprotocol"] ssh ...
現状の実装ではデフォルトで様々な場所にファイルが書き出されますが、ライブラリとしての一貫性を考えると、ユーザが指定していない場所に何かを書き出す挙動は極力排除するのが望ましいです。特に次のような点は改善が必要だと思います。 指定がないとき、カレントディレ
Files 5689f3c .github configs scripts src tests .gitignore .pre-commit-config.yaml DATASET.md LICENSE README.md REFERENCES.md poetry.lock pyproject.toml requirements.txtBreadcrumbs llm-jp-eval / REFERENCES.md Latest commit namgiH commit v1.0.0...