binary-mlc-llm-libs Model libraries are stored in the format: {model_name}/{model_name}-{quantization}-{metadata}-{platform}.{suffix} Metadata: ctx: context window size sw: sliding window size cs: prefill chunk size For default configurations of metadata, we do not include that in the ...
【5月27日 20:00】江湖夜语十二载,相逢一笑谈开源|Gitee 十二周年特别直播预告 扫描微信二维码支付 取消 支付完成 Watch 不关注关注所有动态仅关注版本发行动态关注但不提醒动态 1Star0 zeroway/binary-mlc-llm-libs 代码Issues0Pull Requests0Wiki流水线
Insights: mlc-ai/binary-mlc-llm-libsPulse Contributors Community Standards Commits Code frequency Dependency graph Network Forks Dependency graph Dependencies Dependents Export SBOM Search all dependencies No dependencies found. To view your dependency graph, your repository must define dependencies in ...
lanbomo/binary-mlc-llm-libs 代码 Issues 0 Pull Requests 0 Wiki 统计 流水线 服务 悬镜源鉴 服务由 悬镜安全 提供技术支持 丰富的语言支持,海量知识库支撑 支持Java、JavaScript、PHP等多种主流编程语言的软件成分分析 云平台实时的组件库、漏洞库、许可证库、特征库等海量知识库支撑 许可合规分析,知...
MLC-LLM head (at the time of this PR): mlc-ai/mlc-llm@2cbf393 Mainly needed [Model] Support Phi-3.5 mlc-llm#2839 for longrope support for phi-3.5 TVM: MasterJH5574/tvm@1c17406 (from [Runtime] Support KV cache with RoPE extension factor array apache/tvm#17294) With CharlieFRuan...
s3714110/binary-mlc-llm-libsPublic forked frommlc-ai/binary-mlc-llm-libs NotificationsYou must be signed in to change notification settings Fork0 Star0 Code Pull requests Actions Projects Security Insights Additional navigation options Commit81966e6 ...
Update IOS prebuilts for Llama2 7B to support dynamic vocab_size introduced in mlc-ai/mlc-llm#891 Update IOS prebuilts for Llama2 7B to support dynamic vocab_size 8ec40be CharlieFRuan merged commit fa4479d into mlc-ai:main Sep 17, 2023 This was referenced Sep 19, 2023 Add model...
sangelone/binary-mlc-llm-libsmain 1 BranchTags Code This branch is 1 commit ahead of, 102 commits behind mlc-ai/binary-mlc-llm-libs:main.Folders and files Latest commit Cannot retrieve latest commit at this time. History58 Commits CodeLlama-13b-Python-hf-q4f16_1-metal.so Add CodeLlama-...
This branch is 97 commits behind mlc-ai/binary-mlc-llm-libs:main.Folders and files Latest commit Cannot retrieve latest commit at this time. History55 Commits Llama-2-13b-chat-hf-q4f16_1-cuda.so Update CUDA prebuilts for Llama2 7B/13B and RedPajama Aug 8, 2023 Llama-2-13b-chat-hf-...
forked from mlc-ai/binary-mlc-llm-libs Notifications Fork 0 Star 0 Code Pull requests Actions Projects Security Insights Files main Llama-2-13b-chat-hf-q4f16_1-cuda.so Llama-2-13b-chat-hf-q4f16_1-mali.so Llama-2-13b-chat-hf-q4f16_1-metal.so Llama-2-13b-chat-hf...