Dockerfiles for poetry/mlc-llm(rk3588)/... dockerpoetryrk3588mlc-llm UpdatedSep 13, 2023 Dockerfile SwiftyAI/SwiftyMLC Star6 Code Issues Pull requests An example of integrating local LLMS using mlc-llm into an iOS app swiftioslocalllmmlc-llmllama3-1 ...
Dockerfiles for poetry/mlc-llm(rk3588)/... Contribute to vicalloy/docker-images development by creating an account on GitHub.
See the bottom of the following guide for basic instructions on building your own model:https://github.com/Chrisz236/llm-rk3588 Using mlc-llm with HomeAssistant At the time of writing this HomeAssistant has been adding lots of support for LLMs to utilize as a "Conversation agent" within a...
UPDATE (08/09/2023): We have done major performance overhaul in the past few months, and now I'm happy to share the latest results: SOTA performance on CUDA: https://github.com/mlc-ai/llm-perf-bench SOTA performance on ROCm: https://blog...
Could you please evaluate the build / install process on arm (RK3588 etc.) boards? There seem to be some recent issues. The original guide at https://blog.mlc.ai/2024/04/20/GPU-Accelerated-LLM-on-Orange-Pi doesn't seem to work anymore. MasterJH5574 closed this as completed Feb 11,...