MLC-MiniCPM 中文版 Based onMLC-LLM, we run MiniCPM and MiniCPM-V on android devices. Android APK Install MiniCPM 1.2B and MiniCPM-V 2.0APK(old version can be found here: MiniCPM and MiniCPM-VAPK) Accept camera & photo permission: the permission are for MiniCPM-V which can process ...
⚙️ Request New Models Link to an existing implementation (e.g. Hugging Face/Github): Is this model architecture supported by MLC-LLM? (the list of supported models) No https://huggingface.co/openbmb/MiniCPM-V Additional context https://l...
MODEL_TYPE=minicpm_v mlc_chat convert_weight --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ --quantization $QUANTIZATION -o dist/$MODEL_NAME/ mlc_chat gen_config --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ --quantization $QUANTIZATION --conv-template LM...
0](https://github.com/OpenBMB/mlc-MiniCPM)安装apk使用; MiniCPM-Llama3-V 2.5 将很快推出,敬请期待。 MiniCPM-Llama3-V 2.5和 MiniCPM-V 2.0 可运行在Android手机上,点击[MiniCPM-Llama3-V 2.5](http://minicpm.modelbest.cn/android/modelbest-release-20240528_182155.apk) / [MiniCPM-V 2....
MiniCPM on Android platform. Contribute to OpenBMB/mlc-MiniCPM development by creating an account on GitHub.
cd MiniCPM/quantize python bnb_quantize.py ``` **量化测试** 1. 命令行进入到 MiniCPM/quantize 目录下 2. 修改quantize_eval.sh文件中awq_path,gptq_path,awq_path,如果不需要测试的类型保持为空字符串,如下示例表示仅测试awq模型: 0 comments on commit 3d18712 Please sign in to comment. Footer...
PYTORCH_ENABLE_MPS_FALLBACK=1 python test.py ``` ###Deployment on Mobile Phone Currently MiniCPM-V 1.0 can be deployed on mobile phones with Android and Harmony operating systems. 🚀 Try it out[here](https://github.com/OpenBMB/mlc-MiniCPM)....
MODEL_NAME=MiniCPM-V QUANTIZATION=q4f16_1 MODEL_TYPE=minicpm_v mlc_chat convert_weight --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ --quantization $QUANTIZATION -o dist/$MODEL_NAME/ mlc_chat gen_config --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}-hf/ -...