Compare siddvenkreleased this16 Aug 15:57 ·246 commitsto master since this release v0.29.0 c343d60 Key Features Details regarding the latest LMI container image_uris can be foundhere DJL Serving Changes (applicable to all containers)
[llamacpp] Removing llamacpp support in DJL (#3312) Jul 11, 2024 Deep Java Library (DJL) Overview Deep Java Library (DJL)is an open-source, high-level, engine-agnostic Java framework for deep learning. DJL is designed to be easy to get started with and simple to use for Java developer...
settings.gradle.kts [llamacpp] Removing llamacpp support in DJL (deepjavalibrary#3312) Jul 11, 2024 Repository files navigation README Code of conduct LicenseDeep Java Library (DJL)OverviewDeep Java Library (DJL) is an open-source, high-level, engine-agnostic Java framework for deep learning....
Just trying to understand why we are removing llamacpp engine? is there a replacement planned to support LLM's via DJL? We don't have maintainer can actively maintain this module. We we focused on supporting LLM via Python engine in DJLServing repo We working on rust engine and will suppor...
serving [DLR] Remove Neo-dlr engine from DJL (deepjavalibrary#2373) Feb 8, 2023 testing [api] Update offline property name to avoid conflict with other app. (d… Nov 29, 2023 tools Update checkstyle tool version to 10.14.2 (deepjavalibrary#3047) Mar 28, 2024 ...
settings.gradle.kts [llamacpp] Removing llamacpp support in DJL (deepjavalibrary#3312) Jul 11, 2024 Repository files navigation README Code of conduct LicenseDeep Java Library (DJL)OverviewDeep Java Library (DJL) is an open-source, high-level, engine-agnostic Java framework for deep learning....
serving [tflite] Removes TFLite engine support (deepjavalibrary#3114) Apr 27, 2024 testing [api] Closes file stream (deepjavalibrary#3130) Apr 30, 2024 tools [tflite] Removes TFLite engine support (deepjavalibrary#3114) Apr 27, 2024 ...
djl-zero docker docs engines examples extensions gradle integration jacoco jupyter model-zoo serving testing tools website .gitignore CNAME CODE_OF_CONDUCT.md CONTRIBUTING.md LICENSE NOTICE README.md apt.txt build.gradle.kts gradle.properties gradlew gradlew.bat index.html index1.0.html leaders.md ...
djl-zero docker docs engines examples extensions gradle integration jacoco jupyter model-zoo serving testing tools website .gitignore CNAME CODE_OF_CONDUCT.md CONTRIBUTING.md LICENSE NOTICE README.md apt.txt build.gradle.kts gradle.properties gradlew gradlew.bat index.html index1.0.html leaders.md ...
Description LMI 0.28.0 max num tokens table Updating list of supported models Removing option.rolling_batch=trtllm line in suggested serving.properties add relevant new properties