Institute of Parallel and Distributed Systems (IPADS) 678followers Shanghai, China http://ipads.se.sjtu.edu.cn/ PinnedLoading PowerInferPowerInferPublic High-speed Large Language Model Serving for Local Deployment C++8.1k424 ServerlessBenchServerlessBenchPublic ...
PhoenixOS-Remoting (PhOS-remote) is an fully-optimized API remoting framework for GPU API calls from various vendors, which is a key technique to implement GPU virtualization / pooling. Note The current release version of PhOS (v0.10) relies on RWTH-ACS/cricket for remoting GPU API calls, we...
.github Update issue templates of PowerInfer (#90) Dec 27, 2023 ci save-load-state : fix example + add ci test (#3655) Oct 18, 2023 cmake cmake : MSVC instruction detection (fixed up #809) (#3923) Nov 5, 2023 common Usemul_mat_transposeat axpy op for large batch (#168) ...
本仓库包含上海交通大学IPADS实验室设计的操作系统课程系列实验。. Contribute to SJTU-IPADS/OS-Course-Lab development by creating an account on GitHub.
本仓库包含上海交通大学IPADS实验室设计的操作系统课程系列实验。. Contribute to SJTU-IPADS/OS-Course-Lab development by creating an account on GitHub.
$ git clone -b main --depth 1 https://github.com/SJTU-IPADS/HEDB $cdHEDB $ make $ sudo make install $ make run $ sudo -u postgres psql Run your 1st SQL: CREATE EXTENSION hedb;DROPTABLEIF EXISTS test;CREATETABLEtest(aint, b enc_int4);SELECTenable_client_mode();--- use client...
pipellm-cuda.h Initial commit Dec 22, 2024 pipellm.cpp Initial commit Dec 22, 2024 pipellm.h Initial commit Dec 22, 2024 pipellm.ver Initial commit Dec 22, 2024 profile_iv.sh Initial commit Dec 22, 2024 worker.cpp Initial commit Dec 22, 2024 ...
Contribute to SJTU-IPADS/PipeLLM development by creating an account on GitHub.
.github Documentation compel contrib coredump crit criu flog images include lib plugins scripts soccr test .cirrus.yml .clang-format .codespellrc .gitignore .lgtm.yml .mailmap .travis.yml CONTRIBUTING.md COPYING CREDITS INSTALL.md MAINTAINERS MAINTAINERS_GUIDE...
Contribute to SJTU-IPADS/HTLL development by creating an account on GitHub.