Infini-AI-Lab Overview Repositories 10 Projects Packages People Popular repositories Loading Sequoia Public scalable and robust tree-based speculative decoding algorithm Python 319 36 TriForce Public [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical ...
infini-ai-lab.github.io/TriForce/ Topics acceleration efficiency inference llm long-context llm-inference speculative-decoding Resources Readme Activity Custom properties Stars 232 stars Watchers 1 watching Forks 12 forks Report repository Releases No releases published Packages No packages ...
Infini-AI-Lab/Sequoiamain BranchesTags Code Folders and filesLatest commit Cannot retrieve latest commit at this time. History62 Commits A100_growmaps first commit Feb 29, 2024 Engine fix a bug Mar 9, 2024 L40_growmaps Add files via upload May 22, 2024...
Infini-AI-Lab / MagicPiG Public Notifications Fork 0 Star 10 Code Issues 1 Pull requests Actions Projects Security Insights Infini-AI-Lab/MagicPiGmain 1 Branch 0 Tags Code Folders and filesLatest commit dreaming-panda Add files via upload...
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding - update · Infini-AI-Lab/TriForce@aa9b60a
Infini-AI-Lab/TriForcePublic NotificationsYou must be signed in to change notification settings Fork12 Star210 Code Issues6 Pull requests Actions Projects Security Insights Additional navigation options New issue Open Lucas-TYopened this issueJun 25, 2024· 8 comments ...
Infini-AI-Lab Overview Repositories 9 Projects Packages People Popular repositories Loading Sequoia Public scalable and robust tree-based speculative decoding algorithm Python 307 31 TriForce Public [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical ...