Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
AirLLM 70B inference with single 4GB GPU. Contribute to CymricBean/airllm development by creating an account on GitHub.
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
AirLLM 70B inference with single 4GB GPU. Contribute to haiming2101/airllm development by creating an account on GitHub.
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...
Example [python notebook] (https://github.com/lyogavin/airllm/blob/main/air_llm/examples/run_on_macos.ipynb) Example Python Notebook Example colabs here: example of other models (ChatGLM, QWen, Baichuan, Mistral, etc): ChatGLM: from airllm import AutoModel MAX_LENGTH = 128 model = Au...