OpenAI-compatible RESTful APIs for Amazon Bedrock Breaking Changes The source code is refactored with the new Converse API by bedrock which provides native support with tool calls. If you are facing any problems, please raise an issue. Overview Amazon Bedrock offers a wide range of foundation mod...
### OpenAI-compatible RESTful APIs & SDK (Experimental. We will keep improving the API and SDK.) ### Chat Completion Reference: https://platform.openai.com/docs/api-reference/chat/create Some features/compatibilities to be implemented: - [ ] streaming - [ ] support of some parameters like...
如何使用FastChat? | github:https://github.com/lm-sys/FastChat FastChat's core features include: The training and evaluation code for state-of-the-art models (e.g., Vicuna, MT-Bench). A distributed multi-model serving system with web UI and OpenAI-compatible RESTful APIs. ...
:robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. LocalAI is a RESTful API to run ggml compatible models: llama.cpp, alpaca.cpp, gpt4all.cpp, rwkv.cpp, whisper.cpp,
🔥 Flexible APIs: Serve LLMs over a RESTful API or gRPC with a single command. You can interact with the model using a Web UI, CLI, Python/JavaScript clients, or any HTTP client of your choice. ⛓️ Freedom to build: First-class support for LangChain, BentoML, LlamaIndex, OpenAI...