Azure OpenAI、Azure AI Foundry 和 Azure App Service 的網路安全、高可用性和區域備援企業聊天應用程式的基準參考架構。
此体系结构的许多组件与基本 Azure OpenAI 端到端聊天体系结构均相同。 以下列表仅突出显示对基本体系结构的更改。 Azure OpenAI同时用于基本体系结构和此基线体系结构。 Azure OpenAI 是一项完全托管的服务,提供对 Azure OpenAI 语言模型(包括 GPT-4、GPT-3.5-Turbo 和嵌入模型集)的 REST API 访问。 基线体系结构利...
Azure OpenAI 服務 Azure Machine Learning Azure App Service Azure 金鑰保存庫 Azure 監視器 企業聊天應用程式能夠透過交談互動來強化員工的能力。 這尤其如此,因為 OpenAI 的 GPT 模型和 Meta 的 LLaMA 模型等大型語言模型不斷進步。 這些聊天應用程式是由使用者介面所組成,數據存放庫包含與使用者查詢相關的...
評估此架構中資源的建置自定義警示,例如在 Azure 監視器基準警示中找到的資源。 例如: Container Registry 警示 機器學習 和 Azure OpenAI 警示 Azure Web Apps 警示 語言模型作業 使用Azure DevOps 和GitHub的提示流程,部署 Azure OpenAI 型聊天解決方案應該遵循 LLMOps中的指引。 此外,它必須考慮持續整合...
Azure Private DNS Zones \n Azure Key Vault\n \n This service safeguards cryptographic keys and secrets used by cloud applications and services. In this architecture, Key Vault stores secrets and keys for the OpenAI service, adding an extra layer of security for sensitive data. ...
Store responses of Azure OpenAI API requests to cache Caches response according to the Azure OpenAI API cache configuration. Yes Yes Yes Yes No Get cached responses of large language model API requests Performs lookup in large language model API cache using semantic search and returns a valid cach...
Store responses of Azure OpenAI API requests to cache Caches response according to the Azure OpenAI API cache configuration. Yes Yes Yes Yes No Get cached responses of large language model API requests Performs lookup in large language model API cache using semantic search and returns a valid cach...
azure-storage static-web-apps entra-id playwright vs-code azure-pipelines contoso-real-estate Contoso Real Estate: JavaScript + Enterprise Intelligent enterprise-grade reference architecture for JavaScript, featuring OpenAI integration, Azure Developer CLI template and Playwright tests. Enterprise-grade Refer...
In Spring AI, prompt templates can be compared to the “‘View'” in Spring MVC architecture. A model object, typically a java.util.Map, is provided to populate placeholders within the template. The “‘rendered'” string becomes the content of the prompt supplied to the AI model. ...
azure-database-postgresql azure-functions azure-key-vault azure-sdks azure-storage static-web-apps entra-id playwright vs-code azure-pipelines contoso-real-estate Contoso Real Estate: JavaScript + Enterprise Intelligent enterprise-grade reference architecture for JavaScript, featuring OpenAI integration, A...