How to Deploy Azure OpenAI with Private Endpoint and ChatGPT using Terraform

Guillermo Musumeci
12 min readDec 17, 2023

In this story, we will learn how to deploy Azure OpenAI and ChaptGPT using Terraform in Azure.

Update May 22, 2024: add Azure OpenAI deployment capacity and multiple deployments.

Update July 22, 2024: add Azure OpenAI GPT 4o deployments

The Azure OpenAI Service gives customers access to managed AI services using OpenAI GPT-4, GPT-3, Codex, DALL-E, and Whisper models with Azure's security and enterprise promise.

Azure OpenAI co-develops the APIs with OpenAI, ensuring compatibility and a smooth transition from one to the other.

With Azure OpenAI, customers get the security capabilities of Microsoft Azure while running the same models as OpenAI.

Azure OpenAI offers private networking, regional availability, and responsible AI content filtering.

The code uses Azure Cognitive Services, which will also help deploy other models, such as ada, cabbage, curie, text-embedding-ada, cushman, davinci, etc.

Note: check the How to Send Azure OpenAI Logs and Events to Azure Log Analytics using Terraform story to learn how to send Azure OpenAI Logs and Events to Azure Log Analyzer using Terraform.

1. Prerequisites

--

--

Guillermo Musumeci
Guillermo Musumeci

Written by Guillermo Musumeci

Certified AWS, Azure & GCP Architect | HashiCorp Ambassador | Terraform SME | KopiCloud Founder | ex-AWS | Entrepreneur | Book Author | Husband & Dad of ✌

Responses (1)