Azure Open AI Client Key Set Up

Some features in LegalServer use artificial intelligence, and one step of enabling those features is setting up an account with an AI provider. This article describes how to connect your own Microsoft Azure Open AI account to LegalServer to handle AI tasks.

Requirements: Microsoft Azure Account, and Machine Learning Features enabled by LegalServer.

Permission: Edit AI & Machine Learning Settings user role permission.

Azure Endpoint Configuration

• Have your staff member or managed account representative configure 4 endpoints in your Azure account for the following OpenAI (or compatible) models:
  • gpt-4o
  • gpt-4o-mini
  • text-embedding-3-small

  • whisper

    We recommend customizing each endpoint to adjust the token limits to the maximum allowed for your region

    For each of the models above, Azure will give you:

  • deployment name (defaults to model name but you can change it)
  • endpoint target URI
  • endpoint key

LegalServer Configuration

• In your LegalServer site, navigate to Admin → AI & Machine Learning Settings
• Ignore the OpenAI API Key field; instead click “Yes” for “Enable Azure OpenAI”, then click Configure Models

• On the Machine Learning Model lookup/configuration page, you need to reference the information supplied when each Azure endpoint was created above

  • Azure API Key: enter the endpoint key

    Azure API Version: you will find this at the end of the endpoint target URI; as an example: 2024-08-01-preview

    Azure API Base: this is the beginning of your endpoint target URI; as an example: https://examplecompany-west-us.openai.azure.com

    Azure Deployment Name: deployment name; typically just the model name unless you changed it in Azure

    for each model, enter details like this:

    • gpt-4o
      • vendor: Azure OpenAI
      • Tier: Standard

      • Model Types: Completions, Vision

        gpt-4o-mini

      • vendor: Azure OpenAI
      • Tier: Fast

      • Model Types: Completions, Vision

        text-embedding-3-small

      • vendor: Azure OpenAI
      • Tier: Standard

      • Model Types: Embedding

        whisper

      • vendor: Azure OpenAI
      • Tier: Standard
      • Model Types: Audio