Skip to main content
Feedback

Setting up Azure Synapse Analytics as a target

info

This connector is currently in Beta Stage.

Overview

Welcome to Getting Started with Data Integration and Azure Synapse Analytics.

This guide will show you how to prepare your Azure environment for Data Integration, create an Azure Blob storage for Azures's stage area, and how to set the right credentials for using Data Integration. At the end of this guide, you will be able to connect to Azure Synapse Analytics from Data Integration.

Preparing your Azure environment for Data Integration

To set Azure Synapse Analytics as a target, Data Integration requires creating or managing some Azure resources.

Prerequisites

  • Azure account
  • Azure subscription
  • Azure resource group
  • Azure blob storage account
  • Azure Synapse Analytics

If you are missing one of the prerequisites above, use the guide below to fill in the gaps.

This guide will cover the following:

  • Create an Azure account with the compatible admin/management.
  • Create Azure subscription.
  • Create Azure resource group.
  • (Optional)Create Azure Blob Storage account.
  • Create Azure Synapse Analytics

1. Creating an Azure account If you don't have an Azure account, you can follow the steps detailed here to create one.

2. Creating Subscription Azure subscription is the main billing and tiers accounts. You must have one to work with any resource at Azure portal or environment.

If you do not have a subscription in Azure, you can create it:

  1. Login to your Azure portal.
  2. In the search box at the top right, search for subscriptions. Click subscriptions in the result.
  3. On the subscriptions screen, click + Add .
  4. Follow the steps of the Microsoft subscription wizard.
    Recommended: Create your subscription name with the name of <your-account>-data_integration, so you can manage the billing using Data Integration in Azure Synapse Analytics.
  5. After the subscription is created, save the Subscription Id from the subscription panel.

3. Creating a Resource Group Resource Group is a semantic group in Azure, which lets you manage and define your permissions, users and the resources under it. Data Integration requires the use of a Resource Group. If you don't have one already, create it by following the below steps.

important

Create a specific new Resource Group for Data Integration. It will let you manage the users, permissions, and resources that Data Integration will use, and watch the capacity and usage of the resource. The Resource Group name must be Data Integration.

  1. Click Resource Groups in the main menu in the Azure portal:

  2. Click + Add in the top panel.

  3. In the form, name your Resource Group "Data Integration". Choose your subscription (an existing one, or create one using the guide above) and choose your location.

4. Create a Blob Storage Account and Blob Storage Container Set your own custom blob storage account.

5. Create an Azure Synapse Analytics

Follow the instructions detailed here to create your warehouse. Use the information detailed in the previous steps such Subscription and Resource group when needed.

Setting up the Azure Synapse Analytics

Create a Data Integration user on the Azure Synapse Analytics

Using a client or via the Azure portal, connect to your Microsoft Azure Synapse Analyticsinstance.

Navigate to the master database and execute the following command (don't forget to replace the <password> with a strong password value):

CREATE LOGIN data_integration WITH PASSWORD = '`<password>`';
CREATE USER data_integration FOR LOGIN data_integration;

Navigate to the warehouse and enter the following commands:

CREATE USER data_integration FOR LOGIN data_integration;
GRANT CONTROL ON DATABASE::`<DATABASE_NAME>` to data_integration;

Whitelist Data Integration IP addresses on Azure If you are not using a connection via an SSH Tunnel you will need to Whitelist our IPs.

  1. Sign in to the Azure portal.
  2. Select warehouses from the left-hand menu and then click your warehouse on the SQL data warehouses page.
  3. Click Show firewall settings.
  4. Make sure the Allow access to Azure services is turned on.
  5. Click Add client IP on the toolbar. When a firewall rule opens, enter one of the IP address as the start IP and end IP. Repeat this step for all 4 IP addresses
  6. Click save when done.

Create a connection in Data Integration

To find your host name, do the following:

  1. Sign in to the Azure portal.
  2. Select SQL Data warehouses from the left-hand menu, and click your data warehouse on the SQL data warehouses page.
  3. In the Essentials pane in the Azure portal page for your database, locate and then copy the Server name . Additional information can be found here .

Creating the connection

  1. Log into Data Integration.
  2. Create a new connection for Azure Synapse Analytics:
    1. Go to Connections.
    2. Click New Connection.
    3. From the source list, choose Azure Synapse Analytics
    4. . Enter the credential information created in the prior steps.
      • Host.
      • Database.
      • Azure Synapse Analytics user name.
      • Azure Synapse Analytics password.
  1. You can either set a Custom File Zone to have the data save in your own staging area or use our default FileZone.
  2. You can test your connection by clicking Test Connection.
  3. Save the connection.

Limitations

Connecting to Azure serverless instance is currently not supported.

On this Page