Skip to main content
Feedback

Setting up Azure Synapse Analytics as a target

info

This connector is currently in Beta stage.

Prepare your Azure environment for Data Integration, create an Azure Blob storage for Azure's stage area, and set the right credentials for using Data Integration and connect to Azure Synapse Analytics from Data Integration.

Preparing your Azure environment for Data Integration

To set Azure Synapse Analytics as a target, Data Integration requires creating or managing some Azure resources.

Prerequisites

  • Create an Azure account with a compatible admin/management.
  • Create an Azure subscription.
  • Create an Azure resource group.
  • (Optional)Create an Azure Blob Storage account.
  • Create Azure Synapse Analytics

1. Creating an Azure account
If you don't have an Azure account, you can follow the steps Azure Microsoft documentation to create one.

2. Creating Subscription
Azure subscription is the main billing and tier account. You must have one to work with any resource at the Azure portal or environment.

If you do not have a subscription in Azure, you can create one:

  1. Log in to your Azure portal.
  2. In the search box at the top right, search for subscriptions. Click subscriptions in the result.
  3. On the subscriptions screen, click + Add.
  4. Follow the steps of the Microsoft subscription wizard.
    Recommended: Create your subscription name with the name of <your-account>-data_integration, so you can manage the billing using Data Integration in Azure Synapse Analytics.
  5. After the subscription is created, save the Subscription ID from the subscription panel.

3. Creating a Resource Group
Resource Group is a semantic group in Azure, which lets you manage and define your permissions, users, and the resources under it. Data Integration requires the use of a Resource Group. If you don't already have one, create one.

important

Create a specific new Resource Group for Data Integration. It lets you manage the users, permissions, and resources that Data Integration uses, and watch the capacity and usage of the resource. The Resource Group name must be Data Integration.

  1. Click Resource Groups in the main menu in the Azure portal:

  2. Click + Add in the top panel.

  3. In the form, name your Resource Group "Data Integration". Select your subscription (either an existing one or create a new one using the guide above) and choose your location.

4. Create a Blob Storage Account and Blob Storage Container
Set your own custom blob storage account.

5. Create an Azure Synapse Analytics

Follow the instructions here to create your Azure SQL Data Warehouse. Use the information detailed in the previous steps, such as Subscription and Resource group, when needed.

Setting up the Azure Synapse Analytics

Create a Data Integration user on the Azure Synapse Analytics

Connect to your Microsoft Azure Synapse Analytics instance using a client or via the Azure portal.

Navigate to the master database and execute the following command (don't forget to replace the <password> with a strong password value):

CREATE LOGIN data_integration WITH PASSWORD = '`<password>`';
CREATE USER data_integration FOR LOGIN data_integration;

Navigate to the warehouse and enter the following commands:

CREATE USER data_integration FOR LOGIN data_integration;
GRANT CONTROL ON DATABASE::`<DATABASE_NAME>` to data_integration;

Whitelist Data Integration IP addresses on Azure
If you are not using a connection via an SSH Tunnel, you need to Whitelist our IPs.

  1. Sign in to the Azure portal.
  2. Select warehouses from the left-hand menu and then click your warehouse on the SQL data warehouses page.
  3. Click Show firewall settings.
  4. Make sure to enable Allow access to Azure services.
  5. Click Add client IP on the toolbar. When a firewall rule opens, enter one of the IP addresses as the start IP and end IP. Repeat this step for all 4 IP addresses
  6. Click save when done.

Create a connection in Data Integration

To find your host name, do the following:

  1. Sign in to the Azure portal.
  2. Select SQL Data warehouses from the left-hand menu, and click your data warehouse on the SQL data warehouses page.
  3. In the Essentials pane in the Azure portal page for your database, locate and then copy the Server name. Additional information can be found here.

Creating the connection

  1. Log into Data Integration.
  2. Create a new connection for Azure Synapse Analytics:
    1. Go to Connections.
    2. Click New Connection.
    3. From the source list, choose Azure Synapse Analytics
    4. Enter the credential information created in the prior steps.
  • Host.
  • Database.
  • Azure Synapse Analytics user name.
  • Azure Synapse Analytics password.
  1. You can either set a Custom File Zone to have the data save in your own staging area or use our default FileZone.
  2. You can test your connection by clicking Test Connection.
  3. Save the connection.

Limitations

Connecting to an Azure serverless instance is currently not supported.

On this Page