Skip to main content
Feedback

Building a Boomi Data Integration data flow

Updated 

Prerequisite

You need an existing Boomi Data Integration connection.

Step 1: Set up the data source

  1. Navigate to the Boomi Data Integration console.
  2. Select Create, then select Data Flow.
  3. Select Boomi Data Integration as the data source.
  4. Under Source Connection, select an existing Boomi Data Integration connection from the dropdown, or select Add New to create one. Refer to Boomi Data Integration connection for setup steps.
  5. Select Test Connection to confirm that Data Integration can authenticate and reach your account.
  6. Select Next.
note

Activities and Audit Events each require a date range when you configure that report, later in this walkthrough. Both default to a wide window that covers effectively all available history. Narrow the range if you need only recent activity.

Step 2: Select a data target

  1. Select the destination you want to load Boomi Data Integration data into, then select Next.

    note

    Data Integration labels some destinations Alpha or Beta. Review that destination's documentation before you use it in a production data flow.

  2. Under Target Connection, select an existing connection from the dropdown, or select Add New to create one.

  3. Select Test Connection to confirm that Data Integration can authenticate and reach your destination.

  4. Under Data Loading Settings, select the required fields for your destination, such as Schema. Select the refresh icon next to a field to reload its list of values. Expand Advanced Settings for additional options specific to your destination.

  5. Select Next.

Step 3: Configure the schema

  1. On the Tables Definitions screen, Data Integration lists every Boomi Data Integration report available to sync: Data Flows, Activities, Users, Audit Events, and Connections. Refer to Boomi Data Integration predefined reports for what each report returns.
  2. Select the checkbox next to each report you want to sync. Use Search Reports to find a specific report, or use the Selected and All toggles to switch between views.
  3. For each selected report, review its Target Table, Extract Method, and Loading Mode. For Activities and Audit Events, set the Incremental Field, Incremental Type, Start Value, and End Value.
  4. Optional: Select Extraction Mode, then look for additional options, such as a Table Prefix for target table names or a Convert File To Parquet Format toggle.
  5. If you change report parameters after this step, select Reload Reports Metadata to refresh the list of available reports.
  6. Select Next.

Step 4: Set the schedule and settings

  1. Select Schedule Data Flow, then set how often you want the data flow to run. Data Integration displays and runs schedules in UTC.
  2. Optional: Select Set Custom Timeout to set a fixed run timeout. By default, Data Integration sets the timeout for each run automatically, based on table size. The timeout is capped between 12 hours and seven days.
  3. Optional: Under Notifications, select Failure, Warning, or Run Threshold. Then enter one or more email addresses, separated by commas, to receive alerts.
  4. Under Data Flow Info, enter a Data Flow Name. Data Integration suggests a default name based on your source and target connections and the current date and time. Optionally, select a Group and enter a Description.
  5. Select Activate to save the data flow and start running it on its schedule.
On this Page