Using bulk actions

info

The new Source to Target experience is currently available only in private preview.

The Data Integration Bulk Actions feature lets you manage multiple tables simultaneously, streamlining workflows and enhancing productivity when working with multi-table rivers. This feature is available for multi-table configurations in both create and edit modes.

Steps for using bulk actions

Step 1: select tables

1. Access the Tables View:

   • Navigate to the Tables View in your multi-table river.

2. Activate Bulk Actions:

   • Click Bulk Actions. This option becomes active after two tables are selected.

3. Choose selection options:

   • All Tables in Selected Schemas: Select multiple schemas to include their respective tables.
   • All Tables: Apply actions to all selected tables in the river.

Step 2: choose properties

Once you select tables, configure the desired properties for bulk operations:

Extract method (standard extraction only):

• Keep Original Settings (default): Retain the current settings for all selected tables.
• Set to All: Apply a uniform extraction method across all selected tables.
• Set to Incremental: Use a common incremental field for all tables and configure its values.
  • Incremental Field Type: This is automatically detected based on the selected field (Timestamp, Date, Running Number, Epoch).

Set time period:

• Specify a custom time range for data extraction for tables using date/timestamp-based incremental fields.

CDC initial migration options:

• Available for tables using Change Data Capture (CDC) mode:
  • Overwrite: Replace existing data in the target.
  • Merge: Integrate changes into existing target data.

Loading mode (not applicable for CDC):

• Overwrite: Replaces the target table's content.
• Append: Add new data to the target table.
• Upsert-Merge: Merge data into the target table, supporting the following database platforms:
  • Databricks
  • Postgres
  • Redshift
  • Snowflake

Create a calculated column:

• Add calculated columns to the selected tables:
  • Specify the expression type (Source Expression/Target Expression).
  • Define the target column name.
  • Choose the data type based on the target system's supported formats.

note

Adding a calculated column with the same name as an existing column in the table overwrites the existing column with the new expression configuration.

Step 3: review and confirm

Before applying the bulk actions, review a summary of the selected options:

• Total Selected Tables: Shows the total number of tables included in the bulk action.
• Selection Method: Indicates if the tables chosen by schema or individually.

note

This action impacts multiple items and cannot be reversed. Review your changes before continuing.

After reviewing the summary and confirming the settings, execute the bulk actions.