Skip to main content
Feedback

MySQL walkthrough

Working with MySQL

Step 1: Establish a connection

Make sure you have appropriate credentials for establishing a connection with a MySQL database server.

Step 2: Grant read-only access for data extraction in MySQL

Configure a MySQL user with read-only access to extract data from a specific database. Execute the following SQL statements in MySQL:

-- Grants read access and view metadata permissions on the target database
GRANT SELECT, SHOW VIEW ON my_database.* TO 'etl_user'@'%';

-- Grants permission to list available databases (optional for some tools)
GRANT SHOW DATABASES ON *.* TO 'etl_user'@'%';

Replace placeholders

  • my_database: Target database name.
  • etl_user: MySQL username used for extraction.

Step 3: Choose the Data Flow mode

Once you have successfully established a connection to MySQL, select the Data Flow mode to load data into a Target.

There are two available options for you to choose from:

note

By clicking on the highlighted modes, Data Integration redirects you to a relevant page that offers a comprehensive explanation and presents a Product Tour example showcasing the available features in MySQL.

  • Multi-Tables: Simultaneously load multiple tables from MySQL to your desired Target.
    • Standard Extraction - This Data Flow mode maps, transforms, and loads data from multiple tables into a unified schema. It uses SQL queries for transformations, and you can schedule it or trigger it manually.
    • Change Data Capture (CDC) - This mode monitors the Source database logs, capturing and transforming changes in real-time. This ensures minimal data loss and low-latency transfer when loading the transformed data into the target database, keeping it in sync with the Source.
  • Custom Query: Create a customized query and import it into your designated Target.

Step 4: Run the Data Flow

Once you have successfully configured the Data Flow mode, selected the extraction method, and set up the scheduling, you are ready to start with the Data Flow and its operation.

On this Page