Skip to main content
Feedback

Email walkthrough

Prerequisites

Before proceeding with data extraction from emails to Data Integration, ensure you have an Email connection within Data Integration.

Pulling data from Email

Procedure

Step 1: creating the river and Email connection

  • Create a Source to Target River in the Data Integration Account.
  • Locate Email in the list of data sources under Organization.
  • Under Source Connection, select the created connection or create a new one.

Step 2: selecting date range

  • Specify the date range for data retrieval.
  • Provide a start date.
  • Leaving the end date empty pulls data up to the current time of the river's run.
note
  • Data Integration pulls emails from the specified date range.
  • The most recent emails received since the last run are pulled in case of multiple runs on the same day.
  • The Entire Day checkbox pulls the entire day's emails regardless of new emails, potentially causing duplicates.

Step 3: applying filter attributes

Set desired filter attributes, such as:

  • From (sender's email address)
  • Label (optimal label from the list)
  • Subject (entire subject or specific keywords)
  • Has the word (specific words in the mail content)
  • Body (specific words in the mail content)
  • File Name (specific filename)
  • File Type (desired file type)
  • Specify headers for files/sheets.

When extracting data from a hyperlink, ensure to complete the following fields:

  • From
  • Label
  • Subject
  • File Type
  • Select the checkbox labeled Is Link To Download Report
  • Link Name: Enter either the URL's exact name or the URL itself.

Step 4: testing and configuration

  • Test filters in Gmail's UI to ensure accuracy.
  • Set corresponding filters in Data Integration Gmail source configuration.

Step 5: configuring timestamp

To work with a DD/MM/YYYY timestamp, enable the corresponding checkbox at the bottom of the river page.

Step 6: source auto mapping

Automatically sets the mapping based on the data returned from the selected files or sheets. Modify generated fields as needed:

  • Fetch desired fields in the Mapping table.
  • Add or remove fields.
  • Select the fill empty checkbox for cells with no values.
  • Define fields as source or static.
  • Use expressions for static fields.

Common issues and solutions

Empty data notification

  • A warning notification is not triggered if no data is available for the selected time range.
  • To receive notifications for empty responses, manually add the **email_date** field during the auto-mapping stage.

Additional metadata fields

Add the **email_date TIMESTAMP** field to capture the date when the file was in Gmail. Perform a new auto-mapping to include the new metadata field.

On this Page