Skip to main content
Feedback

Email walkthrough

Prerequisites

Before proceeding with data extraction from emails to Data Integration, ensure you have an Email Connection within Data Integration.

How to pull data from Email

  • Create a Source to Target River.
  • Locate Email in the list of data sources under Organization.
  • Under Source Connection, select the previously created connection or create a new one.

Date range

  • Specify the date range for data retrieval.
  • Provide a start date.
  • Leaving the end date empty will pull data up to the current time of the river's run.
note
  • Data Integration pulls emails from the specified date range.
  • The most recent emails received since the last run are pulled in case of multiple runs on the same day.
  • The Entire Day checkbox pulls the entire day's emails regardless of new emails, potentially causing duplicates.

Filter attributes

  • Set desired filters attributes, such as:
  • From (sender's email address)
  • Label (optimal label from the list)
  • Subject (entire subject or specific keywords)
  • Has the word (specific words in the mail content)
  • Body (specific words in the mail content)
  • File Name (specific filename)
  • File Type (desired file type)
  • Specify headers for files/sheets.

When extracting data from a hyperlink, ensure to complete the following fields:

  • From
  • Label
  • Subject
  • File Type
  • Select the checkbox labeled Is Link To Download Report
  • Link Name: Enter either the URL's exact name or the URL itself.

Testing and configuration

  • Test filters in Gmail's UI to ensure accuracy.
  • Set corresponding filters in Data Integration Gmail source configuration.

Timestamp configuration

To work with DD/MM/YYYY timestamp, enable the corresponding checkbox at the bottom of the river page.

Source auto mapping

Automatically sets mapping based on returned data from files/sheets selected. Modify generated fields as needed:

  • Fetch desired fields in the Mapping table.
  • Add or remove fields.
  • Select fill empty checkbox for cells with no values.
  • Define fields as source or static.
  • Utilize expressions for static fields.

Common issues and solutions

Empty data notification:

  • A warning notification will not be triggered if no data is available for the selected time range.
  • To receive notifications for empty responses, manually add the email_date field during the automapping stage.

Additional metadata fields:

Add the email_date TIMESTAMP field to capture the date when the file was in Gmail. Perform a new automapping to include the new meta-data field.

On this Page