Viewing activities

Data Integration provides structured logs from connections and API requests. These logs provide an inside perspective of the processes with each of your connections.

Activities let you track, access, and analyze these logs. You can:

• View general information about your Data Flow instantly.
• Use filters to view the necessary Data Flow activities.
• Download the Activity Log and analyze each run.
• Configure the activities based on the Data Flow mode.
• If a specific run fails, try again.

You can also navigate to the Activities section by selecting Data Flow from the left-hand menu.

note

• The Activities View displays time in your local timezone, while the Data Flows schedule displays time in UTC.
• The Duration field shows the total time from the start of data processing to its completion, including connectivity to the server. In contrast, the Run Duration field indicates the exact time spent on each step, excluding any delays caused by connectivity or data fetching.

Activities logs retention

Activities logs retention refers to the period that activity logs are stored and accessible for review.

In Data Integration, there are three levels of log granularity:

• High-Level Data Flow Run: View each specific run without limit, with no retention limit in the user interface (UI). The API enforces fetching for the last 30 days only.
• Details of the Run per Data Flow: Data Integration keeps logs for 30 days.
• Complete Log: Provides the detailed logs of each run. Data Integration keeps logs for 14 days.

These varying levels of access and retention let you access the level of detail according to your needs.

note

Data Integration does not change the logs and is available exactly as the code generates them.