Skip to main content
Feedback

Confluence walkthrough

Updated 

Prerequisite

An established Confluence connection.

Step 1: Set up the data source

  1. Navigate to the Data Integration console.
  2. Select Create, then select Data Flow.
  3. Select Confluence as the data source.
  4. Under Source Connection, select an existing Confluence connection from the dropdown, or select Add New to create one. See Confluence connection for setup steps.
  5. Select Test Connection to confirm Data Integration can authenticate and reach your Confluence site.
  6. Select Next.
note

Get pages and Get blog posts each require you to select one or more spaces when you configure that report, later in this walkthrough. Get child pages requires one or more parent pages instead. All other reports are instance-wide and don't require a space selection.

Step 2: Select a data target

  1. Select the destination you want to load Confluence data into, then select Next.

    note

    Data Integration labels some destinations Alpha or Beta. Review that destination's documentation before you use it in a production data flow.

  2. Under Target Connection, select an existing connection from the dropdown, or select Add New to create one.

  3. Select Test Connection to confirm Data Integration can authenticate and reach your destination.

  4. Under Data Loading Settings, select the required fields for your destination, such as Schema. Select the refresh icon next to a field to reload its list of values. Expand Advanced Settings for additional options specific to your destination.

  5. Select Next.

Step 3: Configure the schema

  1. On the Tables Definitions screen, Data Integration lists every Confluence report available to sync: Get attachments, Get blog posts, Get child pages, Get footer comments, Get inline comments, Get labels, Get pages, and Get tasks. See Confluence predefined reports for what each report returns.

  2. Select the checkbox next to each report you want to sync. Use Search Reports to find a specific report, or use the Selected and All toggles to switch between views.

  3. For each selected report, review its Target Table, Extract Method, and Loading Mode. For the incremental Get tasks report, set the Incremental Field, Incremental Type, Start Value, and End Value.

  4. Optional: select Extraction Mode, then look for additional options such as a Table Prefix for target table names or a Convert File To Parquet Format toggle.

  5. If you change your space or parent page selection after this step, select Reload Reports Metadata to refresh the list of available reports.

  6. Select Next.

Step 4: Set the schedule and settings

  1. Turn on Schedule Data Flow and set how often you want the data flow to run. Data Integration displays and runs schedules in UTC.
  2. Optional: turn on Set Custom Timeout to set a fixed run timeout. By default, Data Integration handles the run automatically per run, based on table size, capped between 12 hours and up to 7 days.
  3. Optional: under Notifications, turn on Failure, Warning, or Run Threshold, and enter one or more email addresses, separated by commas, to receive alerts.
  4. Under Data Flow Info, enter a Data Flow Name. Data Integration suggests a default name based on your source and target connections and the current date and time. Optionally select a Group and enter a Description.
  5. Select Activate to save the data flow and start running it on its schedule.
On this Page