Data Integration webhooks integration guide
Overview
Data Integration Webhooks provide a seamless way to connect HTTP endpoints on the web to your cloud data warehouse. With Webhooks, you can stream real-time events or notifications and record them in a cloud-based Relational Database Management System (RDBMS) or Storage type. This guide outlines the steps to enable and configure Webhooks to work with your chosen HTTP endpoint.
Webhook data from Source to Target
Step 1: Select create river
Select Create River from the menu and then click Source to Target River.
Step 2: Configure river settings
Provide a name and description, then go to the Source tab and look up Webhook.
Step 3: Enable webhook
Toggle the Webhook switch to true. Confirm by clicking the Got it and proceed to the Target tab.
Step 4: Select target data warehouse
Choose your desired data warehouse destination. Configure the settings for your destination, including connection, database, schema, and table name.
Data Integration will create the table if it does not exist.
Step 5: Define JSON example
Return to the Source tab. In the JSON example field, paste a sample JSON response representing the data structure sent to the webhook endpoint. If unavailable, obtain a sample using a dummy webhook endpoint or manually map columns in the next step.
Step 6: Column mapping
Go to the Columns Mapping tab. If a JSON example was provided in Step 5, click the button to generate destination column mapping automatically. If not, manually create destination columns.
Nested JSON columns require manual mapping, even with an example JSON provided. Nested column auto-mapping is planned for a future release.
Step 7: Toggle columns confirmation
Once columns are mapped, toggle to true. If configured correctly, you will be provided with your unique Webhook Data Integration endpoint. Copy the endpoint and confirm with Got it.
Step 8: Integrate with web service
Navigate to your web service and paste the Data Integration endpoint into the Payload URL or the related option, establishing the link between your web service and the Data Integration console.
Limitation
The capability to receive and handle events through a Webhook is constrained to 10,000 events within a 5-minute duration per IP address.
