Data Integration webhooks integration
The Data Integration Webhooks provide a seamless way to connect HTTP endpoints on the web to your cloud data warehouse. With Webhooks, you can stream real-time events or notifications and record them in a cloud-based Relational Database Management System (RDBMS) or Storage type. You can configure Webhooks to work with your chosen HTTP endpoint.
Webhook data from Source to Target
Step 1: selecting create river
Select Create River from the menu and click Source to Target River.
Step 2: configuring river settings
Provide a name and description. Navigate to the Source tab and look up Webhook.
Step 3: enabling webhook
Enable the Webhook toggle. Confirm by clicking the Got it and proceed to the Target tab.
Step 4: selecting target data warehouse
Choose your desired data warehouse destination. Configure the settings for your destination, including connection, database, schema, and table name.
Data Integration creates the table if it does not exist.
Step 5: defining JSON example
- Navigate to the Source tab.
- In the JSON example field, paste a sample JSON response representing the data structure sent to the webhook endpoint. If unavailable, obtain a sample using a dummy webhook endpoint or manually map columns in the next step.
Step 6: column mapping
- Go to the Columns Mapping tab.
- If a JSON example is provided, click the button to generate destination column mapping automatically. If not, manually create destination columns.
Nested JSON columns require manual mapping, even with an example JSON provided. Nested column auto-mapping is planned for a future release.
Step 7: toggle columns confirmation
Once columns are mapped, enable the toggle. If configured correctly, you are provided with your unique Webhook Data Integration endpoint. Copy the endpoint and confirm.
Step 8: integrating with a web service
Navigate to your web service and paste the Data Integration endpoint into the Payload URL or the related option, establishing the link between your web service and the Data Integration console.
Limitation
The capability to receive and handle events through a Webhook is constrained to 10,000 events within a 5-minute duration per IP address.