Skip to main content
Feedback

Using copilot

warning (Copilot now available in private preview)

The Copilot and Blueprint features are now available to a select group of beta customers. This lets you explore and test Blueprint's latest capabilities before its official release.

If you want to join the beta program, click here to request access.

AI-driven REST API integration

The "Data Integration Copilot" is an AI-powered assistant that revolutionizes how you interact with data when working with custom or "non-native" Data sources. By leveraging machine learning and intelligent automation, Copilot simplifies complex processes, such as building custom connectors for REST API, enabling seamless integration with virtually any data source.

This AI-driven tool reduces the time and effort required to set up non-native data connectors, ensuring that technical or non-technical users can integrate, manage, and automate data flows.

Key AI capabilities of Data Integration copilot

  1. AI-powered REST API integration for non-native connectors

    • The Copilot's most powerful feature is to assist in creating custom connectors for "non-native" Data Sources using REST API. Instead of manually handling complex API documentation and configuration, Copilot simplifies the process by:
      • Automatically recognizing API structures.
      • Recognizing the appropriate API methods (GET, POST, and so on).
      • Generating authentication flows (O-Auth, API keys, and so on).
      • Mapping data fields for seamless integration.
      • With Copilot, you can connect to any REST API, even if Data Integration does not offer a native connector, providing seamless interaction with external data sources.

  2. Simplified non-native connector creation

    • If you want to integrate with less common data platforms or a custom-built API, Copilot acts as a bridge by simplifying the initial setup process. This AI assistant:
      • Automates the discovery of API endpoints and methods.
      • Generates the required parameters and payload structures.
      • Configures response handling, including data transformations, to fit seamlessly into your pipeline.
      • With Copilot, you can connect to any third-party service, regardless of whether part of Data Integration native integration ecosystem.

  3. Smart suggestions for API configurations

    • Configuring the correct parameters, headers, or pagination settings can be complex when working with the REST API. Copilot reduces this complexity by:
      • Analyze the API documentation and provide innovative suggestions for parameter setup, query strings, and pagination rules.
      • Automatically handles authentication mechanisms, including O-Auth 2.0, API keys, and custom headers.
      • This intelligence-driven automation eliminates the trial and error associated with API configuration.

  4. Automated data mapping and transformation

    • As part of River's Source to Target river creation Flow, once you connect to a data source, Data Integration automatically maps the source.

  5. Proactive error handling and troubleshooting

    • When working with custom connectors, API call errors or data formatting are challenging to troubleshoot. Copilot proactively:
    • Identifies potential issues in API configurations, such as incorrect endpoints, missing authentication, or incorrect parameters.
    • Provides detailed suggestions for correcting errors in real-time, letting you resolve problems without deep technical knowledge.
    • Offers insights into error handling best practices, such as retry logic, timeouts, and response validations, to process the data reliably.

AI-powered custom connector use case: connecting to any data source

The Data Integration Copilot is helpful for organizations that need to connect to data sources without native Data Integration connectors.

  • Step 1: Identify the API

    • Copilot helps you set up the API endpoint and method, suggesting the best configuration based on common patterns for the selected API.

  • Step 2: Set authentication

    • Copilot automatically detects and helps configure the necessary authentication (for example, O-Auth and API keys), guiding you through the setup.

  • Step 3: Define parameters and payload

    • The AI assistant automatically identifies necessary query parameters and payload structures, removing the need for manual configuration.

  • Step 4: Data mapping and transformation

    • Copilot automates the mapping of API response data to the desired format, ensuring that downstream systems can easily ingest the data.

Benefits of using copilot for non-native connectors

  • Speed and efficiency: Copilot drastically reduces the time required to set up custom connectors, enabling non-technical users to connect to API.
  • Error reduction: Copilot minimizes the risk of mis-configurations by providing intelligent suggestions and automated error handling.
  • Flexibility: You can connect to any data source, even if Data Integration does not offer a native connector—making the platform versatile for custom integrations..
  • Enhanced user experience: Copilot simplifies complex data integration tasks, making API integration accessible to users of all skill levels.

Data Integration’s Copilot transforms connecting to external API, especially non-native connectors, into a seamless experience. With its AI-powered capabilities, Copilot handles everything from API configuration to data mapping and error handling, empowering you to quickly and efficiently integrate any data source into your workflows. Copilot streamlines the data integration process to ensure accurate and scalable results, whether working with commonly used API or custom-built platforms.

On this Page