RVR-BQ-RDBMS-012

1. Issue Summary:

   • The error "FAILED_TO_FIND_INCREMENT_FIELD_IN_MAPPING" with Error Code: RVR-BQ-RDBMS-012 indicates that Data Integration failed to find the increment field in the mapping for a BigQuery source (bq_src). This typically occurs when an incremental loading method is configured, but the specified field to track increments is missing or not correctly identified in the mapping.
   • Incremental loads require a field (usually a timestamp or ID) to track new or updated data since the last extraction. Without this field, the platform cannot determine changes, leading to the error.

2. Action Steps:

   • Review the configuration of the River involving the BigQuery source to ensure that the correct incremental field is specified.
   • Go to the mapping section of your River configuration:
     • Ensure that the incremental field is present and correctly mapped. This field should be set as a timestamp or a unique identifier that reflects changes such as updates or insertions.
     • Verify that changes in this field correspond correctly to the data changes intended for extraction.
   • If the field should be present but is not available in the mapping, check the schema of the BigQuery table to ensure it is currently a part of the dataset.
   • Update the River configuration to include this field if it is missing. Resync the schema if changes have been made to the BigQuery source since the River was last configured.

3. External References:

   • Data Integration Documentation on Database Incremental Rivers - Reference for setting incremental fields in mapping.
   • BigQuery Documentation - Guidance on how to manage and structure datasets in BigQuery.

If the issue persists or you need further assistance, please open a ticket with Data Integration support.