RVR-BQ-RDBMS-012
Issue summary
- The error "FAILED_TO_FIND_INCREMENT_FIELD_IN_MAPPING" with Error Code: RVR-BQ-RDBMS-012 indicates that Data Integration failed to find the increment field in the mapping for a BigQuery source (
bq_src). This typically occurs when you configure the incremental loading method, but the specified field to track increments is missing or not correctly identified in the mapping. - Incremental loads require a field (a timestamp or ID) to track new or updated data since the last extraction. Without this field, the platform cannot determine changes, leading to the error.
Action steps
To resolve the error, follow these steps:
- Review the configuration of the Data Flow involving the BigQuery source to ensure that the correct incremental field you specify.
- Go to the mapping section of your Data Flow configuration:
- Ensure that the incremental field is present and correctly mapped. This field should configure as a timestamp or a unique identifier that reflects changes such as updates or insertions.
- Verify that changes in this field correspond correctly to the data changes intended for extraction.
- If the field should be present but is not available in the mapping, check the schema of the BigQuery table to ensure it is currently a part of the dataset.
- Update the Data Flow configuration to include this field if it is missing. Resync the schema if changes have occurred to the BigQuery source since the Data Flow was last configured.
External references
- Data Integration Documentation on Database Incremental Data Flows - Reference for setting incremental fields in mapping.
- BigQuery Documentation - Guidance on how to manage and structure datasets in BigQuery.
note
If the issue persists or you need help, open a case with Data Integration Support. In the console sidebar, select Help > Contact Us and follow the instructions.