RVR-DTF-500

Issue summary

The error "General error while trying to copy parquet to Redshift" with error code RVR-DTF-500 occurs during a data transfer process in Data Integration from Parquet files to Amazon Redshift. This problem arises due to configuration issues, permissions problems, or data format inconsistencies between the Parquet files and Redshift's expected input.

Action steps

To resolve the error, follow these steps:

Check Permissions: Ensure that the IAM role associated with Data Integration has the necessary permissions to access both the source (S3) and target (Redshift) services. This includes permissions for reading Parquet files from S3 and writing them to Redshift.
Check Data Format: Verify that the Parquet file format is compatible with Redshift. Ensure that the schema and data types in Parquet supports Redshift according to AWS documentation on supported data types in Redshift.
Configure Redshift Correctly: Make sure that the Redshift cluster is properly configured to accept the data. Check that the table and schema targeted exist and that the Redshift COPY command is correctly configured in the Data Integration process.
Inspect Data Integration Setup: Confirm that the data pipeline in Data Integration handle Parquet files. This includes checking the settings under the Target configuration to ensure all selections correspond to Redshift's requirements.
Review Error Details: Look at any logs or error details provided by Data Integration during the transfer, which could suggest more specifically where the problem occurs.

External references

For more information on configuring Amazon Redshift as a target in Data Integration, refer to Amazon Redshift as a Target Connection topic.
For details on Parquet file compatibility and configurations, refer to AWS Redshift Supported Data Types topic.
For general guidance on permissions for cross-service data movement, refer to AWS Identity and Access Management (IAM) Documentation topic.

note

If the issue persists or you need help, open a case with Data Integration Support. In the console sidebar, select Help > Contact Us and follow the instructions.