- Más nuevo
- Más votos
- Más comentarios
Hello,
From the below code snippet, I could see that you are using both jobBookmarkKeys and jobBookmarkKeysSortOrder parameters.
additional_options = {"jobBookmarkKeys":["modtime"],"jobBookmarkKeysSortOrder":"desc"},
Please ensure that the bookmark key meets the criteria outlined here for JDBC sources:
- For each table, AWS Glue uses one or more columns as bookmark keys to determine new and processed data. The bookmark keys combine to form a single compound key.
- AWS Glue by default uses the primary key as the bookmark key, provided that it is sequentially increasing or decreasing (with no gaps).
- You can specify the columns to use as bookmark keys in your AWS Glue script. For more information about using Job bookmarks in AWS Glue scripts, see Using job bookmarks.
- AWS Glue doesn't support using columns with case-sensitive names as job bookmark keys.
I would recommend you to ensure that the column being used as a bookmark key has values with sequentially increasing numbers (like serial number) and avoid using jobBookmarkKeys as a string column, to ensure that the job bookmarks work as expected. Refer the following repost article as well.
In order for me to troubleshoot further, by taking a look at the logs in the back-end, please feel free to open a support case with AWS using the following link with the sanitized script, job run id and we would be happy to help.
Contenido relevante
preguntada hace 10 meses
preguntada hace 10 meses
preguntada hace 9 meses
preguntada hace 7 meses
