UDF for encryption and decryption in redshift

I need to create a aes encryption ECB UDF in the redshift. To achieve this, i have imported pycryptodome zip file in the S3 with the name Crypto.zip and create library in the redshift.

When i try to use this UDF, i am getting, the below error:

ERROR: OSError: Cannot load native module 'Crypto.Cipher._raw_ecb': Not found '_raw_ecb.so', Not found '_raw_ecbmodule.so'. Please look at svl_udf_log for more information Detail: ----------------------------------------------- error: OSError: Cannot load native module 'Crypto.Cipher._raw_ecb': Not found '_raw_ecb.so', Not found '_raw_ecbmodule.so'. Please look at svl_udf_log for more information code: 10000 context: UDF query: location: udf_client.cpp:366 process:

I need to use pycryptodome pip package only,

Themen

Datenbank Analysen

Tags

Daten extrahieren, transformieren & laden Amazon Redshift Verschlüsselung

Sprache

English

rePost-User-5147290

gefragt vor 5 Monaten238 Aufrufe

1 Antwort

Neueste
Die meisten Stimmen
Die meisten Kommentare

Sind diese Antworten hilfreich? Stimmen Sie der richtigen Antwort zu, damit die Community von Ihrem Wissen profitieren kann.

Take a look at this sample https://github.com/aws-samples/implement-column-level-encryption-in-amazon-redshift-with-aws-glue-and-aws-lambda-udf , it leverage AWS Lambda and you can use layers (https://docs.aws.amazon.com/lambda/latest/dg/chapter-layers.html) for your custom code.

MilindOke

beantwortet vor 5 Monaten

rePost-User-5147290
vor 5 Monaten
Here, my use case is, i have to decrypt the data which is encrypted say from MySQL RDS. I am trying to use pycryptdome package, by storing whl file as zip file in the S3 bucket and created a library using zip path as mentioned in the https://docs.aws.amazon.com/redshift/latest/dg/r_CREATE_LIBRARY.html

Here, i am getting the error as mentioned in the description.

Instead of interfacing different services to decrypt data, Can we use existed redshfit functionality like 'CREATE FUNCTION' and 'CREATE LIBRARY'?
MilindOke
vor 5 Monaten
There are particular requirement to be satisfied, refer https://docs.aws.amazon.com/redshift/latest/dg/udf-python-language-support.html#udf-importing-custom-python-library-modules, and refer section To import a custom Python module into your cluster
rePost-User-5147290
vor 5 Monaten
Yes.. i followed same steps for all UDFs. I am facing this error with pycryptodome package when i run the udf.
MilindOke
vor 5 Monaten
Then I request you to open a Support Ticket for deeper investigation and troubleshooting.
rePost-User-5147290
vor 5 Monaten
Thank you. Then i need to raise support ticket only.

Relevanter Inhalt

Wie behebe ich den Fehler „The specified queue does not exist or you do not have access to it.“, wenn ich einen AWS Glue Job ausführe, um Nachrichten an Amazon SQS in einer anderen Region zu senden?
AWS OFFICIALAktualisiert vor 3 Jahren
Wie vermeide ich den Fehler „Unable to validate the following destination configurations“ bei Lambda-Ereignisbenachrichtigungen in CloudFormation?
AWS OFFICIALAktualisiert vor 3 Jahren
Wie kann ich den Fehler „Waiting for the slave SQL thread to free enough relay log space“ in Amazon Aurora MySQL beheben?
AWS OFFICIALAktualisiert vor 3 Jahren
Wie behebe ich den Fehler „The new key policy will not allow you to update the key policy in the future“, wenn ich versuche, mit AWS CloudFormation einen AWS-KMS-Schlüssel zu erstellen?
AWS OFFICIALAktualisiert vor 2 Jahren