Skip to content

how to centrally define permission model with lake formation in lake house?

0

Currently, I must define permissions model in lake house using lake formation that I can query data by Athena. It's ok if data sources come from S3 but seem be impossible if it's Redshift. Athena can not using glue data catalog to query data in Redshift. So I can't use only lake formation to grant permission for all data source (S3, Redshift, rds).

asked 2 years ago583 views

1 Answer
0

You're right that Lake Formation can't directly manage permissions for all data sources (S3, Redshift, RDS) in one place. Here's a concise solution:

For Redshift Data:

  • Use Redshift Spectrum to create external tables that point to S3
  • Export important Redshift data to S3 using UNLOAD commands
  • Apply Lake Formation permissions to these external tables

For RDS Data:

  • Use AWS Glue connections to catalog RDS tables
  • Set up Athena Federated Query with Lambda connectors
  • Query through Athena (respecting Lake Formation permissions)

Relevant Documentation:

This hybrid approach is currently the best way to implement centralized governance across these different data sources until AWS enhances Lake Formation's direct integration capabilities.

AWS
EXPERT

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.