Data Pipeline with Airflow and AWS Tools (S3, Lambda & Glue)
Towards Data Science
APRIL 6, 2023
Create a new IAM user with authorization to read and write to S3 and run Glue Jobs, store the access key pair generated. In the airflow UI (localhost:8080), under the admin->connections tab, create a new AWS connection, named AWSConnection , using the previously created access key pair. 1] Amazon Web Services Latin America.
Let's personalize your content