Order processing system from Amazon S3 using Glue job and Crawlers to Serverless Amazon Redshift

In this project based in a real-world scenario, I acted as the Cloud Specialist to establish an order processing system to push the data from Amazon S3 bucket to Amazon Redshift using Glue Data Catalog and Crawlers.

Below are few screenshots:

Created EC2 instance

Created S3 bucket and uploaded the csv file

Created the crawlers in AWS Glue

Run the crawler

View data in Amazon Athena

Created Amazon Redshift cluster

Create and run the crawler

Create gateway endpoint to fix the error

Crawler ran successfully

Create the ETL job

Check the record in the table before running the ETL job

Run the ETL job and check the records in Amazon Redshift