Build Databricks ecosystem using Amazon Web Services to handle data that can provide advanced analytics capabilities.

In this project based in a real-world scenario, I acted as the Cloud Specialist to build Databricks environments using AWS to create a data warehouse that can handle data at scale, provide advanced analytics capabilities, and support a wide range of data sources and formats.

Below are few screenshots:

Create the Databricks Workspace

AWS creates the Cloud Formation Stack

Workspace is created in Databricks

Databricks support wide range of datasource and format

Sample dashboards

Create Cluster

Upload files to DBFS

Can see the tables are created

Create the Jupyter Notebook to run the spark jobs