Beginner data engineering project - batch edition

Terraform module to create AWS Redshift resources 🇺🇦

Use AWS Lambda to Pull E-Scooter and E-Bike Location Data, store in S3 & Redshift using Data Vault Data Model, Server to Google Data Studio Dashboard

This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.

Data Warehouse with AWS Redshift and Visualizing data using Power BI

Simple getting started 1-node redshift cluster stack

Building and executing end-to-end ELT pipeline and driving analytics using Amazon Redshift as the data warehouse solution.

The idea is how can we prepare data to be used by Business Intelligence applications like Tableu or even Jupyternotebook! 👍 In order to help the business see an overview of the data in a diagram of what important features of the product their customers might be using. Mainly, how can we improve the performance of these OLAP and OLTP transactions…

Sparkify - Data Pipelines with Airflow - Udacity Data Engineering Expert Track.

In this project, an ETL pipeline is built for a database hosted on Redshift. In this project, data from S3 is loaded to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.

Health Synth simplifies healthcare with unified data, automated notifications, and patient feedback and monitoring the reports for better care and efficiency.

Deploy an Amazon Redshift Cluster in AWS using Terraform

Airflow orchestrated ETL (running in docker containers) that pulls batch data from an API to a local Postgres database, loads to AWS S3/Redshift provisioned by Terraform, and visualized in Quicksight.

An end-to-end AWS data engineering pipeline for processing, and visualizing historical climate data for Russia.

Udacity Course, Data Engineering Nanodegree, 3rd Project, Data Warehouse with Amazon Redshift

This project builds a cloud-based ETL pipeline for Sparkify to move data to a cloud data warehouse. It extracts song and user activity data from AWS S3, stages it in Redshift, and transforms it into a star-schema data model with fact and dimension tables, enabling efficient querying to answer business questions.

Data Pipeline with Apache Airflow

Simplistic Terraform module for creating a AWS Redshift cluster to allow direct access programmatically or via a tool like DBeaver, pgAdmin, etc.

Udacity Data Engineering project: Data Warehouse