CodeWithYu

@UCAEOtPgh29aXEt31O17Wfjg - 36.2K subscribers

Data Engineer | Solution Architect | Open Source. Welcome to CodeWithYu, your gateway to the world of data engineering! Dive into comprehensive tutorials and practical data engineering projects. I regularly post contents related to data engineering, fast data, big data and system architectures every week. Join our community of data enthusiasts! Don't forget to leave a like and subscribe to stay updated with amazing contents!

Home Videos Live Playlists

Build a Production-Ready Real-Time CDC Pipeline (Debezium + Kafka + Postgres)

Build a Production-Ready Real-Time CDC Pipeline (Debezium + Kafka + Postgres) CodeWithYu

5 months ago

Apache Spark on Kubernetes: The RIGHT Way (No Master/Worker Clusters Needed)

Apache Spark on Kubernetes: The RIGHT Way (No Master/Worker Clusters Needed) CodeWithYu

3.1K views - 5 months ago

Building Self-Healing Data Pipeline - End to End Data Engineering Project

Building Self-Healing Data Pipeline - End to End Data Engineering Project CodeWithYu

4.9K views - 7 months ago

Build Churn Training and Inference AI from Scratch - End to End Machine Learning Project - Part 1

Build Churn Training and Inference AI from Scratch - End to End Machine Learning Project - Part 1 CodeWithYu

2K views - 8 months ago

Build Churn Training and Inference AI from Scratch - End to End Machine Learning Project

Build Churn Training and Inference AI from Scratch - End to End Machine Learning Project CodeWithYu

8 months ago

Apache Iceberg Explained in 10 Minutes – Everything You Need to Know!

Apache Iceberg Explained in 10 Minutes – Everything You Need to Know! CodeWithYu

3.5K views - 9 months ago

End to End Modern Distributed Data Lakehouse using Apache Iceberg, Trino, Airflow, DBT and Minio

End to End Modern Distributed Data Lakehouse using Apache Iceberg, Trino, Airflow, DBT and Minio CodeWithYu

9 months ago

End to End Modern Distributed Data Lakehouse using Apache Iceberg, Trino, Airflow, DBT and Minio

End to End Modern Distributed Data Lakehouse using Apache Iceberg, Trino, Airflow, DBT and Minio CodeWithYu

8.8K views - 9 months ago

Building Realtime End to End Sales Forecasting AI from Scratch

Building Realtime End to End Sales Forecasting AI from Scratch CodeWithYu

12K views - 10 months ago

DBT Cloud Masterclass

DBT Cloud Masterclass CodeWithYu

1 year ago

10 Step Roadmap to Become an Expert Data Engineer with Projects

10 Step Roadmap to Become an Expert Data Engineer with Projects CodeWithYu

7.1K views - 1 year ago

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform & AWS - PART 1

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform & AWS - PART 1 CodeWithYu

4.7K views - 1 year ago

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform & AWS

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform & AWS CodeWithYu

1 year ago

Build Realtime Fraud Detection AI from Scratch - End to End Machine Learning Project - Part 1

Build Realtime Fraud Detection AI from Scratch - End to End Machine Learning Project - Part 1 CodeWithYu

35K views - 1 year ago

Build a Fraud Detection AI from Scratch: End-to-End Machine Learning Project

Build a Fraud Detection AI from Scratch: End-to-End Machine Learning Project CodeWithYu

1 year ago

Realtime Logs Processing with Apache Airflow, Kafka and Elasticsearch - PART 1

Realtime Logs Processing with Apache Airflow, Kafka and Elasticsearch - PART 1 CodeWithYu

11K views - 1 year ago

Realtime Logs Processing with Apache Airflow, Kafka and Elasticsearch - End to End Data Engineering

Realtime Logs Processing with Apache Airflow, Kafka and Elasticsearch - End to End Data Engineering CodeWithYu

1 year ago

Elasticsearch for High Throughout Systems - 1 Billion records!

Elasticsearch for High Throughout Systems - 1 Billion records! CodeWithYu

2.4K views - 1 year ago

End to End Monitoring with Prometheus, Grafana, Apache Kafka and Spark - A Data Engineering Project

End to End Monitoring with Prometheus, Grafana, Apache Kafka and Spark - A Data Engineering Project CodeWithYu

5.1K views - 1 year ago

End to End Monitoring of High Performance Systems - A Data Engineering Project PART 1

End to End Monitoring of High Performance Systems - A Data Engineering Project PART 1 CodeWithYu

5.1K views - 1 year ago

Monitoring High Performance Systems - An End to End Data Engineering Project

Monitoring High Performance Systems - An End to End Data Engineering Project CodeWithYu

1 year ago

1.2 Billion Records Per Hour High Performance Kafka and Spark - End to End Data Engineering Project

1.2 Billion Records Per Hour High Performance Kafka and Spark - End to End Data Engineering Project CodeWithYu

22K views - 1 year ago

Working with Amazon Managed Service for Apache Flink (MSF) - End to End Data Engineering Project

Working with Amazon Managed Service for Apache Flink (MSF) - End to End Data Engineering Project CodeWithYu

1 year ago

Setting up Apache Spark Master Worker Architecture

Setting up Apache Spark Master Worker Architecture CodeWithYu

1 year ago

Setting up Apache Kafka in KRaft Mode

Setting up Apache Kafka in KRaft Mode CodeWithYu

1 year ago

Setting up Apache Projects Architectures

Setting up Apache Projects Architectures CodeWithYu

1 year ago

Building a High Performance Real-Time Analytics Database - End to End Data Engineering Project

Building a High Performance Real-Time Analytics Database - End to End Data Engineering Project CodeWithYu

9.9K views - 1 year ago

Realtime Streaming for Anomaly Detection | An End to End Data Engineering Project

Realtime Streaming for Anomaly Detection | An End to End Data Engineering Project CodeWithYu

1 year ago

Realtime Stock Market Anomaly Detection using ML Models | An End to End Data Engineering Project

Realtime Stock Market Anomaly Detection using ML Models | An End to End Data Engineering Project CodeWithYu

8.5K views - 1 year ago

Building Realtime Data Warehouses from Scratch | End to End Data Engineering Project

Building Realtime Data Warehouses from Scratch | End to End Data Engineering Project CodeWithYu

13K views - 1 year ago

Decodable vs AWS Managed Service for Apache Flink (MSF) - End to End Data Engineering Project

Decodable vs AWS Managed Service for Apache Flink (MSF) - End to End Data Engineering Project CodeWithYu

3.7K views - 1 year ago

Query Optimisation for Data Engineers | End to End Walkthrough

Query Optimisation for Data Engineers | End to End Walkthrough CodeWithYu

5.7K views - 1 year ago

Realtime Algorithmic Trading with Apache Flink | End to End Data Engineering Project

Realtime Algorithmic Trading with Apache Flink | End to End Data Engineering Project CodeWithYu

9.7K views - 2 years ago

Realtime Streaming with Data Lakehouse - End to End Data Engineering Project

Realtime Streaming with Data Lakehouse - End to End Data Engineering Project CodeWithYu

11K views - 2 years ago

Building Data Lakehouse from Scratch - End to End Data Engineering Project

Building Data Lakehouse from Scratch - End to End Data Engineering Project CodeWithYu

16K views - 2 years ago

Real Estate End to End Data Engineering using AI

Real Estate End to End Data Engineering using AI CodeWithYu

27K views - 2 years ago

Designing DataWarehouse from Scratch | End to End Data Engineering

Designing DataWarehouse from Scratch | End to End Data Engineering CodeWithYu

31K views - 2 years ago

Designing #DataWarehouse from Scratch using #Redshift, #medallion #architecture and #DBT

Designing #DataWarehouse from Scratch using #Redshift, #medallion #architecture and #DBT CodeWithYu

745 views - 2 years ago

End to End Realtime Streaming with Unstructured Data | Get Hired as an Experienced Data Engineer

End to End Realtime Streaming with Unstructured Data | Get Hired as an Experienced Data Engineer CodeWithYu

24K views - 2 years ago

Smart City End to End Realtime Data Engineering Project | Get Hired as an AWS Data Engineer

Smart City End to End Realtime Data Engineering Project | Get Hired as an AWS Data Engineer CodeWithYu

90K views - 2 years ago

Kubernetes for Modern Data Engineering: An End to End Data Engineering Project

Kubernetes for Modern Data Engineering: An End to End Data Engineering Project CodeWithYu

20K views - 2 years ago

CI/CD for Modern Data Engineering | End to End Data Engineering Project

CI/CD for Modern Data Engineering | End to End Data Engineering Project CodeWithYu

16K views - 2 years ago

Top Data Engineering Tools and Technologies for 2024

Top Data Engineering Tools and Technologies for 2024 CodeWithYu

2.4K views - 2 years ago

Building Robust Data Pipelines for Modern Data Engineering | End to End Data Engineering Project

Building Robust Data Pipelines for Modern Data Engineering | End to End Data Engineering Project CodeWithYu

97K views - 2 years ago

Data Engineering Trivia: can you get it all?

Data Engineering Trivia: can you get it all? CodeWithYu

764 views - 2 years ago

Realtime Voting System | End-to-End Data Engineering Project

Realtime Voting System | End-to-End Data Engineering Project CodeWithYu

27K views - 2 years ago

Realtime Streaming with Apache Flink | End to End Data Engineering Project

Realtime Streaming with Apache Flink | End to End Data Engineering Project CodeWithYu

45K views - 2 years ago

Realtime Change Data Capture Streaming | End to End Data Engineering Project

Realtime Change Data Capture Streaming | End to End Data Engineering Project CodeWithYu

31K views - 2 years ago

Apache Flink For Analytics | End to End Data Engineering Project

Apache Flink For Analytics | End to End Data Engineering Project CodeWithYu

12K views - 2 years ago

Apache Spark Processing with AWS EMR | Data Engineering Project

Apache Spark Processing with AWS EMR | Data Engineering Project CodeWithYu

12K views - 2 years ago

Creating and Submitting Java Spark Jobs to Spark Clusters

Creating and Submitting Java Spark Jobs to Spark Clusters CodeWithYu

1K views - 2 years ago

Creating and Submitting Scala Jobs to Spark Clusters using Airflow

Creating and Submitting Scala Jobs to Spark Clusters using Airflow CodeWithYu

1.3K views - 2 years ago

Creating and Submitting Pyspark Jobs to Spark Clusters

Creating and Submitting Pyspark Jobs to Spark Clusters CodeWithYu

3.8K views - 2 years ago

Setting up Apache Airflow and Spark Clusters on Docker

Setting up Apache Airflow and Spark Clusters on Docker CodeWithYu

10K views - 2 years ago

Apache Airflow with Spark, Pyspark, Java, Scala for Data Engineers || Full Course

Apache Airflow with Spark, Pyspark, Java, Scala for Data Engineers || Full Course CodeWithYu

28K views - 2 years ago

Realtime Socket Streaming with Apache Spark | End to End Data Engineering Project

Realtime Socket Streaming with Apache Spark | End to End Data Engineering Project CodeWithYu

26K views - 2 years ago

Reddit Data Pipeline Engineering | AWS End to End Data Engineering

Reddit Data Pipeline Engineering | AWS End to End Data Engineering CodeWithYu

112K views - 2 years ago

End to End Modern Data Engineering with DBT (Data Build Tool)

End to End Modern Data Engineering with DBT (Data Build Tool) CodeWithYu

20K views - 2 years ago

End to End Data Engineering On Azure Spark Cluster: Japan Visa Analysis

End to End Data Engineering On Azure Spark Cluster: Japan Visa Analysis CodeWithYu

13K views - 2 years ago

Football Data Analytics + Tableau | Azure End To End Data Engineering Project - Part 3

Football Data Analytics + Tableau | Azure End To End Data Engineering Project - Part 3 CodeWithYu

4.5K views - 2 years ago