The Data and AI Guy

@UCQq79zHGZJNzm3SPOfLNmrw - 25.8K subscribers

Your one stop shop for all your Data needs! Have a hard problem you'd like solved but don't know how? Send it to me at [email protected] and I'll make a video on it! www.linkedin.com/in/george-yates/

Home Videos Live Playlists

What Is ClickHouse? (And Why Every Data Team Is Suddenly Using It)

What Is ClickHouse? (And Why Every Data Team Is Suddenly Using It) The Data and AI Guy

226 views - 21 hours ago

Stop Losing Streaming Data: Build a Kafka DLQ from Scratch

Stop Losing Streaming Data: Build a Kafka DLQ from Scratch The Data and AI Guy

213 views - 3 days ago

How Message Queues Actually Prevent System Crashes

How Message Queues Actually Prevent System Crashes The Data and AI Guy

156 views - 6 days ago

Temporal.io Setup & Walkthrough: Write Distributed Systems Like Normal Code

Temporal.io Setup & Walkthrough: Write Distributed Systems Like Normal Code The Data and AI Guy

301 views - 1 week ago

The Ultimate Postgres Observability Dashboard (Read-Only & Self-Hosted)

The Ultimate Postgres Observability Dashboard (Read-Only & Self-Hosted) The Data and AI Guy

633 views - 1 week ago

Top AI & ML Interview Questions (And The Answers That Actually Get Offers)

Top AI & ML Interview Questions (And The Answers That Actually Get Offers) The Data and AI Guy

463 views - 1 week ago

Run Claude Code for Free: Wiring Up Local Qwen Models via Ollama

Run Claude Code for Free: Wiring Up Local Qwen Models via Ollama The Data and AI Guy

1.1K views - 2 weeks ago

From Data Engineer to AI Engineer: What You Keep & What You Learn

From Data Engineer to AI Engineer: What You Keep & What You Learn The Data and AI Guy

858 views - 2 weeks ago

Supabase Explained: The Open-Source Backend You Need

Supabase Explained: The Open-Source Backend You Need The Data and AI Guy

1.7K views - 2 weeks ago

FastAPI in 15 Minutes: The Ultimate Crash Course for Beginners

FastAPI in 15 Minutes: The Ultimate Crash Course for Beginners The Data and AI Guy

1.4K views - 3 weeks ago

The Ultimate Local Embedding Pipeline: From TXT to Vector Database

The Ultimate Local Embedding Pipeline: From TXT to Vector Database The Data and AI Guy

502 views - 3 weeks ago

How to Build a Data Quality Framework in Databricks with Great Expectations

How to Build a Data Quality Framework in Databricks with Great Expectations The Data and AI Guy

560 views - 3 weeks ago

Data Governance Explained: From Theory to Production

Data Governance Explained: From Theory to Production The Data and AI Guy

710 views - 4 weeks ago

The Ultimate Guide to Context Engineering for AI Agents

The Ultimate Guide to Context Engineering for AI Agents The Data and AI Guy

920 views - 1 month ago

How to Build a Self-Healing Airflow Agent with Claude and Python

How to Build a Self-Healing Airflow Agent with Claude and Python The Data and AI Guy

832 views - 1 month ago

Feature Stores: The Missing Piece in Your ML Infrastructure

Feature Stores: The Missing Piece in Your ML Infrastructure The Data and AI Guy

344 views - 1 month ago

What is DuckDB? The Database Changing Data Engineering Forever

What is DuckDB? The Database Changing Data Engineering Forever The Data and AI Guy

981 views - 1 month ago

The End of Rule-Based Data Quality? How to Use AI Agents Instead

The End of Rule-Based Data Quality? How to Use AI Agents Instead The Data and AI Guy

679 views - 1 month ago

SQL Window Functions Explained: The Complete Guide (with Code)

SQL Window Functions Explained: The Complete Guide (with Code) The Data and AI Guy

634 views - 1 month ago

Slowly Changing Dimensions (SCD) Explained: Type 1, 2, & 3

Slowly Changing Dimensions (SCD) Explained: Type 1, 2, & 3 The Data and AI Guy

861 views - 1 month ago

Analytics Engineering vs Data Engineering in 2026

Analytics Engineering vs Data Engineering in 2026 The Data and AI Guy

1.1K views - 1 month ago

How to Build a Snowflake Dimensional Model with dbt (Step-by-Step)

How to Build a Snowflake Dimensional Model with dbt (Step-by-Step) The Data and AI Guy

818 views - 1 month ago

Build a PySpark CDC Pipeline with Debezium & Kafka (Step-by-Step)

Build a PySpark CDC Pipeline with Debezium & Kafka (Step-by-Step) The Data and AI Guy

865 views - 1 month ago

Top 5 Data Engineering Pipeline Mistakes Explained

Top 5 Data Engineering Pipeline Mistakes Explained The Data and AI Guy

718 views - 1 month ago

The 6 Pillars of the AWS Well-Architected Framework (Tutorial)

The 6 Pillars of the AWS Well-Architected Framework (Tutorial) The Data and AI Guy

532 views - 1 month ago

Data Modeling Explained: Star vs. Snowflake Schema

Data Modeling Explained: Star vs. Snowflake Schema The Data and AI Guy

1.8K views - 1 month ago

End-to-End Real-Time Analytics with Apache Kafka, Spark & Streamlit

End-to-End Real-Time Analytics with Apache Kafka, Spark & Streamlit The Data and AI Guy

976 views - 1 month ago

What is Data Engineering? (A Complete Guide for Beginners)

What is Data Engineering? (A Complete Guide for Beginners) The Data and AI Guy

850 views - 1 month ago

Introduction to Apache Kafka (A Complete Beginner's Guide)

Introduction to Apache Kafka (A Complete Beginner's Guide) The Data and AI Guy

2K views - 1 month ago

How to Implement DataSecOps

How to Implement DataSecOps The Data and AI Guy

304 views - 1 month ago

How to Implement Data Governance (A Step-by-Step Framework)

How to Implement Data Governance (A Step-by-Step Framework) The Data and AI Guy

1.5K views - 1 month ago

How to Build a RAG Pipeline with Apache Airflow (Step-by-Step)

How to Build a RAG Pipeline with Apache Airflow (Step-by-Step) The Data and AI Guy

1.3K views - 1 month ago

Git for Beginners: The Ultimate Guide to Version Control

Git for Beginners: The Ultimate Guide to Version Control The Data and AI Guy

361 views - 1 month ago

Airflow Event-Driven Architecture: Automate S3 → Lambda → Redshift → SageMaker Pipeline

Airflow Event-Driven Architecture: Automate S3 → Lambda → Redshift → SageMaker Pipeline The Data and AI Guy

592 views - 1 month ago

The Foundation of Everything Tech: Understanding Databases

The Foundation of Everything Tech: Understanding Databases The Data and AI Guy

797 views - 1 month ago

Stop Wasting Money on Snowflake! (5 Common Mistakes)

Stop Wasting Money on Snowflake! (5 Common Mistakes) The Data and AI Guy

363 views - 1 month ago

Data Engineering Best Practices: Avoiding the 5 Most Costly Pitfalls

Data Engineering Best Practices: Avoiding the 5 Most Costly Pitfalls The Data and AI Guy

709 views - 1 month ago

How to Automate Data Quality Checks for Kafka Streams with Soda

How to Automate Data Quality Checks for Kafka Streams with Soda The Data and AI Guy

400 views - 1 month ago

Databricks Unity Catalog: The Complete Beginner’s Guide (2026)

Databricks Unity Catalog: The Complete Beginner’s Guide (2026) The Data and AI Guy

1.4K views - 1 month ago

Everything You Need to Know About Data Orchestration

Everything You Need to Know About Data Orchestration The Data and AI Guy

904 views - 3 months ago

Databricks Lakeflow vs. Apache Airflow: The Ultimate Comparison

Databricks Lakeflow vs. Apache Airflow: The Ultimate Comparison The Data and AI Guy

617 views - 3 months ago

The Hard Truth: Why Most Data Meshes Fail

The Hard Truth: Why Most Data Meshes Fail The Data and AI Guy

468 views - 3 months ago

Data Engineer vs. AI Engineer: Which Career is Safe in 2026?

Data Engineer vs. AI Engineer: Which Career is Safe in 2026? The Data and AI Guy

2K views - 3 months ago

The CAP Theorem EXPLAINED (Why Your Data Architecture Must Choose Carefully)

The CAP Theorem EXPLAINED (Why Your Data Architecture Must Choose Carefully) The Data and AI Guy

584 views - 3 months ago

How to Block Bad Data at Ingestion with Soda

How to Block Bad Data at Ingestion with Soda The Data and AI Guy

448 views - 3 months ago

Lambda vs Kappa Data Architecture: Pros, Cons, and Real Use Cases

Lambda vs Kappa Data Architecture: Pros, Cons, and Real Use Cases The Data and AI Guy

1.6K views - 3 months ago

What Is Zenflow? AI Agent Orchestration Finally Done Right

What Is Zenflow? AI Agent Orchestration Finally Done Right The Data and AI Guy

1.6K views - 3 months ago

Build Your First ML Training Pipeline with Ray (Step-by-Step)

Build Your First ML Training Pipeline with Ray (Step-by-Step) The Data and AI Guy

457 views - 3 months ago

The 9 Principles of Good Data Architecture (Every Data Engineer Should Know)

The 9 Principles of Good Data Architecture (Every Data Engineer Should Know) The Data and AI Guy

2K views - 3 months ago

How to Build a Data Quality Monitoring System with Great Expectations & Airflow

How to Build a Data Quality Monitoring System with Great Expectations & Airflow The Data and AI Guy

1.1K views - 3 months ago

Push, Pull, or Poll? Choosing the Right Data Pipeline Pattern

Push, Pull, or Poll? Choosing the Right Data Pipeline Pattern The Data and AI Guy

471 views - 3 months ago

Major TargetBoard AI Improvements You Should Know About

Major TargetBoard AI Improvements You Should Know About The Data and AI Guy

254 views - 4 months ago

Real-Time to Lakehouse: Airflow-Triggered Kafka Pipelines Postgres Data into Iceberg

Real-Time to Lakehouse: Airflow-Triggered Kafka Pipelines Postgres Data into Iceberg The Data and AI Guy

928 views - 4 months ago

What Are Data Contracts? (And How They Actually Work in Production)

What Are Data Contracts? (And How They Actually Work in Production) The Data and AI Guy

1.5K views - 4 months ago

Shopify Just Changed Data Engineering Forever (Meet Tangle)

Shopify Just Changed Data Engineering Forever (Meet Tangle) The Data and AI Guy

757 views - 4 months ago

Build End-to-End Data Pipelines with Zencoder that Use Apache Airflow, Spark & Kafka

Build End-to-End Data Pipelines with Zencoder that Use Apache Airflow, Spark & Kafka The Data and AI Guy

700 views - 4 months ago

Understanding the Data Storage Lifecycle: From Creation to Deletion

Understanding the Data Storage Lifecycle: From Creation to Deletion The Data and AI Guy

526 views - 4 months ago

Data Dictionary 101: The Most Underrated Tool in Data Engineering

Data Dictionary 101: The Most Underrated Tool in Data Engineering The Data and AI Guy

1.9K views - 4 months ago

How to Use Airflow to Move Data from MySQL to Postgres (Full Walkthrough)

How to Use Airflow to Move Data from MySQL to Postgres (Full Walkthrough) The Data and AI Guy

1.2K views - 4 months ago

Data Quality with Soda.io — The Complete Guide for Modern Data Engineers

Data Quality with Soda.io — The Complete Guide for Modern Data Engineers The Data and AI Guy

1.6K views - 4 months ago