Learning Journal

@UC8OU1Tc1kxiI37uXBAbTX7A - 82.9K subscribers

Learn more at www.scholarnest.in?ref=ae0dde Data Engineering Learning Path www.scholarnest.in/bundles/mastering-spark-and-dat… Advanced Data Engineering Learning Path www.scholarnest.in/bundles/mastering-apache-spark-… Individual Courses www.scholarnest.in/courses/mastering-pyspark?ref=a… www.scholarnest.in/courses/apache-spark-and-databr… www.scholarnest.in/courses/mastering-databricks-cl… www.scholarnest.in/courses/apache-spark-performanc… You can also find us on Udemy www.udemy.com/courses/search/?q=prashant+kumar+pan… You can also find us on Oreilly www.oreilly.com/search/?q=author%3A%22ScholarNest%… www.oreilly.com/search/?q=author%3A%22Prashant%20K…

Home Videos Live Playlists

AI profile review | Check your resume against a JD and get shortlisted. Learning Journal

454 views - 4 months ago

How to tune union operation in Apache Spark | Apache Spark Performance Tuning and Optimization

How to tune union operation in Apache Spark | Apache Spark Performance Tuning and Optimization Learning Journal

879 views - 1 year ago

How to increase spark executor memory to fix the data spill problem | Spark performance optimization

How to increase spark executor memory to fix the data spill problem | Spark performance optimization Learning Journal

742 views - 1 year ago

What is data explosion in Apache Spark | How to detect and tune data explosion | Performance Tuning

What is data explosion in Apache Spark | How to detect and tune data explosion | Performance Tuning Learning Journal

536 views - 1 year ago

How to detect and tune data spill problem in Apache spark | Apache Spark performance optimization

How to detect and tune data spill problem in Apache spark | Apache Spark performance optimization Learning Journal

627 views - 1 year ago

Apache Spark executor memory architecture | How to estimate the Spark Executor Memory

Apache Spark executor memory architecture | How to estimate the Spark Executor Memory Learning Journal

522 views - 1 year ago

What is data spill and how to handle data spill problem in Apache Spark | Performance Tuning

What is data spill and how to handle data spill problem in Apache Spark | Performance Tuning Learning Journal

902 views - 1 year ago

How to tune small file problem in Spark using openCostInBytes | Spark performance optimization

How to tune small file problem in Spark using openCostInBytes | Spark performance optimization Learning Journal

565 views - 1 year ago

How to tune Spark data frame shuffle partitions | Apache Spark Performance Tuning

How to tune Spark data frame shuffle partitions | Apache Spark Performance Tuning Learning Journal

490 views - 1 year ago

Tuning Spark queries using index | Apache Spark performance tuning and optimization

Tuning Spark queries using index | Apache Spark performance tuning and optimization Learning Journal

422 views - 1 year ago

How to handle small file problem in Apache spark | Apache Spark performance tuning and optimization

How to handle small file problem in Apache spark | Apache Spark performance tuning and optimization Learning Journal

633 views - 1 year ago

Why my Spark SQL query is taking soo long even if I am reading only 100 records | Spark Tuning

Why my Spark SQL query is taking soo long even if I am reading only 100 records | Spark Tuning Learning Journal

680 views - 1 year ago

Overview of the Data Lake Architecture

Overview of the Data Lake Architecture Learning Journal

2K views - 1 year ago

How to cripple your predicate pushdown in Apache Spark | Performance Tuning Apache Spark

How to cripple your predicate pushdown in Apache Spark | Performance Tuning Apache Spark Learning Journal

353 views - 1 year ago

Microproject – Requirement

Microproject – Requirement Learning Journal

262 views - 1 year ago

SQL Classification

SQL Classification Learning Journal

286 views - 1 year ago

How to test your SQL environment

How to test your SQL environment Learning Journal

267 views - 1 year ago

What is Spark and Why it is replacing Hadoop

What is Spark and Why it is replacing Hadoop Learning Journal

996 views - 1 year ago

How to download your resources

How to download your resources Learning Journal

402 views - 1 year ago

About the course

About the course Learning Journal

678 views - 1 year ago

Why filters are not improving Spark SQL Query Performance | How to optimize Spark with filters

Why filters are not improving Spark SQL Query Performance | How to optimize Spark with filters Learning Journal

418 views - 1 year ago

Overview of Hadoop Platform

Overview of Hadoop Platform Learning Journal

650 views - 1 year ago

How to reduce cache size in Apache Spark | How much data can you cache in Apache Spark memory

How to reduce cache size in Apache Spark | How much data can you cache in Apache Spark memory Learning Journal

424 views - 1 year ago

Monolithic and Distributed Architecture for Big Data Systems

Monolithic and Distributed Architecture for Big Data Systems Learning Journal

835 views - 1 year ago

How to reuse and cache Spark Dataframe to optimize performance | Apache Spark performance tuning

How to reuse and cache Spark Dataframe to optimize performance | Apache Spark performance tuning Learning Journal

452 views - 1 year ago

How to test your SQL environment

How to test your SQL environment Learning Journal

148 views - 1 year ago

Data Engineering tools and technologies

Data Engineering tools and technologies Learning Journal

397 views - 1 year ago

Big data challenge and limitations for data warehouse architecture

Big data challenge and limitations for data warehouse architecture Learning Journal

419 views - 1 year ago

How to tune Data Read in Apache Spark | How can you read faster in Apache Spark data frame

How to tune Data Read in Apache Spark | How can you read faster in Apache Spark data frame Learning Journal

584 views - 1 year ago

Data Engineering Platform Architectures

Data Engineering Platform Architectures Learning Journal

582 views - 1 year ago

Apache Spark Performance Tuning Response Time Vs. Cost | How to performance tune for best of both

Apache Spark Performance Tuning Response Time Vs. Cost | How to performance tune for best of both Learning Journal

437 views - 1 year ago

How to set up your SQL learning environment

How to set up your SQL learning environment Learning Journal

241 views - 1 year ago

What is data engineering | Summary in 3 minutes

What is data engineering | Summary in 3 minutes Learning Journal

406 views - 1 year ago

Apache Spark Performance Tuning Goals | What do you want to tune in your data engineering pipelines

Apache Spark Performance Tuning Goals | What do you want to tune in your data engineering pipelines Learning Journal

543 views - 1 year ago

When do you need a near real-time stream processing project | Understand with an example and use ca

When do you need a near real-time stream processing project | Understand with an example and use ca Learning Journal

419 views - 1 year ago

When to use Data Caching in Spark | Apache Spark Performance Tuning Scenario

When to use Data Caching in Spark | Apache Spark Performance Tuning Scenario Learning Journal

687 views - 1 year ago

What can you do with Databases and SQL

What can you do with Databases and SQL Learning Journal

256 views - 1 year ago

When do you need real-time stream processing project | Understand with an example and use case

When do you need real-time stream processing project | Understand with an example and use case Learning Journal

391 views - 1 year ago

Auto Compact and Optimize Write | How to fix Small file problem in Apache Spark and Databricks

Auto Compact and Optimize Write | How to fix Small file problem in Apache Spark and Databricks Learning Journal

951 views - 1 year ago

When do you need batch processing project | Understand with an example and use case

When do you need batch processing project | Understand with an example and use case Learning Journal

317 views - 1 year ago

How to detect and tune data explosion problem | Apache Spark Performance Tuning Scenario

How to detect and tune data explosion problem | Apache Spark Performance Tuning Scenario Learning Journal

820 views - 1 year ago

What is Database and SQL

What is Database and SQL Learning Journal

641 views - 1 year ago

What are the three approaches for Data Engineering

What are the three approaches for Data Engineering Learning Journal

446 views - 1 year ago

Why is reading JSON slow and how do you optimize it | Apache Spark Performance Tuning Scenario

Why is reading JSON slow and how do you optimize it | Apache Spark Performance Tuning Scenario Learning Journal

1.2K views - 1 year ago

Data Engineering Course | Freedom Sale | Grab at ScholarNest

Data Engineering Course | Freedom Sale | Grab at ScholarNest Learning Journal

706 views - 1 year ago

What is Data Engineering | What is the job of Data Engineer

What is Data Engineering | What is the job of Data Engineer Learning Journal

471 views - 1 year ago

What is performance benchmarking and how do you do it | Apache Spark Performance Tuning

What is performance benchmarking and how do you do it | Apache Spark Performance Tuning Learning Journal

1.1K views - 1 year ago

Learn Spark Programming in 2 Days | Free Course

Learn Spark Programming in 2 Days | Free Course Learning Journal

1K views - 1 year ago

How do you identify and locate performance tuning opportunity | Apache Spark Performance Tuning

How do you identify and locate performance tuning opportunity | Apache Spark Performance Tuning Learning Journal

1.2K views - 1 year ago

What is Apache Spark Performance Tuning | How do you approach Spark Performance Tuning Problem

What is Apache Spark Performance Tuning | How do you approach Spark Performance Tuning Problem Learning Journal

1.7K views - 1 year ago

Apache Spark Performance Tuning | Scenario based interview question | Cluster Autoscaling

Apache Spark Performance Tuning | Scenario based interview question | Cluster Autoscaling Learning Journal

3.3K views - 1 year ago

57-Working with Databricks CLI

57-Working with Databricks CLI Learning Journal

1 year ago

56-Working with Databricks Rest API

56-Working with Databricks Rest API Learning Journal

1 year ago

55-Working with Databricks Workflows

55-Working with Databricks Workflows Learning Journal

1 year ago

54-Working with Databricks Repos

54-Working with Databricks Repos Learning Journal

1 year ago

53-What will you learn in this section

53-What will you learn in this section Learning Journal

1 year ago

52-Creating DLT Workload in Python

52-Creating DLT Workload in Python Learning Journal

1 year ago

51-Creating DLT Pipeline for your Workload

51-Creating DLT Pipeline for your Workload Learning Journal

1 year ago

50-Creating DLT Workload in SQL

50-Creating DLT Workload in SQL Learning Journal

1 year ago

49-Setup DLT Scenario Dataset

49-Setup DLT Scenario Dataset Learning Journal

1 year ago