Karthikeyan S 
How Hash Tables Silently Help Modern Database Engines Join Tables Under the Hood When developers write a SQL query like: it looks simple. But behind the scenes, the database engine may process millions — sometimes billions — of rows.So how does it perform these joins so quickly? The answer is often a powerful data structure … Read more
In the world of data engineering, “scale” is often a relative term. But at Uber, scale means managing a multi-hundred-petabyte repository that handles 6 trillion rows ingested daily. To manage this tidal wave of information, Uber moved away from traditional append-only data lakes to create Apache Hudi™, a storage engine that brings database-like primitives to … Read more
Python has become one of the most important programming languages in modern data engineering. From building data pipelines to processing large datasets and integrating APIs, Python plays a critical role in the daily workflow of a data engineer If you’re planning to build a career in data engineering, understanding the essential Python topics for data … Read more