✦ THE RECODE HIVE BLOG
blog by recode community.
github.com/recodehive (opens in a new tab)
Aditya Singh Rathore
Sanjay Viswanathan
Sowmiya Venkatesan3 authors have written 22 posts
Become one → (opens in a new tab)TOPIC SPOTLIGHT
AZURE
Every Azure data pipeline needs a place to store data. But Azure gives you four different storage types and choosing the wrong one is easier than you think. This guide explains all four, shows how they work together in a real pipeline, and goes deep on ADLS Gen2, the storage layer that powers modern Azure data engineering.
AZURE
Azure Synapse Analytics is one of the most powerful tools in the Azure data stack. But in 2026, with Microsoft Fabric growing fast, the question isn't just "what is Synapse?" — it's "when should you still use it, and when should you move to Fabric?" Here's the honest answer.
EXPLORE ARTICLES
DESIGN
Google redesigned its Workspace icons in 2026, dropping the four-color rule from 2020. Here's what changed, why now, and whether it fixes the confusion.
CAREER
MBAs learn to analyze businesses. Data engineers live inside the data those businesses actually run on. Here's why that difference matters more than any credential — and what both sides should learn from each other.
DATA GOVERNANCE
Learn how Microsoft Purview Data Catalog improves data discovery, lineage, ownership, and governance. This practical case study shows how we reduced data engineer onboarding from 2 weeks to 3 days — including the configuration that made it work.
PERFORMANCE
Six PySpark mistakes that silently kill pipeline performance and how to fix every one of them. Covering partitioning, shuffle tuning, caching, join strategies, UDFs, predicate pushdown, and cluster config. Explained from scratch.
CLOUD COST
Six costly mistakes in a 2GB Azure data pipeline drove a $4,200 monthly bill. Here's every mistake, root cause, and fix — with before-and-after numbers for each.
ARCHITECTURE
Most data pipelines don't fail because of bad technology. They fail because raw data flows directly into reports with no checkpoints, no validation, and no clear ownership. Medallion Architecture fixes exactly this — here's how it works, why it matters, and how to implement it in practice.
TUTORIAL
Azure Data Factory is Microsoft's cloud-native ETL service — a visual, no-code platform for moving and transforming data at scale. This step-by-step guide walks you through building your first real pipeline in under 10 minutes, explaining every concept along the way.
AZURE
Every Azure data pipeline needs a place to store data. But Azure gives you four different storage types and choosing the wrong one is easier than you think. This guide explains all four, shows how they work together in a real pipeline, and goes deep on ADLS Gen2, the storage layer that powers modern Azure data engineering.
AZURE
Azure Synapse Analytics is one of the most powerful tools in the Azure data stack. But in 2026, with Microsoft Fabric growing fast, the question isn't just "what is Synapse?" — it's "when should you still use it, and when should you move to Fabric?" Here's the honest answer.
STREAMING
Everyone talks about the benefits of streaming pipelines — real-time insights, millisecond latency, live dashboards. Nobody talks about what it actually costs you. I rebuilt a working batch pipeline as a streaming system. Here's what I learned the hard way.
CASE STUDY
Every click, pause, search, and scroll on Netflix generates an event. With 300 million subscribers across 190 countries, Netflix processes 2 trillion events every single day through a pipeline called Keystone. Here's a deep dive into how Kafka, Flink, Cassandra, and Iceberg make it all work in real time.
SECURITY
SSO lets you log into dozens of apps with a single set of credentials. But how does it actually work under the hood? This beginner-friendly guide walks through the full flow — from clicking "Sign in with Google" to getting access — step by step.
EDITOR’S PICK
CAREER
MBAs learn to analyze businesses. Data engineers live inside the data those businesses actually run on. Here's why that difference matters more than any credential — and what both sides should learn from each other.
DESIGN
Sanjay Viswanathan · May 21, 2026 · 9 min read
DATA GOVERNANCE
Aditya Singh Rathore · May 19, 2026 · 21 min read
PERFORMANCE
Aditya Singh Rathore · May 16, 2026 · 27 min read
Titles, descriptions and social previews improved across the blog.
#2296 @Adez017
Post content updated after publishing.
#2201 @Adez017
Duplicate line removed and text readability fixed.
Post refactored and restructured.
#1556 @Adez017
✦ WRITE FOR THE HIVE
Share what you built or learned. The strongest posts get the Featured spot on this page.