spark articles

Every BricksNotes article on spark: 6 practical pieces on Databricks and data engineering, newest first.

The small files problem in Spark and Databricks, explained simply
Same result, 3 seconds or 30 minutes. Query optimization in Databricks
The join that ran for seven hours. Broadcast and shuffle joins in Databricks
One task ran for forty minutes. Data skew in Databricks, explained
Apache Spark 4.2: Defining truth in the age of AI
The Databricks Cheat Sheet, Explained: What Each Feature Actually Does
All BricksNotes articles