Spark SQL and Joins

Spark 129 SQL and the DataFrame API are two front ends to the same Catalyst optimizer, so you can switch between them freely. Analytical SQL and Data Warehouses covers analytical SQL and LAMP Stack Development the join and window basics; this section is about what distribution adds: the catalog, join strategies and skewed keys.

Subsections

• Running SQL Against DataFrames
• Catalog and Managed Tables
• Temporary and Global Views
• Choosing a Join Strategy
• Broadcast Joins
• Diagnosing Data Skew
• Fixing Skew
• Window Functions in Spark SQL
• Analyzing Order History