MENU


Core Skills

Core Skills and How This Book Builds Them

SQL comes first in almost every job description: it is the language of warehouses, lakehouse engines and dbt 37,942 .

Core data engineering skills and where this book teaches them
Skill Built in
SQL, including analytical SQL Analytical SQL and Data Warehouses (basics in LAMP Stack Development)
Python for pipelines Every chapter; PySpark 129 in Batch Processing with Apache Spark
Data formats and modeling XML and Its Toolchain and JSON, Columnar and Binary Formats; Data Modeling Paradigms, Dimensional Modeling-Slowly Changing Dimensions
Spark 129 and Kafka 129 Batch Processing with Apache Spark and Apache Kafka and Managed Cloud Kafka
Orchestration, testing, CI Orchestration and Pipelines; Package Managers and DevOps
Lakehouse, quality, governance Lakehouses, Data Quality and Governance

Two skills never fit in a table: judgment about trade-offs and communication. Appendix H collects questions on both, with model answers.