Data engineering builds systems that collect, transform, store and serve data reliably. It provides the foundation for analytics, machine learning and AI applications.

Core concepts

  • Relational and non-relational databases
  • ETL and ELT pipelines
  • Data warehouses and data lakes
  • Batch and streaming data
  • Workflow orchestration
  • Data quality and governance

Practical project

Build a pipeline that ingests source data, validates it, transforms it and publishes a clean analytical dataset.