Competencies: Data Engineering

Data Engineering

Overview

Data engineering covers the infrastructure, tools, and practices for collecting, storing, processing, and governing data at scale. This domain spans from CLI-level data processing through enterprise data platforms.

Industry Frameworks

Google Professional Data Engineer — cloud data engineering
AWS Data Analytics Specialty — AWS data services
dbt certification — analytics engineering
Apache Foundation projects — Kafka, Spark, Flink, Airflow

Subdomains

Subdomain	Topics	Personal Coverage	Avg Level
Data Pipelines	13	Moderate	Intermediate
Data Processing	13	Moderate	Intermediate
Data Storage	13	Low	Beginner
Data Modeling	13	Low	Beginner
Data Governance	12	None	—
CLI Data Processing	10	High	Advanced

Subdomain

Topics

Personal Coverage

Avg Level

Data Pipelines

Moderate

Intermediate

Data Processing

Moderate

Intermediate

Data Storage

Low