Competencies: Software Architecture > Data Architecture
Data Architecture
Body of Knowledge
| Topic | Description | Relevance | Career Tracks |
|---|---|---|---|
Data Modeling |
Entity-relationship diagrams, normalization, denormalization, schema design |
Critical |
Data Engineer, Software Architect, DBA |
Data Lake Architecture |
Raw/curated zones, medallion architecture, schema-on-read, data catalogs |
High |
Data Engineer, Software Architect |
Data Warehouse Design |
Star schema, snowflake schema, fact/dimension tables, slowly changing dimensions |
High |
Data Engineer, Software Architect, Analytics Engineer |
Data Mesh |
Domain ownership, data as product, federated governance, self-serve platforms |
High |
Data Engineer, Software Architect |
Event Streaming Architecture |
Kafka architecture, stream processing, event schemas, schema registry |
Critical |
Data Engineer, Software Architect, Backend Developer |
Data Governance |
Data lineage, metadata management, data quality, master data management |
High |
Data Engineer, Software Architect, Data Steward |
ETL/ELT Patterns |
Batch vs streaming, change data capture, incremental loads, data pipelines |
Critical |
Data Engineer, Software Architect |
Data Partitioning |
Range, hash, list partitioning, partition pruning, time-based partitions |
High |
Data Engineer, DBA, Software Architect |
Data Versioning |
Schema evolution, backward/forward compatibility, data migrations |
High |
Data Engineer, Software Architect |
Real-Time Analytics |
OLAP vs OLTP, columnar storage, materialized views, pre-aggregation |
High |
Data Engineer, Software Architect, Analytics Engineer |
Data Privacy Architecture |
Data anonymization, pseudonymization, data masking, retention policies |
Critical |
Data Engineer, Software Architect, Security Engineer |
Personal Status
| Topic | Level | Evidence | Active Projects | Gaps |
|---|---|---|---|---|
To be populated |
— |
— |
— |
— |