Data Engineering Solution Architect
Permanent
Cape Town
Posted 2 years ago
As a recognized data engineering authority the Solution Architect collaborates in data engineering standards & controls and creates the data engineering architecture for the target environments to deliver data pipelines into the bigger Business Intelligence environments.
Extensive subject matter knowledge of data engineering is essential, as well as ETL, relational databases, data warehousing and big data.
The solution architect will collaborate closely with the data, integration and analytics teams.
Job Objectives
- Define and continuously improve the data engineering architecture framework and modeling standards:
- Define and create solution level data engineering architecture models that enable specific BI and analytics requirements.
- Provide expert data engineering guidance, ensure solution architectures and designs are in line with the data engineering technology standards and conduct architecture and design reviews as part of the Architecture Review Committee.
Experience
- Experience within the IT industry
- Leadership role in an Information and Data analysis environment
- Experience with IT projects from an Information and Data architecture and design perspective (SDLC).
- Knowledge of various architecture frameworks including TOGAF and Zachman frameworks (TOGAF certification would be a distinct advantage)
- Demonstrable knowledge of Data Engineering Architecture and familiarity with various architecture viewpoints (business, applications, data, and technology architectures) is required.
- Proven experience creating data engineering solutions, building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructures
- Experience in working with Data Ops and/or Dev Ops Frameworks
- Knowledge of implementing future-fit Data Engineering technologies and capabilities such as APIs, API Portals, and Lakehouse architectures.
- Proven Experience in using scripting languages such as Python and SQL to create, manage, manipulate data pipelines and – sets
- Proven experience with data engineering in a cloud environment (AWS/Azure/Google) as well as on-premise.
- Experience in solution architectures, system analysis and design, data modeling and application development methodologies
- Experience with data profiling, data cleansing/quality, performance issues, reporting and data analysis
- Experience in database and data management (Data Replication, Backup and Recovery, DBMS Scaling techniques, SOA, ODS/OLTP vs Data Warehouse/OLAP/VLDB)
- Experience in various data modeling paradigms (dimensional, data vault, normalized, NoSQL)
- Experience in implementing and using EA tools and EA meta-model definition (ARIS Preferable/ or Sparx Enterprise Architect)
- Retail industry experience with an understanding of retail business processes and the information and data requirements of these processes.
Qualifications
- Degree in Information Systems / B Sc Computer Science (or similar)
Job Features
Job Category | Business Analysis, Data, Information Technology |