Data Engineer

Cape Town, Western Cape, South Africa

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining our centralised data repository, as well as all data streams in and out of it. They will provide strategic and technical guidance for all measurement, digital transformation and innovation.
They are responsible for leading the Department of Programs and Technical Services (DPTS) into the production and availability of quality basic and disaggregated data and the strengthening of information systems and digital transformation for health as a fundamental pillar. They will guide the data analysts, data scientists, and Strategic Information (SI) team through the ethical use of data to produce health intelligence through analysis, modelling, forecasting, and data science to guide decisions and actions in m2m's programmes.
This position is based at m2m's Head Office in Cape Town and is part of the Data Analytics Unit (a sub-unit within DPTS) and reports to the Data Analytics Lead.
Key Performance Areas:
Design and build data pipelines for multiple health information systems including CommCare, DHIS2, VMMP, and CHARM.

  • Implement robust ETL processes for data extraction, transformation, and loading.
  • Ensure all client-level data is stored in GCP in clean, structured, SQL-query able formats.
  • Automate pipeline processes to minimize manual intervention and improve reliability. Monitor pipeline performance and troubleshoot issues as they arise.
Cloud Infrastructure Management & Optimization
  • Review and optimize GCP environment architecture for cost-effectiveness and performance.
  • Configure and maintain user roles, permissions, and security protocols within cloud platforms.
  • Implement cloud data storage, processing, and backup strategies. Monitor resource utilization and implement cost optimization measures.
  • Ensure compliance with data security and privacy requirements.
System Integration & Automation
  • Develop and maintain scripts for seamless data integration between multiple systems.
  • Create and optimize data integration workflows between various health information platforms.
  • Ensure data consistency, quality, and integrity across integrated systems.
  • Troubleshoot integration issues and implement corrective measures.
  • Build applications that facilitate server/client communication via network protocols.
Database Management & Reporting Support
  • Create and maintain databases for clean client-level and aggregated data.
  • Automate data loading processes and trait generation.
  • Support business intelligence tool implementation and reporting process optimization.
  • Collaborate on dashboard development and reporting enhancements.
  • Ensure database performance optimization and maintenance using SQL and related technologies.
Documentation & Knowledge Management
  • Develop comprehensive technical documentation for all data processes, scripts, and workflows.
  • Create and maintain ETL pipeline architecture documentation and transformation logic.
  • Document automation procedures, scheduling, and maintenance requirements.
  • Maintain cloud environment configuration and troubleshooting guides. Provide technical training and knowledge transfer to team members.
Job Requirements
Qualification and Experience
  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or related technical field
  • Professional certifications in cloud platforms (preferred)
Knowledge & Technical Skills
  • Working knowledge of cloud platforms (GCP, AWS, or Azure) with experience creating services and understanding permission/role/access models
  • Proficiency in Python and SQL
  • Experience with SQL databases (PostgreSQL and similar)
  • Familiarity with Git version control systems
  • General data engineering knowledge and best practices
  • Experience writing applications with server/client communication via network protocols
  • Business intelligence tools experience (Power BI, Tableau, or similar platforms preferred)
  • Understanding of ETL tools and data pipeline development
Experience Requirements
  • Minimum 3 years in data engineering or similar technical roles
  • Experience with large-scale data processing and transformation
  • Health sector or NGO experience (advantageous)
  • Experience with international development projects (advantageous)
Languages
  • English (fluent - written and verbal)
  • Additional South African languages (advantageous)
Core Competencies
  • Analytical thinking and problem-solving
  • Attention to detail and quality focus
  • Strong communication and documentation skills
  • Ability to work independently and manage multiple projects
  • Cultural sensitivity and understanding of healthcare contexts
  • Adaptability in dynamic environments
mothers2mothers is an equal opportunity employer. We particularly encourage applications from people living with HIV and AIDS (PLWHA), people with disabilities, women and previously disadvantaged people. Competitive salary packages will be negotiable in accordance with m2m's remuneration policies.

Skills Required

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1532695
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Cape Town, Western Cape, South Africa
  • Education
    Not mentioned