Data Engineer/architecture

Johannesburg, Gauteng, South Africa

Job Description

Role overview
You will:

  • Design and maintain scalable, secure, high-performance data architecture
  • Build robust ETL/ELT pipelines for batch and streaming data
  • Enable analytics, BI, and AI workloads through reliable data platforms
  • Ensure regulatory compliance and data governance for sensitive financial data
Duties:
  • Design and maintain scalable, secure, and high-performance data architectures
  • Define data models, schemas, and standards across transactional and analytical systems
  • Architect data lakes, data warehouses, and real-time data pipelines
  • Ensure alignment with fintech regulatory and compliance requirements
  • Build and maintain ETL/ELT pipelines for batch and streaming data
  • Integrate data from internal systems, third-party APIs, and financial data providers
  • Optimize data processing for performance, reliability, and cost efficiency
  • Ensure data quality, consistency, and availability
  • Develop and manage cloud-based data platforms (AWS, GCP, or Azure)
  • Implement infrastructure-as-code and CI/CD for data pipelines
  • Monitor and troubleshoot data systems in production
  • Implement data security, access controls, encryption, and monitoring
  • Support data governance, lineage, and metadata management
  • Collaborate with compliance and risk teams on audits and regulatory needs
  • Work closely with product managers, analysts, and ML engineers
  • Provide technical guidance and best practices for data usage
  • Document architectures, workflows, and standards
  • Mentor junior data engineers (if applicable)
Requirements:
  • 5+ years of experience in data engineering, data architecture
  • Strong proficiency in SQL and data modelling (dimensional and/or normalized
  • Experience building data pipelines using tools such as Airflow, dbt, Spark, or similar
  • Strong programming skills in Python, Scala, or Java
  • Hands-on experience with cloud data services (BigQuery, Redshift, Snowflake, Databricks)
  • Experience with both batch and streaming data systems (Kafka, Kinesis, Pub/Sub)
  • Solid understanding of data security, privacy, and governance principles
  • Experience in fintech, banking, payments, or financial services
  • Familiarity with regulatory frameworks (PCI DSS, SOC 2, GDPR)
  • Experience supporting analytics, BI, and machine learning workloads
  • Knowledge of event-driven and real-time data architectures
  • Prior experience leading architectural decisions or data platform migrations

Skills Required

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1645099
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Johannesburg, Gauteng, South Africa
  • Education
    Not mentioned