Data Engineer (azure Data Factory & Databricks)

Cape Town, Western Cape, South Africa

Job Description

PBT Group is seeking a skilled Data Engineer with strong expertise in Azure Data Factory (ADF) and Databricks to support and scale our data infrastructure. This role is ideal for a proactive problem-solver who thrives in dynamic environments and is comfortable working on both pipeline development and platform optimisation.
Key Responsibilities:

  • Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks
  • Integrate and transform data from various sources to support analytics and reporting requirements
  • Optimise data workflows for performance and cost-effectiveness in a cloud-based environment
  • Collaborate with analysts, data scientists, and business stakeholders to deliver clean, reliable data
  • Monitor data quality and ensure robust data governance practices
  • Participate in code reviews, DevOps processes, and continuous improvement initiatives
Required Skills & Experience:
  • 3+ years' experience as a Data Engineer or in a similar role
  • Proven expertise in Azure Data Factory and Databricks (Spark, Python, SQL)
  • Experience with building ELT/ETL pipelines in a cloud-based architecture
  • Strong proficiency in SQL and working with structured/unstructured data
  • Familiarity with Azure Synapse, Data Lake, and version control tools (e.g., Git)
  • Solid understanding of data security and governance best practices
Nice to Have:
  • Experience in CI/CD and infrastructure-as-code (e.g., Terraform, Azure DevOps)
  • Exposure to machine learning or real-time data processing
  • In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
  • If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1456076
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Cape Town, Western Cape, South Africa
  • Education
    Not mentioned