Job Description

Data Engineering Technical Lead - Cape TownFull job descriptionCalybre is recruiting for a very dynamic entrepreneurial digital services company in fintech offering critical services to major financial services. Work directly with the CTO to drive their data strategy and turn vision into innovation with the team.In this role, you will:Lead and Innovate: Drive our Data Engineering Team, guiding projects while staying hands-on.Architect the Future: Build our modern Data Platform using the latest architecture and best practices.Mentor and Grow: Guide and inspire the team, helping them become experts.Stay hands-on: Continue to code and solve problems as the team's top engineer.The Team:The team works in the Fintech space, focusing on real-time biometric verification and secure data authentication. We're a group of innovative, entrepreneurial engineers with a dynamic, people-centred culture. While we work remotely for flexibility, we value in-person connections and regularly gather to strengthen our relationships.Our Data Engineering Team is crucial to our success. Comprised of passionate data analysts and engineers, they drive customer success through data. We need a leader and mentor to help grow the team's impact as the company advances in data maturity.Key Role and ResponsibilitiesYou'll work closely with the companies' leaders, senior engineers, and architects, aligning with our technology roadmap. Leading the Data Team, you'll drive daily delivery activities, producing valuable data products and reports for the business.Your main responsibilities include:Leading the design and engineering of data pipelines for batch and real-time processing.Ensuring best practices in data engineering, monitoring, and observability using tools like Databricks, Microsoft SQL, Azure Data Factory, Synapse, or Airflow.Mentoring junior team members to help them grow into experts.Collaborating with executives and stakeholders to scale data platform capabilities and integrate them with other digital products.Driving the development and performance management of the Data Engineering team.In our Data team, we focus on quick, efficient automation. We tackle problems head-on and work seamlessly together. Our job is to support teammates and stakeholders by promoting shared data ownership and practical governance rules. These values help us meet Analytics and Reporting needs, ensuring stakeholders thrive with the companies data insights.We're looking for someone who:Is customer-focused and values delivering impactOwns the team's systems, ensuring good data practices and platform reliabilitySets up efficient data processes across teamsIs a great mentor and helps junior colleagues growWorks well with other teams to unblock projectsCollaborates with leadership to improve and scale the Data platformHas excellent communication skillsLeads the team towards growth and successRequired experience:Leadership: 2+ years with proven ability of leading and mentoring teams and driving performance and delivery of quality outputsData Engineering: 5+ years of building modern, cloud-native data platforms, with ability in:Designing scalable pipelines using Apache Spark and DatabricksOrchestrating data workflows with Airflow, Databricks Jobs, Azure Synapse, or Azure Data FactoryWorking with streaming platforms like Kafka, RabbitMQ, or Azure Event HubsDeveloping metadata-driven pipelinesUnderstanding data security, governance, and architectureLinux, Python programming, and scripting for data automationImplementing DevOps, DataOps, and CI/CD pipelinesDatabase administration and optimization in Microsoft or Azure SQLCloud Technology: 3-5 years with Microsoft AzureReal-Time Processing: Experience with streaming platforms using Kafka, Event HubsBI & Visualisation: 2+ years with tools like Power BI, GrafanaMonitoring & Observability: Familiarity with tools like Application Insights, Azure Monitor, and GrafanaAdditional Skills/Experience (Beneficial):Data Model Design: Familiar with data lakes, data warehousing, and Kimball Dimensional ModellingData Development Lifecycle (DDLC): Experience guiding teams from requirements to deploymentMentorship & Documentation: Ability to coach team members and create high-quality documentationDevOps & Security: Experience with DevEx in Agile environments and knowledge of the ISO 27001 security frameworkCome and be a part of the companies journey in advancing data capabilities and shaping the future of cloud tech. If you're up for a new challenge in a supportive and growth-focused environment, we'd love to hear from you!Job Types: Full-time, Permanent, Temp to permPay: R70 000,00 - R90 000,00 per monthEducation:Honours (Preferred)Experience:Leadership: 2 years (Required)Data Engineering: 5 years (Required)Cloud Technology: 3 years (Required)Application Deadline: 2025/01/31

Skills Required