Our client has an opportunity available for a Data Engineer based in Pretoria.
Requirements:
Bachelor's or Honour's degree in Computer Science, Engineering or equivalent experience.
4+ years' experience in software development and data management disciplines.
Project Management experience.
Proficient in Java, C/C++, or Python.
Valid driver's license.
Advanced working Python knowledge and experience working with relational databases.
Experience building and optimizing data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data.
Experience supporting and working with cross-functional teams in a dynamic environment.
KPAs:
Drive automation in data integration and management.
Track data consumption patterns, preparation and integration tasks to identify the most common, repeatable tasks.
Prioritize opportunities for automation to minimize manual and error-prone processes.
Promote reuse of content and data through a centralized portal, catalogue or other system.
Build, manage and maintain data pipelines and architecture.
Match appropriate data sources to identified analytics use cases.
Integrate data from multiple sources into a single source or system.
Contribute to educational programs to increase accessibility for analytic team and users.
Contribute to educational programs to increase accessibility for analytic team and users.
Collaborate with IT and other departments to gain access to enterprise-wide data systems.
Work closely with data scientists and marketing analysts to define data requirements for analytics projects.
Recommend methods to continuously optimise data collection processes.
Identify, design, and implement internal process improvements.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, GCP, Azure 'Big Data' technologies.
Build analytics tools that utilize the data pipeline.
Work with stakeholder teams to assist with data-related technical issues and support their data infrastructure needs.
Work with data and analytics experts to strive for greater functionality in our data systems.
Create data tools for analytics and data scientist team members.