Job Description

Senior Data Engineer-Hybrid Cape Town ICT/ Information Technology
Cape Town - Western Cape

Are you a seasoned Data Engineer looking to make a significant impact in the heart of Cape Town's tech scene? Join an agile and cross-functional development team, driving the creation and maintenance of cutting-edge data solutions. As a Senior Data Engineer, you'll immerse yourself in diverse technologies, optimizing data pipelines, crafting intelligent reports, and championing data integrity. Your expertise in SQL, cloud environments like Azure, and proficiency with ETL processes will play a pivotal role. If you're a proactive self-starter who thrives in collaborative settings, and you're eager to shape the future of data architecture, we invite you to be an essential part of this innovative journey.

Responsibilities

• Design, construct, schedule, deploy, and oversee data pipelines
• Enhance, optimize, and validate existing data pipelines
• Devise and implement effective data structures, forms, queries, and reports
• Generate ad-hoc queries and construct reports to address evolving business requirements
• Develop security-conscious cloud-based data solutions
• Transform and store data in versatile formats like Parquet, JSON, and Avro
• Leverage appropriate data processing engines, including Graph, Relational, and NoSQL
• Create and manage comprehensive technical documentation
• Contribute to the expansion of data marts and the data warehouse
• Play a pivotal role in shaping data architecture strategies and initiatives
• Collaborate closely with business representatives to steer data solution efforts

Requirements:

• Possess a Bachelor's degree with a specialization in data management (e.g., Information Systems, Statistics, Data Engineering)
• 5+ years' hands-on experience as a Data Engineer, employing visual pipeline designers such as SSIS, Talend, Informatica, or Azure Data Factory
• 2+ years experience in data engineering within a commercial cloud environment like Azure
• Display advanced proficiency in the SQL language
• Exhibit adeptness in optimizing SQL queries for enhanced performance
• Demonstrate competence with at least two DBMS platforms, such as Postgres, MySQL, or MSSQL
• Showcase proficiency in extracting and integrating data from diverse sources
• Possess a strong track record in developing, implementing, and monitoring ETL processes
• Exhibit familiarity with database administration, maintenance, and optimization
• Hold a solid grasp of data management principles, encompassing data quality assurance and data governance
• Exhibit experience with source code and version control systems
• Showcase expertise in master data management and its implementation and upkeep

Highly Advantageous Requirements:

• Familiarity with Azure data technologies
• Proficiency in database administration tasks
• Proficiency in scripting languages like Bash or PowerShell
• Possession of Data Engineering certifications from Google, Azure, or AWS
• Demonstrated interest and involvement in the claims and healthcare IT domain.

Apply

TereCruits Recruitment