Job Description

Data Engineer - Jhb NorthJob SummaryRequired Minimum Education / TrainingBachelor's degree in Computer Science, Software Engineering, Informatics, or Information Systems.A degree from an accredited institution is essential to ensure foundational knowledge in programming, algorithms, and software design.Equivalent qualifications or certifications combined with significant industry experience may also be considered.Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.Required Minimum Work Experience3-5 years of professional experience in a Data Engineer or related role.Technical CompetenciesAt least 3 years of experience working with Microsoft SQL Server, Sybase, or Postgres SQL.Familiarity with NoSQL DB systems.Strong T-SQL knowledge.Intermediate Python development and familiarity with data-related libraries (Pandas, PySpark, NumPy, etc.).Experience with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, or similar tools for AWS (e.g., Glue, Fire Hose).SQL Internals - statistics, execution plans, wait types, isolation levels, DMVs, indexes.Understanding of Hadoop, Spark, MapReduce, columnar databases, and Massive Parallel Processing systems.Setting up data ingestion processes in Azure, AWS, or GCP.Experience with visualization tools such as Power BI, SSRS, Tableau, or QlikView.Knowledge of writing and optimizing complex queries with 3-5 years' expertise.Version Control and CI/CD:Proficient in using Git and working with repositories like GitHub or Bitbucket.Familiarity with CI/CD pipelines and deployment strategies.Advantageous Skills:Experience in C# or Java and its ecosystem.Understanding of microservices architecture and containerization (e.g., Docker, Kubernetes.Key Performance Areas Maintain and Enhance Existing Systems:Identify and resolve issues in existing software systems.Perform system upgrades and ensure compatibility with new technologiesDesign and Develop New Features:Collaborate with stakeholders to gather requirements.Implement new features and functionalities in both front-end and back-end systems.Innovate and Optimize:Explore new tools and technologies to enhance system performance and scalability.Propose and implement improvements to existing workflows and processes.Collaborate with Team Members:Work closely with developers, QA, and product managers to deliver high-quality solutions.Participate in code reviews and share best practices.Apply now!If you are interested in this opportunity, please apply directly. For more IT jobs, please visit www.networkrecruitment.co.za. If you wish to send your CV per email forward your CV to clombard@networkrecruitment.co.za and copy the reference number in brackets in the subject line of your e-mail.If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any further possible positions

Skills Required