Senior Data Engineer

Johannesburg, Gauteng, South Africa

Job Description

Job Summary Hire Resolve's client is seeking a talented individual to join their dynamic team in Gauteng. You'll thrive in a remote-first work culture that prioritizes innovation and collaboration, with monthly in-person get-togethers to foster team bonding and idea sharing.
Responsibilities:

  • Stay Current with SQL: Continuously learn and apply the latest SQL features and programming practices through education, study, and participation in conferences, workshops, and groups.
  • Data Management: Oversee data backups from local directories to shared drives and VSTS.
  • Issue Resolution: Identify and resolve problems stemming from customer feedback and testing, correcting them or escalating to appropriate personnel.
  • Code Quality Assurance: Evaluate code to ensure it meets industry standards, is valid, properly structured, and compatible with various Azure SQL versions.
  • Requirements Analysis: Analyze technical requirements to accurately determine user needs.
  • System Integration: Manage data analysis and the integration of disparate systems.
  • Performance Optimization: Guarantee high quality and optimal performance of delivered code, adhering to internal guidelines.
  • Database Expertise: Apply deep understanding of database operations and optimization for Microsoft SQL Server.
  • Reporting Development: Develop effective reporting systems that provide accessible information for decision-making.
  • Troubleshooting: Conduct thorough troubleshooting on code, tables, indexes, and SQL Server instances.
  • Report Generation: Generate and deliver quality reports to customers, performing comprehensive quality assurance checks.
  • Cross-functional Collaboration: Partner with various teams to translate business requirements into scalable data solutions.
  • Design Participation: Contribute to design reviews, providing valuable input on requirements, product design, and potential issues.
  • Software Validation: Test and validate software against major architectural requirements, with a focus on scalability and performance.
  • System Quality: Ensure the overall quality of the entire system.
  • Technology Advancement: Stay up-to-date with the latest Microsoft data technologies, Azure services, and data engineering best practices.
  • Performance Enhancement: Troubleshoot and optimize Azure data pipelines and SQL Server performance, and resolve data quality issues.
  • Cost Optimization: Continuously improve data infrastructure to reduce latency, increase throughput, and optimize Azure costs using FinOps principles.
  • Tool Integration: Evaluate and integrate new Microsoft data tools and Azure services to enhance our data platform capabilities.
  • Mentorship: Mentor and guide junior data engineers, fostering their growth.
  • Architectural Oversight: Participate in architecture reviews, ensuring all data solutions meet high-quality standards and best practices.
  • Stakeholder Communication: Communicate effectively with stakeholders to understand data requirements and provide technical solutions.
  • Independent Delivery: Work autonomously and deliver high-quality work within tight deadlines.
Minimum Requirements:
  • Data Processing: 7+ years of T-SQL/SQL Server expertise, deep Azure Synapse Analytics skills, and C#/.NET for data processing applications.
  • Microsoft Data Stack: Strong proficiency in Azure Data Factory, Azure Databricks, SQL Server Integration Services (SSIS), Azure Stream Analytics, and Event Hubs.
  • Cloud & Infrastructure: Experience with Azure Synapse Analytics, Power Designer for data modeling, and Azure DevOps for CI/CD.
  • Data Modeling: Expertise in dimensional modeling with Power Designer, SQL Server Data Tools (SSDT), schema design for OLAP/OLTP, and performance optimization.
  • Business Intelligence: Experience with Power BI integration, SSAS/SSRS, and knowledge of DAX/MDX and semantic layer design.
  • DevOps & Orchestration: Proficient with Azure DevOps pipelines, ARM templates/Bicep, Azure Monitor, and Application Insights.
  • Testing: Experience with unit testing for T-SQL and data pipelines, data quality frameworks, and integration testing with Azure Data Factory.
  • Strong understanding of basic DB concepts, joins, aggregate functions, and commands (DDL, DML, TCL DCL).
  • Proficiency in advanced SQL concepts like CTE, Recursive queries, Pivots, Self joins, Temporary functions, UDF, etc.
  • Deep understanding of relational database concepts with solid knowledge of MS-SQL.
  • Proficiency with version control systems such as Git and Azure Repos.
  • Strong problem-solving and troubleshooting skills in Microsoft environments.
  • Experience with ETL tools.
  • Expertise in SQL Server performance tuning and optimization of large-scale data systems.
Advantageous Skills
  • Experience with Azure Machine Learning and Azure Cognitive Services for ML pipelines.
  • Experience with Microsoft Fabric and its unified analytics platform.
  • Real-time analytics with Azure Stream Analytics and Complex Event Processing.
  • Azure Cost Management and FinOps experience optimizing data workloads.
  • Power Platform integration (Power Apps, Power Automate) for data workflows.
  • Experience with Cosmos DB for multi-model database scenarios.
  • Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect certification.
Benefits:
  • Competitive salary based on experience.
IF you meet the above requirements and want to make a career-changing move, apply today by emailing your CV to
You can also connect with Daniel on LinkedIn or contact Hire Resolve
If you meet the above requirements we will contact you within 3 working days
Hire Resolve
IT/Computer
Recruiter
About
Specialists in Civil, Structural, Mechanical Engineering, Information Technology, Mining, Manufacturing and Finance Careers! Hire Resolve is one of the larger and more agile South African recruitment companies that focus on placing professionals and skilled people in permanent employment and contract employment. We prefer and focus on working with top quality professionals and candidates in South Africa and Africa. Hire Resolve has successfully placed Engineering, Mining, IT, Manufacturing and Finance professionals with top firms across the Western Cape, Eastern Cape, KwaZulu Natal, Gauteng and in Africa. Hire Resolve has assisted candidates to find jobs at over 100 JSE listed companies of which many are global companies with offices and operations in South Africa and Africa. It is for this reason that we are well respected in the industries we operate in and in the recruitment industry.

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1441959
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Johannesburg, Gauteng, South Africa
  • Education
    Not mentioned