Core Purpose
Develop and manage cloud data infrastructure on Microsoft Azure (Data Factory). Responsible for designing and optimizing data pipelines, integrating information from multiple sources, and ensuring the quality, security, and availability of data for analytics and reporting.
Key Responsibilities
Data Integration: Consolidate structured and unstructured data into formats ready for analytics.
Pipeline Development: Build and optimize ingestion, transformation, and movement pipelines, with strong focus on incremental loads.
Data Platform Management: Implement, monitor, and fine-tune solutions using Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Azure Databricks.
Data Quality and Security: Ensure governance, reliability, and security of data and pipelines.
Collaboration: Work closely with data scientists, AI engineers, and business analysts to provide high-quality, analytics-ready datasets.
Master Data Standardization: Clean and standardize dimension tables in QAD, with primary emphasis on the Item Master Data.
Ensure consistency and accuracy across all domains and regions by accessing data from different systems and establishing processes to assure and maintain the quality of master data.
Support management and maintenance of existing client databases, ensuring data is current.
Attend meetings and training sessions virtually and in person.
Core Functional Knowledge & Skills
Solid experience working within the Microsoft Azure ecosystem.
Strong knowledge of incremental pipeline updates (mandatory).
Hands-on experience with Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Databricks, Azure Stream Analytics.
Proficiency in SQL (T-SQL) and Python.
Knowledge of Scala for advanced Spark/Databricks workloads.
Experience in data modeling, transformation, and processing.
Ability to handle large-scale datasets (Big Data).
Strong IT infrastructure background covering cloud, virtualization, server, database, and networking technologies.
Experience with Power BI (data modeling, integration, performance optimization).
Background in data governance and data quality initiatives.
Excellent command of English, both written and verbal.
Competencies
Strong interpersonal skills and ability to influence stakeholders to ensure timely completion of tasks.
Proactive and highly motivated self-starter.
Critical thinker able to question assumptions and analyze problems from various perspectives.
Excellent time management, planning, and organizational skills.
Detail-oriented with the ability to manage concurrent projects efficiently and accurately.
Strong oral and written communication skills.
Takes personal responsibility for speed, quality, and accuracy of own work and teamwork.
Ability to work under pressure, flexible and adaptive to changing circumstances and requirements in a fast-moving environment.
Team player with high level of empathy and collaborative attitude.
Curious mind and drive for continuous learning.
Ability to build rapport with key stakeholders and decision-makers.
Minimum Qualifications & Experience
Computer Science degree or equivalent.
Additional IT or related qualifications advantageous.
Microsoft certification DP-203 (Data Engineering on Microsoft Azure).
Minimum 5 years' experience in a similar IT support role within an established enterprise.
Minimum 3 years' system integration experience.
Knowledge of PC hardware and Microsoft Windows 7 and 10 software.
Strong English verbal, reading, and writing skills; other languages beneficial.
Valid driver's license and own transport.
Valid passport.
Required to sign an NDA and adhere to strict confidentiality requirements.
Working Hours & Conditions
Standard working hours: 08h00 to 17h00, Monday to Friday.
Must be willing and available to work extended hours and occasionally over weekends when required.
Work involves high pressure within a fast-paced environment while ensuring quality and client relations are maintained.
Some travel may be required.
MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.