Duties & Responsibilities: There are two main duties:
Develop & maintain data pipelines in support of downstream data delivery.
Perform analysis on organisational data & create reports to communicate the results.
Other potential duties include, but are not limited to:
Communicate and advocate for a data-driven mindset in the larger organisational community, especially the IT department.
Investigate and evaluate emerging technologies like robotic process automation (RPA), new AWS services, new data management approaches, machine learning advancements, etc.
Liaise with individuals in the organisation in support of all the above duties.
Qualifications & Experience:
Relevant IT degree, Diploma or certification
10 years plus experience as a Data Engineer
Good programming skills in both Python and SQL.
Good database design skills and an understanding of data warehousing techniques and approaches.
An understanding of and ability to access data from sources such as: Microsoft SQL Server, Oracle, MongoDB, Amazon S3
Windows and Linux file systems (Excel, delimited files, etc.), HTTP APIs
SFTP sites
An ability to engineer cloud-first solutions in the Amazon Web Services cloud.
An interest in machine learning and advanced analytics, and the development of data pipelines in
support thereof.
An understanding of the software development process, with proficiency in Git for version control and build & deployment pipelines in GitLab.
An ability to create reports and BI dashboards to communicate data & analysis results, using a variety of technologies, which might include: Microsoft SQL Server Reporting Services, Microsoft Power BI, Microsoft Excel
Beware of fraud agents! do not pay money to get a job
MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.