Job Description

Closing Date: 2023-11-09

Job Type: Contract

Job Level: Senior

Experience: Between 3 - 5 Years

EE/AA: No

Summary

My international client based in Midrand, Gauteng currently has an exciting opportunity for an AWS Data Engineer to join their growing team, kindly submit all applications to Kyle.Govender@mediro-ict.co.za

Description

WHAT WILL BE YOUR ROLE AND RESPONSIBILITIES?

e.g. Core Role tasks and responsibilities

Data Engineers are responsible for building and maintaining Big Data Pipelines using BMW Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.

Knowledge of the Agile Working Model.Demonstrate expertise in data modelling Oracle SQL. xe2x80xa2 Exceptional analytical skills analysing large and complex data sets. xe2x80xa2 Perform thorough testing and data validation to ensure the accuracy of data transformations. xe2x80xa2 Strong written and verbal communication skills, with precise documentation. xe2x80xa2 Self-driven team player with ability to work independently and multi-task. xe2x80xa2 Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.

• Experience developing technical documentation and artefacts.
• Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc.
• Experience working with Data Quality Tools such as Great Expectations.
• Experience developing and working with REST API's is a bonus.
• Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.

Familiar with data store such as AWS S3, and AWS RDS or DynamoDB. xe2x80xa2 Experience and solid understanding of various software design patterns. xe2x80xa2 Experience preparing specifications from which programs will be written, designed, coded, tested and debugged. xe2x80xa2 Strong organizational skills.

Minimum Requirements

WHICH QUALIFICATIONS/EXPERIENCE DO WE NEED FOR THE ROLE?

• Relevant IT / Business / Engineering Degree
• Candidates with one or more of the certifications are preferred.
• AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate

ESSENTIAL SKILLS REQUIREMENTS:

Above average experience/understanding (in order of importance):

e.g. Technical Skills / Technology

• Terraform
• Python 3x
• SQL - Oracle/PostgreSQL
• Py Spark
• Boto3
• ETL
• Docker
• Linux / Unix
• Big Data
• Powershell / Bash
• Cloud Data Hub (CDH)
• CDEC Blueprint

ADVANTAGEOUS SKILLS REQUIREMENTS:

Basic experience/understanding of AWS Components (in order of importance):

• Glue
• CloudWatch
• SNS
• Athena
• S3
• Kinesis Streams (Kinesis, Kinesis Firehose)
• Lambda
• DynamoDB
• Step Function
• Param Store
• Secrets Manager
• Code Build/Pipeline
• CloudFormation
• Business Intelligence (BI) Experience
• Technical data modelling and schema design (xe2x80x9cnot drag and dropxe2x80x9d)
• Kafka
• AWS EMR
• Redshift
• Basic experience in Networking and troubleshooting network issues.

Mediro ICT Recruitment