2063 Aws Data Engineer

Centurion, Gauteng, South Africa

Job Description


Product / Feature Team Information (if applicable)
Our Domain, Enterprise Data Services, Platforms, comprises of a number of Data Business Objects, namely, Quality, Motorbike, Purchasing & Supplier, Marketing & Research, Finance, Sales, Customer, Customer Support, ITO and OTD
ESSENTIAL SKILLS REQUIREMENTS:
Above average experience/understanding (in order of importance):
e.g. Technical Skills / Technology

  • Terraform
  • Python 3x
  • SQL - Oracle/PostgreSQL
  • Py Spark
  • Boto3
  • ETL
  • Docker
  • Linux / Unix
  • Big Data
  • Powershell / Bash
Basic experience/understanding of AWS Components (in order of importance):
  • Glue
  • CloudWatch
  • SNS
  • Athena
  • S3
  • Kinesis Streams (Kinesis, Kinesis Firehose)
  • Lambda
  • DynamoDB
  • Step Function
  • Param Store
  • Secrets Manager
  • Code Build/Pipeline
  • CloudFormation
  • Business Intelligence (BI) Experience
  • Technical data modelling and schema design (not drag and drop)
  • Kafka
xc2xb7 AWS EMR
xc2xb7 Redshiftxc2xb7 Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.
xc2xb7 Experience developing technical documentation and artefacts.
xc2xb7 Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc.
xc2xb7 Experience working with Data Quality Tools such as Great Expectations.
xc2xb7 Experience developing and working with REST API's is a bonus.xc2xb7 Basic experience in Networking and troubleshooting network issues.
xc2xb7 Any additional responsibilities assigned in the Agile Working Model (AWM) Charter
ADVANTAGEOUS SKILLS REQUIREMENTS:
xc2xb7 Demonstrate expertise in data modelling Oracle SQL.
xc2xb7 Exceptional analytical skills analysing large and complex data sets.
xc2xb7 Perform thorough testing and data validation to ensure the accuracy of data transformations.
xc2xb7 Strong written and verbal communication skills, with precise documentation.
xc2xb7 Self-driven team player with ability to work independently and multi-task.
xc2xb7 Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
xc2xb7 Familiar with data store such as AWS S3, and AWS RDS or DynamoDB.
xc2xb7 Experience and solid understanding of various software design patterns.
xc2xb7 Experience preparing specifications from which programs will be written, designed, coded, tested and debugged.
xc2xb7 Strong organizational skills.
WHICH QUALIFICATIONS/EXPERIENCE DO WE NEED FOR THE ROLE?
xc2xb7 Relevant IT / Business / Engineering Degree
Certifications:
xc2xb7 Candidates with one or more of the certifications are preferred.
xc2xb7 AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate
WHAT WILL BE YOUR ROLE AND RESPONSIBILITIES?
e.g. Core Role tasks and responsibilities
Data Engineers are responsible for building and maintaining Big Data Pipelines using Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.
Data Engineers are also expected to:
Stay up to date with the latest data engineering tools, technologies and industry trends. Identify opportunities for process improvements and automation to enhance the efficiency and reliability of data pipelines. Explore and evaluate new data engineering approaches and technologies to drive innovation within the organisation.Mentor, train and upskill members in the team.WHAT DO WE OFFER YOU?
xc2xb7 Cutting edge global IT system landscape and processes
xc2xb7 Flexible working of 1960 hours in a 12-month period
xc2xb7 High Work-Life balance
xc2xb7 Remote / On-site work location flexibility
xc2xb7 Affordable Group vehicle promotions (buying or leasing options available, terms and conditions apply)
xc2xb7 Highly motivating, energetic, and fast-paced working environment
xc2xb7 Modern, state-of-the-art offices
xc2xb7 Dynamic Global Team collaboration
xc2xb7 Application of the Agile Working Model Methodology

ExecutivePlacements.com

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1410082
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Centurion, Gauteng, South Africa
  • Education
    Not mentioned