Bi Data Engineer

Bellville, Western Cape, South Africa

Job Description



Who are we?
The Sanlam Retail Affluent business (SRA) is dedicated to empower South Africans in the middle- and upper-income segments to be financially confident, secure and prosperous. With deep client understanding and a focus on excellence in technology, client and intermediary experiences, SRA delivers financial solutions including comprehensive financial planning, life- and disability insurance, credit solutions, savings and investments, retirement and fiduciary services that can be accessed through various platforms.



What will you do?

Main responsibilities
The performance of the BI Data Engineer can be described and measured by:

  • Define a structured approach to problem solving and delivery against it.
  • Create role specific design standards, patterns and principles
  • Load large, complex data sets to and make data available for other data engineers
  • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing models for greater scalability
  • Use modern development and modelling techniques and tools to implement BI and data management solutions, including data quality, metadata and reference data
  • Engage with a wide range of technical stakeholders including data scientists, data analysts, business analysts, other data engineers and solutions architects
  • Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration, and processes
  • Mentor Junior Engineers
  • Working with other data engineers and data modelers, you will design, implement, and manage ETL programmes, data transformations and data pipelines that realise source to target mappings.
  • Design, implement, and manage complex data vaults, data transformations and the data pipeline; generally using the Wherescape tool
  • Monitor and fine-tune data pipelines and data transformations using SQL, Spark, NiFi on the Cloudera Hadoop stack
  • Monitor and fine-tune data vaults, data transformations and stored procedures on the Cloudera Hadoop stack
  • Identify, design, and implement vault access layers to enable BI products to leverage the data within data vaults
  • Design and monitor user or system access to the data warehouse to ensure data security and integrity



What will make you successful in this role?

Qualifications

  • Bachelorxe2x80x99s degree in Computer Science, Statistics, Informatics, Information Systems, Engineering or another quantitative field / National Diploma in an Information Technology related discipline preferred



Experience and skills:
  • 3- 8 years related experience
  • Application and data engineering background with a solid background in SQL is required
  • Data architecture design and delivery experience preferred
  • Experience in three (3) or more of the following areas is required:
  • Database technologies (e.g. SAP Hana, Teradata or similar) and database development (Views, Functions and Stored Procedure development)
  • Hadoop components including HDFS, Hive, Spark, Oozie and Impala
  • Object-oriented/object functional scripting languages: Python, Java, Scala or related.
  • ETL tools (e.g. SAP Data Services)
  • Event/Streaming based data pipelines (e.g. Kafka or Nifi)
  • Data warehousing (Kimball and Data Vault patterns are preferred) and dimensional data modelling (OLAP and MDX experience)






Personal Attributes

Interpersonal savvy - Contributing through others
Decision quality - Contributing through others
Plans and aligns - Contributing through others
Optimises work processes - Contributing through others


Build a successful career with us

Wexe2x80x99re all about building strong, lasting relationships with our employees. We know that you have hopes for your future xe2x80x93 your career, your personal development and of achieving great things. We pride ourselves in helping our employees to realise their worth. Through its four business clusters xe2x80x93 Sanlam Life and Savings, Sanlam Investment Group, Sanlam Emerging Markets, Santam, as well as MiWay and the Group Office xe2x80x93 the group provides many opportunities for growth and development.


Core Competencies

Cultivates innovation - Contributing through others
Customer focus - Contributing through others
Drives results - Contributing through others
Collaborates - Contributing through others
Being resilient - Contributing through others


Turnaround time

The shortlisting process will only start once the application due date has been reached. The time taken to complete this process will depend on how far you progress and the availability of managers.


Our commitment to transformation

The Sanlam Group is committed to achieving transformation and embraces diversity. This commitment is what drives us to achieve a diverse, inclusive and equitable workplace as we believe that these are key components to ensuring a thriving and sustainable business in South Africa. The Group's Employment Equity plan and targets will be considered as part of the selection process.

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1273405
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bellville, Western Cape, South Africa
  • Education
    Not mentioned