Data Engineer Ict Data And Analytics Services Department

Pretoria, Gauteng, South Africa

Job Description


Purpose of the job:

To Design, build, expand, and optimize the data pipeline architecture, as well as optimize data flow and optimize the organizationxe2x80x99s data ingestion process to support data initiatives. The person appointed to this position will report to the Senior Specialist: ICT Data & Analytics.

Requirements:

Key Performance Area:

  • Develop, innovate and maintain the data architecture that will drive various initiatives/projects across the organisation
  • Collaborate with teams to build strategic data models that will help enable the achievement of business outcomes
  • Create robust and automated pipelines to ingest and process structured and unstructured data from source systems into analytical platforms
  • Conduct complex data analysis and report on results
  • Build and optimise xe2x80x98big dataxe2x80x99 data pipelines, architectures and datasets
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management
  • Develop and maintain datasets
  • Analyse raw data and Interpret trends and patterns
  • Prepare data for prescriptive and predictive modelling
  • Reformulate existing frameworks to optimize functionality.
  • Deploy and schedule ETL jobs (Batch/Micro batch processing)
  • Partner with various stakeholders within the organisation to drive the improvement in the way that data is stored and consumed.
  • Support application team development by writing stored procedures, functions etc.
  • Develop and maintain data security and permissions, including data encryption and database user access controls and logging.
  • Build algorithms and prototypes.
  • Lead business stakeholderxe2x80x99s engagement on Data Engineer standards and reporting requirements in order to derive the data driven strategy of the FSCA.
Other Key Competencies:
The candidate must demonstrate the following skills and attributes: Must have extensive experience with ETL, technical expertise with data models, data mining, and segmentation techniques, experience using MS SSIS, MS SSAS, MS SSRS and Visual Studio data tools, advanced working SQL knowledge and experience working with relational databases, dimensional modeling, query authoring (SQL) as well as working familiarity with a variety of other databases, experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement, ability to deal professionally with internal and external clients, Ability to work under pressure and meet deadlines, Innovative thinking and planning skills, Ability to function independently.

FSCA is committed towards increasing the representation of marginalised groups in line with its Employment Equity Plan. Persons with disabilities are encouraged to apply.

Please note that correspondence and communication will only be conducted with short listed candidates and that the FSCA reserves the right not to appoint if a suitable candidate is not identified.

A degree in computer science, IT, or related field. Data engineering certification is a plus, with more than 5 experience as a data engineer/ETL Developer.

Closing Date: 24 November 2023

Financial Sector Conduct Authority

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1277568
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pretoria, Gauteng, South Africa
  • Education
    Not mentioned