Lead: Data Engineering

Cape Town, Western Cape, South Africa

Job Description


Job Summary Job Purpose:
In this vital role, you'll manage the development and maintenance of our advanced data infrastructure, crucial for maintaining rain's position as a leader in 5G technology in South Africa. Your responsibilities include overseeing data pipelines, warehouses, and lakes, ensuring data quality and reliability. Collaborating with various teams like Network, Consumer, and DevOps, you'll be instrumental in driving data-driven strategies across the organization. If you're passionate about leading-edge data engineering and want to contribute significantly to our team, we encourage you to apply and join our journey in pioneering 5G advancements.

Key Responsibilities:
1. Leadership and team management:

  • Lead and mentor a team of data engineers.
  • Engrain a culture of continuous process improvement.
  • Manage planning, execution, delivery, and maintenance of efforts.
2. Data strategy and architecture
  • Develop and implement and data strategies that align with business goals.
  • Co-design and maintain data architectures.
  • Oversee the integration of data management technologies on the cloud (AWS, Azure, GCP, HCS) and on-premises.
3. Data process and analytics
  • Ensure efficient data processing and pipeline development from various sources such as databases, Network Element (NE) events, log files, APIs, streaming sources, and external data-generated sources.
  • Implement systems for tracking data quality and consistency, complying to data protection and privacy regulation best practices.
  • Implement monitoring and performance optimization strategies for data infrastructure, considering budget and requirements.
  • Work closely with data scientists and analysts to support data modeling, analysis, and reporting.
Requirements:
  • Extensive (5+ years) experience in data engineering.
  • At least 3 years in a leadership role.
  • Proficiency in engineering tools and languages, Python and SQL are a must., and a strong understanding of big data technologies such as (1) Hadoop, Hive, MongoDB, Postgres etc; (2) Presto, ElasticSearch etc for data mining; (3) Kafka, Splunk, Apache Spark etc for big data analytics.
  • Preferred experience in containerisation and/or dockerisation of developed solutions.
  • Strong understanding of ETL processes, data warehousing principles.
Personal Attributes:
  • Excellent problem solving, analytical and management skills.
  • Strong leadership and team building abilities.
  • Excellent communication and interpersonal skills.
  • Ability to work in a fast-paced, dynamic environment.
  • Passionate about data-driven decision making.
Rain

Company

Job Mail

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1287918
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Cape Town, Western Cape, South Africa
  • Education
    Not mentioned