Job Description

Data Integrations Engineer (NiFi)
We are seeking a Data Integration Engineer with deep experience in Apache NiFi, Kafka, and enterprise systems like SAP, to design and implement secure, scalable, and real-time data pipelines for a high-profile client implementation project. The ideal candidate will have expertise in managing structured and semi-structured data, integrating legacy and modern systems, and automating data flows across cloud and on-prem environments.
Key Responsibilities:

• Design, develop, and maintain NiFi data pipelines for ingesting and transforming data from various sources (including SAP, APIs, flat files, DBs).
• Integrate messaging systems like Kafka and RabbitMQ into the pipeline for event streaming and system decoupling.
• Work closely with Business Analysts and BPEs to translate client requirements into technical data flows.
• Implement and manage connectors for SAP, REST APIs, and file-based batch processes.
• Ensure data lineage, auditability, and performance tuning of NiFi flows.
• Deploy and monitor data flows in distributed environments using Zookeeper, Kafka, and ElasticSearch for logging and observability.

Required Skills:

• 3-5+ years of experience in data integration/engineering roles.
• Strong expertise with Apache NiFi (flow design, templates, version control, custom processors).
• Proficient in Kafka, RabbitMQ, and event-driven architectures.
• Experience integrating with SAP (BAPIs, IDocs, OData) and legacy systems.
• Scripting and transformation in Python, Groovy, or Java.

Familiarity with distributed systems (Zookeeper, ElasticSearch, etc.). * Experience with CI/CD for NiFi or container-based deployments (Docker, Kubernetes).
Nice to Have:

• Knowledge of security practices (TLS, role-based access in NiFi).
• Hands-on with monitoring tools (Prometheus, Grafana).
• Familiarity with cloud platforms (AWS/GCP/Azure) for data storage or processing.

Other Requirements:

• Eligibility for Top-Level Security Clearance:

• Candidates must be eligible to obtain and maintain security clearance at the highest level, in accordance with applicable national security regulations.
• On-Site Work Requirement:

• This role requires full-time, on-site presence at the client's premises located in Pretoria. Remote or hybrid work arrangements are not applicable.