Job Description

Requirements

• Relevant qualifications such as Computer Science or Information Technology
• 5 to 8 years of relevant experience
• Proven experience in designing and implementing data pipelines using stream processing technologies
• Experience with end-to-end testing of analytics pipelines
• In-depth expertise in managing and optimizing Elasticsearch clusters, including performance tuning and scalability
• Strong proficiency with data extraction, transformation, and loading (ETL) processes
• Familiarity with data modelling and schema design for efficient data storage and retrieval
• Proficiency in troubleshooting data pipeline and Elastic-related issues to ensure data integrity and availability
• Solid programming and scripting skills, particularly in languages like Python, Scala, or Java
• Knowledge of DevOps and automation practices related to data engineering

• Designing, implementing, and maintaining robust data pipelines using Kafka, ensuring the efficient and reliable flow of data across our systems
• Leveraging your expertise in stream processing to optimize real-time data processing and streaming, enhancing our ability to analyze customer interactions
• Developing and maintaining Elasticsearch clusters, fine-tuning them for high performance and scalability
• Collaborating with cross-functional teams to extract, transform, and load (ETL) data into Elasticsearch for advanced analytics and search capabilities
• Troubleshooting data pipeline and Elasticsearch issues, ensuring the integrity and availability of data for analytics and reporting

ExecutivePlacements.com