Job Description

What we do
Blue Bean Software is a premier custom software and product development IT company, delivering custom-made solutions for large enterprises as well as dynamic start-ups.
We pride ourselves in taking on and solving complex problems as well as high-stakes projects through the use of a balanced combination between tech savvy and a deep understanding of a client's needs.
We have a prominent presence in the financial services industry and have started to branch out into other industries such as agritech and healthtech.
Who we are
At Blue Bean Software, we believe in creating an environment where like-minded software engineers are able to express themselves freely and pursue their individual and professional growth. We further encourage individuals to master their respective skill sets whilst effectively working within teams to overcome challenges and accomplish set goals.
At Blue Bean Software, we firmly believe in maintaining a culture of self-motivation, integrity and trust to drive productivity.
How we work
We have a flat organisational structure and value collaboration between our teams. We further believe in empowering individual team members to ensure agile decision-making and streamlined communication across all teams to deliver efficient and effective customer service at all times.
We are looking for a Senior Data Engineer to join our team of professionals.
Job Summary:
We are looking for an experienced Intermediate to Senior Data Engineer to join our growing team. The ideal candidate is passionate about designing and building scalable data solutions, has a strong grasp of data architecture, and is comfortable working across modern cloud-based data platforms. You'll be responsible for building, optimising, and maintaining efficient data pipelines that drive business value.
Key Responsibilities:

• 5+ years of professional experience in data engineering or related fields.
• Strong experience building ETL pipelines in cloud environments (preferably AWS).
• Proficiency in Python for scripting, data manipulation, and automation.
• Experience with Apache Spark and knowledge of the broader big data ecosystem
• Hands-on experience with streaming technologies such as Kafka or Kinesis.
• Working knowledge of AWS services like S3, Glue, Lake Formation, Athena, and IAM.
• Familiarity with CI/CD tools (e.g. GitHub Actions, Azure DevOps) and version control (Git).
• Experience with Terraform or other infrastructure-as-code frameworks.
• Exposure to Lakehouse/Data Mesh architectures.
• Understanding of security protocols including encryption, OAuth, SAML, and identity providers (AD/LDAP/Kerberos).
• Exposure to containerisation and orchestration tools like Docker and Kubernetes is advantageous.
• Familiarity with both relational and NoSQL databases.

• Experience with dbt (Data Build Tool).
• Exposure to Snowflake or similiar cloud-native data warehouse platforms.
• Relevant certifications such as AWS Certified Data Analytics or Azure Data Engineer Associate.
• Experience with monitoring and observability tools for data pipelines.

• Strong analytical thinking and attention to detail.
• Comfortable working in high-pressure environments with time-sensitive data.
• Excellent problem-solving and debugging abilities.
• Team-oriented with strong communication skills.
• A proactive, solutions-driven mindset.
• Embraces change and thrives in Agile environments.