Data Engineer

• Experience:

• Bringing 2+ years of expertise in data engineering, with a proven track record of designing and optimizing scalable solutions. Strong experience with cloud data warehouses and query engines

• Experience with data cataloging, metadata management, and lineage tools

• Experience with data quality tooling will be a plus. - Technical Expertise:

• Strong expertise in big data technologies such as SQL, PySpark and Hive

• Experience with big data workflow orchestrators like Argo Workflows

• Hands-on experience with cloud-based data stores like Redshift or BigQuery (preferred). - Familiarity with cloud platforms, preferably GCP or Azure. - Development Practices:

• Strong programming skills in Python, with experience in frameworks like FastAPI or similar API frameworks. - Proficiency in unit testing and ensuring code quality. - Hands-on experience with version control tools like Git. - Optimization & Problem Solving:

• Ability to analyze complex data pipelines, identify performance bottlenecks, and suggest optimization strategies. - Work collaboratively with infrastructure teams to ensure a robust and scalable platform for data science workflows. - Collaboration & Communication:

• Excellent problem-solving skills and the ability to work effectively in a team environment. - Proven mentoring and communication skills, fostering collaboration across teams and effectively sharing technical expertise. Nice To Have:

• Experience with microservices architecture, containerization using Docker, and orchestration tools like Kubernetes. - Working knowledge of machine learning workflows with feature engineering, model training, deployment, and monitoring etc. - Understanding of logging, monitoring, and alerting for production-grade big data pipelines. - Good working knowledge with NoSQL databases such as MongoDB, Cassandra, or DynamoDB. This role is ideal for someone eager to grow their expertise in modern data engineering practices while contributing to impactful projects in a collaborative environment. What you can expect from us

We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect. Plus, thoughtful perks, like flexible working hours and your birthday off. You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn. And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One, dh Enabled and dh Thrive as the living proof. We want everyone to have the opportunity to shine and perform at your best throughout our recruitment process. Please let us know how we can make this process work best for you. Our approach to Flexible Working

At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work. We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process. For further information about how we collect and use your personal information please see our Privacy Notice which can be found (here)