Spark/Scala Developer
Posted May 8, 2026
As a Spark/Scala Developer, your responsibilities will include:
-
Leading the development of data pipelines to support the implementation of data science and analytics use cases. - Developing code in Scala, testing it, and implementing it into the Production environment. - Participating in the solution design phase and analyzing requirements. - Leading a squad of engineers for a Data Product and executing data transformation projects in Hadoop. - Leading a team of 3-5 data engineers with minimum supervision and collaborating with wider IT and business project teams. Qualifications required for this role:
-
7-12 years of experience in Big Data/Hadoop, with a focus on ingesting data and implementing Data ingestion pipelines. - Proficiency in Hadoop, Hive, Impala, Advanced SQL, Spark, Scala, OS (Unix), CI/CD Tools (Git, Jenkins, Nexus), Agile (Jira, Confluence), and Relational Databases. - Strong understanding of SQL, Unix, and HDFS commands. - Experience working on Data Engineering projects. - Exposure to Tableau & SAS will be an added advantage. If you are passionate about working with Big Data platforms and have a solid background in Spark, Scala, Hive, and Impala, this role offers you the opportunity to lead data engineering projects and collaborate with cross-functional teams to drive impactful data transformation initiatives. As a Spark/Scala Developer, your responsibilities will include:
-
Leading the development of data pipelines to support the implementation of data science and analytics use cases. - Developing code in Scala, testing it, and implementing it into the Production environment. - Participating in the solution design phase and analyzing requirements. - Leading a squad of engineers for a Data Product and executing data transformation projects in Hadoop. - Leading a team of 3-5 data engineers with minimum supervision and collaborating with wider IT and business project teams. Qualifications required for this role: