Posted May 7, 2026
You will be responsible for designing, developing, and maintaining scalable ETL pipelines using DataStage and other ETL tools. Leveraging AWS cloud services for data storage, processing, and analytics will be a key part of your role. Utilizing Databricks to analyze, process, and transform data, ensuring high performance and reliability, will also be one of your responsibilities. You will be expected to implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying. Working with Apache Spark to process large datasets, ensuring optimal performance and scalability, will be crucial. Integrating Kafka and Spark Streaming to build real-time data processing applications will also be part of your duties. Collaboration with cross-functional teams to gather requirements and deliver data solutions that meet business needs is essential. Ensuring data quality, integrity, and security across all data systems and pipelines will be a key focus. Monitoring and troubleshooting data workflows to ensure smooth operations is also part of the role. Documenting data processes, architecture designs, and technical specifications will be required. Qualifications:
Preferred Skills:
Experience with data warehousing and big data technologies
Familiarity with data governance and data security best practices
Certification in AWS or Databricks is a plus You will be responsible for designing, developing, and maintaining scalable ETL pipelines using DataStage and other ETL tools. Leveraging AWS cloud services for data storage, processing, and analytics will be a key part of your role. Utilizing Databricks to analyze, process, and transform data, ensuring high performance and reliability, will also be one of your responsibilities. You will be expected to implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying. Working with Apache Spark to process large datasets, ensuring optimal performance and scalability, will be crucial. Integrating Kafka and Spark Streaming to build real-time data processing applications will also be part of your duties. Collaboration with cross-functional teams to gather requirements and deliver data solutions that meet business needs is essential. Ensuring data quality, integrity, and security across all data systems and pipelines will be a key focus. Monitoring and troubleshooting data workflows to ensure smooth operations is also part of the role. Documenting data processes, architecture designs, and technical specifications will be required. Qualifications:
Bachelors degree in Computer Science, Information Technology, or a related field
Proven experience as a Data Engineer or in a similar role
Strong proficiency in SQL and experience with relational databases such as Teradata
Hands-on experience with AWS services such as S3, EMR, Redshift, and Lambda
Proficiency in using Databricks for data engineering tasks
Experience with Delta Live Tables and Delta Tables in a data engineering context
Solid understanding of Apache Spark, Kafka, and Spark Streaming
Experience with messaging systems like MQ is a plus
Strong problem-solving skills and attention to detail
Excellent communication and collaboration skills
Preferred Skills:
Don't want to apply yourself?
Our team writes your resume, applies for you, preps you for interviews, and negotiates your offer.
Browse Jobs
By Role
By City