As a Data Services Engineering lead, you will play a crucial role in designing and implementing distributed applications within our innovative development team. Your expertise in java development, distributed computing, and big data technologies, particularly focused on Databricks, will be instrumental in leading the creation of cutting-edge data solutions for business intelligence and analytics. **Key Responsibilities:**
Lead the design, development, and deployment of scalable Java applications integrated with Databricks for big data processing
Architect and optimize distributed computing solutions using Apache Spark within the Databricks environment to handle large-scale datasets efficiently
Implement and manage data lake house architecture using Databricks, ensuring data integrity, security, and accessibility
Develop and maintain ETL pipelines using Databricks and Apache Spark, automating data workflows to improve processing efficiency
Provide technical leadership in system architecture design, making informed decisions to meet business requirements and scalability needs
Optimize cloud resource utilization on platforms like Azure ensuring cost-effective and reliable data processing solutions
Lead, mentor, and grow a team of engineers fostering a culture of excellence and innovation
**Qualifications Required:**
Expertise in Core Java/ J2EE development, Solution design & Architecture with a deep understanding of object-oriented principles
Proficiency in distributed computing frameworks, particularly Apache Spark, within the Databricks environment
Strong knowledge in modern software development technologies and frameworks
Solid understanding of data warehousing concepts and hands-on experience with Snowflake & Databricks
Experience with version control system such as GitHub and familiarity with CI/CD pipelines
Strong analytical and problem-solving skills with the ability to make critical technical and business decisions
Demonstrated excellent Communication Skills with the ability to effectively run meetings and collaborate across teams and functions
**Additional Company Details:**
Our technology function, Global Technology Services (GTS), plays a vital role at State Street by enabling the delivery of data and insights to clients, driving the company's digital transformation and expanding business capabilities using advanced technologies such as cloud, artificial intelligence, and robotics process automation. We offer a collaborative environment where technology skills and innovation are valued, seeking top technical talent to deliver creative technology solutions that help us become a next-generation financial services company. As a Data Services Engineering lead, you will play a crucial role in designing and implementing distributed applications within our innovative development team. Your expertise in java development, distributed computing, and big data technologies, particularly focused on Databricks, will be instrumental in leading the creation of cutting-edge data solutions for business intelligence and analytics. **Key Responsibilities:**
Lead the design, development, and deployment of scalable Java applications integrated with Databricks for big data processing
Architect and optimize distributed computing solutions using Apache Spark within the Databricks environment to handle large-scale datasets efficiently
Implement and manage data lake house architecture using Databricks, ensuring data integrity, security, and accessibility
Develop and maintain ETL pipelines using Databricks and Apache Spark, automating data workflows to improve processing efficiency
Provide technical leadership in system architecture design, making informed decisions to meet business requirements and scalability needs
Optimize cloud resource utilization on platforms like Azure ensuring cost-effective and reliable data processing solutions
Lead, mentor, and grow a team of engineers fostering a culture of excellence and innovation
**Qualifications Required:**
Expertise in Core Java/ J2EE development, Solution design & Architecture with a deep understanding of object-oriented principles
Proficiency in distributed computing frameworks, particularly Apache Spark, within the Databricks environment
Strong knowledge in modern software development technologies and frameworks
Solid understanding of data warehousing concepts and hands-on experience with Snowflake & Databricks
Experience with version control system such as GitHub and familiarity with CI/CD pipelines
Strong analytical and problem-solving skills with the ability to make critical technical and business decisions
Demonstrated excellent Communication Skills with the ability to effectively run meetings and collaborate across teams and functions
**Additional Company Details:**
Our technology function, Global Technology Services (GTS), plays a vital role at State Street by enabling the delivery of data and insights
