AWS Databricks Architect - Sr Staff

Key Responsibilities:

• Architect end-to-end data solutions using the Medallion Architecture (Bronze/Silver) and Delta Lake. - Implement and manage Unity Catalog for centralized data governance, access control, and lineage tracking. - Lead and mentor cross-functional teams of data engineers, conduct code reviews, and define best practices in Python, PySpark, and SQL. - Drive cost-efficiency by tuning Spark jobs, managing cluster policies, and utilizing serverless compute and auto-scaling. - Integrate Databricks workflows into CI/CD pipelines using tools like Databricks Asset Bundles, Terraform, and Azure DevOps or GitHub. - Provide architectural guidance for integrating machine learning models, including feature engineering and model deployment via MLflow. - Build complex data models to support various analytics needs. - Work collaboratively with cross-functional teams and business stakeholders. - Own the strategy for migrating to Databricks medallion architecture and drive project completion. Qualifications Required:

• 14+ years of experience in data management, data engineering, or data science roles, with at least 7 years in building enterprise-level data models. - 8+ years of experience with Data Structures and algorithms. - 8+ years of experience with programming languages such as Java and Python. - 8+ years of experience with SQL or NoSQL Databases. - 3+ years of experience interacting with senior leadership and leading modernization efforts of Data platforms. - Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field. - Strong understanding and hands-on experience with lakehouse medallion data architecture and governance. - Experience in migrating legacy DW data models to 3-layer medallion architecture. - Passion for exploring GenAI-based solutions for documenting existing DW footprint and building strategic data models for Databricks platform. - Experience with machine learning, artificial intelligence, and predictive analytics is a plus. - Excellent leadership, communication, and collaboration skills in a global hybrid delivery model. - Strong problem-solving skills with a strategic thought process and proactive soft skills. (Note: The additional details of the company were not explicitly mentioned in the provided job description) Role Overview: As a Databricks Architect at Qualcomm India Private Limited, you will be responsible for making technical decisions, ensuring code quality, and successfully delivering complex data projects using Delta Lake, Unity Catalog, and Mosaic AI. You will own the end-to-end strategy for data ingestion, storage, and analytics, acting as a liaison between business stakeholders and engineering teams to ensure a secure, cost-optimized platform capable of supporting advanced AI/ML workloads. Key Responsibilities: