Middle DataOps Engineer

What You’ll Do

• Support the migration from Synapse to Databricks by building and maintaining robust infrastructure and deployment pipelines. - Automate provisioning, configuration, and monitoring of Databricks environments across multiple data streams. - Ensure smooth CI/CD processes for data engineering workloads, including:

• Initial data load automation

• Deployment of data marts and consumption layers

• Integration with reporting and Power BI solutions

• Collaborate with Data Engineers, product teams, and business stakeholders to ensure reliable and secure data delivery. - Optimize system performance, scalability, and cost-efficiency in cloud environments. - Implement monitoring, alerting, and logging solutions to maintain system health and reliability. - Write and maintain Infrastructure as Code (IaC) for repeatable, version-controlled deployments. - Troubleshoot and resolve environment, pipeline, and integration issues efficiently. - Stay current with DevOps best practices and emerging technologies in the cloud and data ecosystem. ### What You Bring

• 5+ years of professional experience in DevOps, cloud infrastructure, and automation. - Proven experience in designing and leading large-scale implementation on Databricks. - Proficiency with Infrastructure as Code tools (e.g., Terraform, ARM templates, Bicep, or similar). - Solid scripting and automation skills in Python, Bash, or PowerShell. - Familiarity with CI/CD pipelines (Azure DevOps, GitHub Actions, or similar) for data engineering workflows. - Knowledge of containerization and orchestration (Docker, Kubernetes is a plus). - Experience implementing monitoring and observability tools (Azure Monitor, Prometheus, Grafana, etc.). - Strong understanding of cloud security, governance, and cost optimization practices. - Competency in collaborating with engineers to ensure stable, scalable, and maintainable solutions. Duties and responsibilities may evolve based on business needs