Senior DataOps Engineer

Become part of an iconic brand that is set to revolutionize the electric pick-up truck & rugged SUV marketplace by achieving the following:

• Contribute to the design, implementation, automation, maintenance, and operational support of enterprise-scale cloud data platforms leveraging Databricks, AWS cloud services, and modern Infrastructure as Code (IaC) practices. - Lead the design, development, optimization, and operational management of enterprise-scale ETL/ELT pipelines within Databricks. - Build and maintain scalable batch and streaming data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows. - Configure, optimize, and manage Databricks clusters for performance, scalability, reliability, and cost efficiency. - Work closely with software development and systems teams to build Data Integration solutions. - Design and build Data models using tools such as Lucid, Talend, Erwin, MySQL workbench. - Define and enhance enterprise data model to reflect relationships and dependencies. - Review application data systems to ensure adherence to data governance policies. - Design and build ETL (Python), ELT(Python) infrastructure, automation, and solutions to transform data as required. - Design and Implement BI dashboards to visualize Trends and Forecasts. - Design and implement data infrastructure components, ensuring high availability, reliability, scalability, and performance. - Design, train and deploy ML models

• Implement monitoring solutions to proactively identify and address potential issues. - Collaborate with security teams to ensure the data platform meets industry standards and compliance requirements. - Collaborate with cross-functional teams, including product managers, developers, and business partners to ensure robust and reliable systems. Location & Travel Expectations:

• This role is based out of the Scout Motors corporate headquarters in Charlotte, NC. - The responsibilities of this role require 4-5 days attendance in office with in-person meetings and events regularly. - Applicants should expect that the role will require the ability to convene with Scout colleagues in person and travel to participate in events on behalf of the company from time to time. #### What you’ll bring

We expect all Scout employees to have integrity, curiosity, resourcefulness, and strive to exhibit a positive attitude, as well as a growth mindset. You’ll be comfortable with change and flexible in a fast-paced, high-growth environment. You’ll take a collaborative approach to achieve ambitious goals. Here's what else you'll bring:

• Bachelor's degree in computer science, information technology, or related field or equivalent work experience. - 7+ years of hands-on experience as DataOps Engineer in a manufacturing or automotive environment. - Experience with streaming and event-based architecture. - Experience implementing data lakehouse solutions using Databricks. - Experience with infrastructure as code (Terraform). - Proficient in building data pipelines using languages such as Python and SQL. - Experience with AWS based data services such as Glue, Kinesis, Firehose or other comparable services. - Experience with Structured, unstructured and time series databases. - Solid understanding of cloud data storage solutions such as RDS, DynamoDB, DocumentDB, Mongo, Cassandra, Influx. - Several years of experience working with cloud platforms such as AWS and Azure. - Proven ability to develop and deploy scalable ML models. - Hands-on experience in designing, training, and deploying ML models
• Strong ability to extract actionable insights using ML techniques
• Ability to leverage ML algorithms for forecasting trends and decision-making
• Excellent problem-solving and troubleshooting skills. When a problem occurs, you run towards it not away. - Effective communication and collaboration skills. You treat colleagues with respect. You have a desire for clean implementations but are also humble in discussing alternative solutions and options.