As a Senior Data Engineer on the Enterprise Data Platform team at PitchBook, your role involves building data pipelines to ingest various source data from enterprise technologies and the PitchBook Platform. You will be responsible for manipulating data into well-constructed data models for analysis, implementing business logic, and making the data available to end consumers through data products built on top of the data warehouse/data lake (e.g. Snowflake). You will work with a variety of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to ensure efficient processing and develop insights for internal stakeholders across various departments. Your team will rely on you to enhance your skills in data techniques and analytics to deliver accurate, timely, accessible, and secure data & insights to users. Collaboration with internal and external stakeholders of different roles and technical backgrounds will be essential, allowing you to impact various areas of analytics and operational thinking across enterprise technology and product engineering. Your attitude towards growth, feedback solicitation, empathy, and teamwork will contribute to creating a culture of belonging and purpose within the team. **Key Responsibilities:**
Apply unified data technologies to support advanced and automated business analytics
Design, develop, document, and maintain database and reporting structures for compiling insights
Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
Evolve data processes and techniques following industry best practices
Build data models for reports and dashboards translating business data into insights and identifying operational improvement opportunities
Contribute to improving quality assurance standards and procedures
Support the company's vision and values through role modeling and encouraging desired behaviors
Participate in various company initiatives and projects as required
**Skills and Qualifications:**
Bachelor's degree in a related field (Computer Science, Engineering, etc.)
5+ years of experience in data engineering roles, including data pipelines, data modeling, and data architecture
5+ years of advanced SQL experience, including querying large datasets and developing automated reporting
3+ years of Python experience, including scripting, data manipulation, and statistical analysis
Expertise in ETL and ELT processes, platforms like Airflow, and distributed messaging systems like Kafka
Experience with data modeling change management tools such as SQLMesh
Proficiency in data storage solutions, data warehousing, and cloud-based data platforms like Snowflake
Knowledge and experience in data governance, data quality, and compliance standards
If you are passionate about building data-centric solutions, strive for excellence, and enjoy a collaborative and purpose-driven work environment, we invite you to join our team at PitchBook. As a Senior Data Engineer on the Enterprise Data Platform team at PitchBook, your role involves building data pipelines to ingest various source data from enterprise technologies and the PitchBook Platform. You will be responsible for manipulating data into well-constructed data models for analysis, implementing business logic, and making the data available to end consumers through data products built on top of the data warehouse/data lake (e.g. Snowflake). You will work with a variety of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to ensure efficient processing and develop insights for internal stakeholders across various departments. Your team will rely on you to enhance your skills in data techniques and analytics to deliver accurate, timely, accessible, and secure data & insights to users. Collaboration with internal and external stakeholders of different roles and technical backgrounds will be essential, allowing you to impact various areas of analytics and operational thinking across enterprise technology and product engineering. Your attitude towards growth, feedback solicitation, empathy, and teamwork will contribute to creating a culture of belonging and purpose within the team. **Key Responsibilities:**
Apply unified data technologies to support advanced and automated business analytics
Design, develop, document, and maintain database and reporting structures for compiling insights
Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
Evolve data processes and techniques following industry best practices
Build data models for reports and dashboards translating business data into insights and identifying operational improvement opportunities
Contribute to improving quality assurance standards and procedures
Support the company's vision and values through role modeling and encouraging desired behaviors
Participate in various company initiatives and projects as requi
