Senior / Staff Data Engineer
Posted Apr 12, 2026
What you'll own
- Reliability and completeness of our multi-provider ingestion pipeline: build failover logic, track daily completion rates per AI provider, and maintain the systems that ensure customers always get accurate, timely data
- Data quality and consistency end to end: own the contracts between ingestion, processing, and downstream serving so that what customers see in the product is correct and trustworthy
- Extraction pipeline performance: design and maintain async processing patterns that keep our ingestion throughput ahead of demand as we scale
- Data readiness for new features: partner with engineering upstream so instrumentation, schema changes, and pipeline capacity are in place before features ship
- Pipeline observability: build and maintain health monitoring across the full data stack so the team knows the state of the system in real time
What you'll bring
- Built and maintained production data pipelines at meaningful scale, including experience with ingestion, ETL, and distributed job queue systems
- Hands-on experience with ClickHouse or a comparable columnar store, including schema design, materialized views, and query optimization
- Experience working with third-party data providers or scraping infrastructure at scale
- Designed and owned reliability and observability systems: you have built the dashboards and alerting that tell you what is wrong before users do