Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose system to accelerate scientific discovery, integrating frontier AI models, biological foundation models, and lab capabilities, with the ultimate goal of curing disease. Our technology powers scientists around the world, translating AI capabilities into tools that accelerate research everywhere. ## What You'll Do
Develop and maintain the tooling and infrastructure that drives the entire data lifecycle at Biohub, from ingestion and processing to secure storage and access. Your work will directly support cutting-edge research, AI model training, and data analysis across the organization. - Partner with researchers and engineers across various domains, including genetics, imaging, and scientific literature. You'll work on various use cases, from web analytics to complex model training, ensuring data accessibility and performance for teams across CZI. - Design and implement flexible, scalable, and performant systems to address our stakeholders’ needs, leveraging technologies like Argo Workflows, Slurm, Ray, AWS Parallel Cluster for mass-scale job processing and orchestration; Vast Data, Delta Lake, Databricks and Apache Iceberg for data management and access; and cloud and on-prem HPC resources
What You'll Bring
Education & Experience: BS, MS, or PhD in Computer Science or a related technical discipline, or equivalent experience. 8+ years of hands-on coding experience in scripting (Python, PHP, Ruby) and systems languages (Rust, C++, C#, Go, Java, or Scala). - Data Platform Expertise: Proficiency in managing large-scale data operations, including designing scalable pipelines (streaming and batch), working with varied data types, and optimizing flexible storage solutions using tools like Argo Workflows, Databricks, Slurm, etc. - Data Management and Development Operations: Experience with data governance, metadata, and data lineage tooling like Open Lineage or Marquez. Deep experience working with building CI/CD pipelines for data infrastructure and associated observability and monitoring tooling such as Prometheus, Grafana, OpenTelemetry, Prometheus, or Honeycomb
Supporting Complex Data and AI ML Workflows: Experience with addressing end to end data needs for working with complex data and delivering this data ready form model training, working directly with AI Researchers and AI Engineers as part of AI model training project teams. Knowledge of data pipelines that feed Deep Learning model training that makes use of accelerated computing systems (GPUs as well as ASICs, FPGAs, TPUs)
Containerization: Extensive experience with scaling containerized applications on Kubernetes or Mesos, with a focus on secure custom containers, replicability and portability. - Cloud & Infrastructure: Strong experience with AWS, GCP, or Azure. Exposure to hybrid environments with on-prem and colocation systems is a plus. Familiarity with Infrastructure as Code (e.g., Terraform, Ansible) and monitoring tools (Datadog, Prometheus). - Collaboration & Problem Solving: Proven ability to work with diverse, cross-functional stakeholders and teams to navigate complex technical challenges, adapt to evolving requirements, and drive impactful solutions. ## Compensation
The Redwood City, CA base pay range for a new hire in this role is $214,000 - $295,000. New hires are typically hired into the lower portion of the range, enabling employee growth in the range over time. Actual placement in range is based on job-related skills and experience, as evaluated throughout the interview process. This position may be eligible to participate in our discretionary annual performance bonus program. Bonus eligibility and targets are determined in accordance with our total rewards philosophy and may vary by role. ## Benefits for the Whole You
We’re thankful to have an incredible team behind our work. To honor their commitment, we offer a wide range of benefits to support the people who make all we do possible. - Provides a generous employer match on employee 401(k) contributions to support planning for the future. - Paid time off to volunteer at an organization of your choice. - Funding for select family-forming benefits. - Relocation support for employees who need assistance moving
If you’re interested in a role but your previous experience doesn’t perfectly align with each qualification in the job description, we still encourage you to apply as you may be the perfect fit for this or another role. #LI-Hybrid
