Senior Software Engineer, ML Infrastructure

• Design and build distributed training platforms for LLM and multimodal fine-tuning and post-training at scale
• Integrate state-of-the-art training algorithms into production pipelines
• Own inference architecture and multi-provider routing, including failover and optimization
• Lead initiatives to improve latency and cost efficiency across the training and serving stack
• Build evaluation and experimentation infrastructure that enables rapid, reliable iteration
• Drive technical direction, mentor engineers, and establish best practices for ML infrastructure

Your background looks something like this

• 6+ years building ML infrastructure or production systems at scale
• Deep experience with distributed training: multi-node GPU clusters, fault tolerance, and optimization
• Strong understanding of LLM inference: latency optimization, provider tradeoffs, and serving architecture
• Proven track record leading complex, multi-quarter technical projects

Compensation

$200K – $400K + Offers Equity

This range reflects the expected compensation for this role. Compensation within the range is determined based on experience, skills, and the scope of responsibilities, with flexibility for candidates who demonstrate exceptional impact. In addition to base salary, we offer competitive equity. Final compensation may vary based on location within the United States. Benefits

We proudly offer the following benefits for our full-time employees:

• Take what you need vacation policy (subject to local requirements; UK employees receive 25 days of statutory leave)
• Medical, Dental, and Vision benefits for you and your family
• Life Insurance and Disability Benefits
• Retirement Plan (e.g., 401K, pension)
• Parental Leave
• Fertility and family building benefits through Carrot
• Daily lunches and snacks in the office to keep you at your best

These benefits are described in more detail in Decagon’s policies, may vary by location, and can change at any time according to applicable compensation and benefits plans.