Lead Research Engineer

You will own the model architecture roadmap at Kog. You will work on the boundary between research judgment, training reality, and execution constraints. You will decide how the next model generation is structured, trained, evaluated, and refined. This is a hands-on leadership role. You will design architectures, write and review training code, shape experiments, make calls on model direction, and lead a team toward work that compounds. You will be expected to move with equal rigor between theory, implementation, and measured outcomes. What you will work on

• Architecture design for new model generations, including routing strategies, attention mechanisms, MoE structure, and architectural choices that improve capability while staying aligned with execution reality
• Research directions that extend the Laneformer thesis and deepen the overlap between model design and engine design
• Training pipeline ownership across convergence stability, distributed training efficiency, data pipeline design, post-training optimization, and evaluation methodology
• Close collaboration with the GPU and systems team so that hardware constraints shape model choices early, and model choices create real execution advantages
• Experiment strategy that favors fast, rigorous learning loops and turns architectural ideas into measurable decisions
• Technical direction for a small team working on the critical path of model capability and generation speed

Must-have

• You have trained large models or comparably demanding architectures from scratch and understand training dynamics at the level where you can diagnose issues from first principles
• You have made architectural decisions that produced measurable improvements and can explain why they worked
• You have strong fluency in Transformers, MoE, and at least one alternative architecture family with enough depth to reason across tradeoffs rather than within one paradigm
• You can write production-grade research code in PyTorch, JAX, or an equivalent stack and bridge research ideas with robust implementation
• You have operated with real ownership over difficult technical work and raised the standard of the people around you through research, judgment, code, and decision-making
• You are comfortable carrying both individual technical depth and team-level responsibility in the same role

Strong signal

• You have worked on architecture-hardware co-design, inference-aware training, or model decisions shaped directly by execution constraints
• You have experience with post-training optimization such as speculative decoding, quantization-aware training, preference optimization, or related methods that materially affect deployment behavior
• You have built systems where training, evaluation, and serving considerations had to be thought about together rather than in sequence
• You have a public trace of serious research work with implementation depth, such as papers, repositories, benchmark results, technical writing, or open-source contributions adopted by others

Top 0.1% for this role

The strongest candidates for this role have already developed original architectural judgment. They have designed model structures that improved performance because of a specific decision they made, and they can explain the mechanism clearly. They understand that model design is constrained by training dynamics, communication patterns, memory behavior, and the realities of the execution path. When they encounter an idea like Laneformer, they do not treat it as an isolated modeling trick. They immediately understand the downstream consequences for routing, layer structure, optimization, convergence, and generation speed. They know how to turn that understanding into a research program, a training plan, and a sequence of experiments that compounds. They bring both authorship and taste. They know when a result is fundamental, when it is local, and when a model change is worth the system cost it introduces. What we offer

• Direct access to AMD MI300X clusters from day one, with enough compute to validate serious work at real scale
• A team where technical judgment carries weight and where the people closest to the problem shape the key decisions
• Problems that sit on the critical path of model execution speed and that directly influence what the system can become
• A remote-first working model, with regular time overlap close to France time and monthly Paris weeks for engineering depth, alignment, and time together
• Compensation aligned with top technical profiles in the Paris AI market, including meaningful equity