About Atla
Atla is committed to building safe, beneficial AI systems that will have a massive positive impact on the future of humanity. We are a London-based start-up training frontier AI evaluation models. Become part of our growing world-class team. We are backed by Y Combinator, Creandum, and the founders of Reddit, Cruise, Rappi, Instacart and more.
Role
As Atla’s Head of Engineering, you will lead and scale our engineering team, driving the technical execution of language model training, evaluation, and deployment. As part of your role, you will:
- Design, implement, and manage robust APIs to facilitate access to fine-tuned language models, ensuring scalability and security for high-stakes applications.
- Lead and empower a world-class engineering team, setting a high bar of excellence that propels Atla forward.
- Design and optimise a scalable post-training framework to efficiently manage training runs while controlling costs.
- Engineer robust, high-performance inference platforms to ensure our models' reliability, throughput and speed at scale.
- Partner with the research team to accelerate the iteration of new research ideas and improve training workflows.
Please note that this role is in-person (we can sponsor visas and offer international relocation support!)
Qualifications
Proven engineering leadership ability:
- Track record of 5+ years in software or ML engineering, focusing on building robust, scalable systems.
- Demonstrated success leading teams, fostering collaboration and achieving significant milestones.
- Skilled in creating and managing multi-instance clusters for data and model parallel training on GPUs/TPUs, preferably using DeepSpeed or PyTorch FSDP.
- Experience with orchestration systems like SLURM or Ray, along with MLOps tools such as Kubernetes, Vertex, or Sagemaker.
- Proficient in serving large machine learning models at scale, including quantization, distributed computing, and using frameworks like vLLM or Ray Serve.
Nice to have
- Experience at a leading machine learning company (Mistral, Anthropic, X.ai, HuggingFace, Neuralink, OpenAI, etc.)
- Publications in top AI conferences.
- Interested in and thoughtful about of the impacts of AI technology.
About you
You are going to thrive at Atla with the following mindset:
- Collaborative and team-oriented, with strong communication skills.
- Comfortable with the uncertainty of a hyper-growth startup.
- Unpretentious and hard working; find the best ideas wherever they come from.
Compensation
- £150K - £300K
- Significant stake in equity as one of our core technical leaders
- Pension plan with employer contributions
- Medical, dental, and vision benefits
Join us in making a dent in the universe by engineering safe, beneficial AI systems!