Software Engineer, Deployment

About Mistral

At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.

We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.

We are a dynamic, collaborative team passionate about AI and its potential to transform society.

Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.

Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact.

Role Summary

We are seeking experienced backend software engineers (Python, Docker, K8s) to join our Engineering team. You'll help deploy and integrate our models and APIs across multiple infrastructure configurations, from leading cloud service providers to on-premises solutions. You'll work closely with the research, product, solution architect and program management teams to serve our frontier models to customers wherever they use our technology. The role is based in Palo Alto and reports to the Head of Engineering.

What you will do

Key Responsibilities 

As Software Engineer in the Deployment team, you will be responsible for:

• New releases – you will ensure fast and reliable launch of new models and new features to customers

• Build and test infrastructure – you will work to improve and extend the infrastructure needed to package, deploy and integrate our core technology within first-party systems and third-party platforms

• Safety – you will help solve the unique challenges that come with maintaining AI safety on third-party platforms

• Observability and Monitoring – you will collaborate closely with both internal and external stakeholders to ensure our services achieve high availability and deliver state-of-the-art performance for our users

• Resource Optimization – you will help measure and optimize the allocation of the chips that serve our models to make the best use of costly resources.

About you

• 5+ years of relevant professional work experience

• Master’s degree in Computer Science, Information Technology or a related field

• Excellent proficiency in backend software development (Python)

• Strong proficiency in infrastructure management (Docker, CI/CD, K8s, Helm, Terraform...)

• Good knowledge of cloud ecosystems and understanding of the challenges of deploying LLM in multiple environments (public cloud, private cloud, on-premises)

• Autonomous and self-starter profile

• Ability to communicate with influence

What We Offer

• Competitive salary and bonus structure 

• Generous Equity

• Health : Competitive Healthcare program (Medical Provider: Blueshield of California 100% coverage for employee, 75% for dependents)

• Pension : 401K (6% matching)

• PTO : 18 days 

• Transportation: Reimburse office parking charges, or $120/month for public transport

• Coaching: we offer Betterup coaching on a voluntary basis

• Sport: $120/month reimbursement for gym membership

• Meal stipend: $400 monthly allowance for meals (solution might evolve as we grow bigger)

• Visa sponsorship