Mistral Ai · Posted 10d ago
Evaluation Engineer, Applied AI
Job relayed by Stapply Data, its source: you apply there.
- Location
- 🇫🇷 Paris, France
- Contract
- Full-time
- Role
- ML engineering
- Source
- Stapply Data
Stack
- LLM
- Python
The posting
Join Mistral, a leading provider of full-stack AI solutions. As an Evaluation Engineer on the Applied AI team, you will play a crucial role in shaping how enterprise customers measure and trust AI solutions. You will design and implement evaluation frameworks, build scalable infrastructure, and collaborate with customers to create custom evaluation suites. This position requires at least 3 years of experience in evaluating machine learning systems, strong Python coding skills, and a deep understanding of machine learning concepts. Mistral offers a comprehensive benefits package and a dynamic, collaborative work environment.
- Design and implement comprehensive frameworks to evaluate large language model (LLM) performance across customer use cases. - Build and maintain scalable evaluation infrastructure and pipelines for rapid, reproducible assessment. - Collaborate with customers to create custom evaluation suites that fit their unique needs and criteria.