Glean · Posted 1d ago
AI Engineer (Quality and Post-Training)
Job relayed by Stapply Data, its source: you apply there.
- Location
- 🇺🇸 San Francisco, United States
- Contract
- Full-time
- Role
- ML engineering
- Source
- Stapply Data
Stack
- LLM
- Python
- TypeScript
The posting
Join Glean, a company at the forefront of building the next generation of enterprise AI assistants and autonomous agents. As an AI Engineer focused on quality and post-training, you will work at the intersection of applied research, quality, and product engineering to improve the performance of our AI systems. Your responsibilities will include enhancing the quality of our models and agent harnesses, implementing post-training models, and collaborating with product, platform, and research teams to drive quality improvements in production.
- Améliorer la qualité des modèles et des systèmes d'agent de Glean en utilisant des résultats d'évaluation et des traces de production. - Travailler sur des modèles post-formation avec un ajustement supervisé et une optimisation basée sur les préférences ou les récompenses. - Collaborer avec les équipes produit, plateforme et recherche pour mettre en œuvre des améliorations de qualité en production.
- 5+ years of industry experience in AI or Machine Learning Engineering - Hands-on experience post-training LLMs including adapting open-weight models to specialized tasks - Strong coding skills in Python and/or Go (TypeScript is a plus), proficiency in your ML framework of choice, and a track record of shipping production ML systems - Experience building evals for AI assistant and agent systems, including generating evalsets, LLM-as-a-judge verifiers, calibrating offline and online signals coupled with good judgment about when a metric reflects quality improvements - Product-minded, able to turn a vague problem into a concrete experiment, and thrive in a tight-knit, cross-functional team