AI Engineer, Evaluation

This position is posted by Jobgether on behalf of a partner company. We are currently looking for an AI Engineer, Evaluation in India.

This role sits at the core of AI model quality and reliability, focusing on building the systems that evaluate and validate machine learning performance at scale. You will design and implement robust evaluation frameworks that ensure AI models meet strict accuracy, safety, and consistency standards across production environments. Working closely with ML engineers and data teams, you will define benchmarks, automate testing pipelines, and develop dashboards that provide clear visibility into model behavior. Your work will directly influence how AI systems are trusted, deployed, and improved across enterprise use cases. This is a highly analytical and engineering-driven environment where precision, experimentation, and iteration are essential. The role offers strong exposure to large-scale AI systems and real-world model evaluation challenges.