Senior Software Engineer - AI Interaction Evaluator

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer - AI Interaction Evaluator in United States.

This is a highly specialized evaluation role focused on assessing the quality, reasoning, and engineering judgment of modern AI coding agents. Rather than writing production software, you will analyze how advanced AI systems behave when solving real engineering problems and determine whether their outputs reflect strong developer intuition. The work sits at the intersection of software engineering expertise and AI evaluation, requiring sharp technical instincts and the ability to judge “engineering taste” beyond syntax correctness. You will help define what high-quality AI-assisted development looks like in practice by critically reviewing model interactions and identifying strengths, weaknesses, and failure patterns. Operating in a fast-moving, experimental environment, your feedback will directly influence how AI coding tools are refined and improved. This role is ideal for senior engineers who enjoy deep technical judgment work and shaping next-generation developer experiences.