Senior AI Quality Engineer Machine Learning

Lead AI quality initiatives within Sony Interactive Entertainment’s Information Security team, validating nondeterministic models and release readiness.

This senior quality engineering role supports ML-powered products and services through model monitoring, statistical evaluation, and automation. You will separate model variance from quality regressions while coordinating risks and dependencies. Collaboration spans ML, engineering, product, infrastructure, and embedded QE teams.

Key Responsibilities:

• Build automated validation for probabilistic ML and LLM outputs
• Assess ranking behavior, score distributions, and response quality
• Drive quality across complex cross-functional machine learning projects
• Perform performance and reliability testing for distributed systems
• Establish scalable quality standards, tooling, and guidelines

Requirements:

• Bachelor’s degree in Computer Science or equivalent
• Experience with AI evaluation, monitoring, or human review workflows
• Proficiency developing automation in Python, Java, or JavaScript
• Understanding of SDLC, Agile methodologies, and release processes
• Strong problem-solving, debugging, and communication skills

Lead dependable AI quality through statistical validation, risk management, and scalable automation at Sony Interactive Entertainment.