Machine Learning Evaluation Engineer

Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.

This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies, testing strategies, and metrics reflecting creator experiences. The work spans model development, infrastructure, integrated features, and customer-ready quality.

Key Responsibilities:

• Define evaluation strategies and metrics for models, LLMs, and AI features
• Create representative datasets and improve their quality iteratively
• Build scalable infrastructure with reproducible runs and tracked baselines
• Apply LLMs and agentic workflows to evaluation
• Report quality, risks, recommendations, and resolution progress clearly

Requirements:

• Five-plus years in machine learning or software engineering
• Experience evaluating ML models, LLMs, and AI products
• Understanding of data, training, deployment, and monitoring cycles
• Proficiency in Python, Swift, or comparable languages
• Bachelor’s degree or equivalent experience in a related field

Bring evaluation methodology, dataset quality, scalable infrastructure, and machine learning expertise to Apple’s creative applications.