IT & Software

Senior AI Chatbot Test Automation Engineer

Astra-North Infoteck Inc.

Toronto · Ontario · Canada

Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks. This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You will define test strategies, create evaluation datasets, and validate chatbot responses, APIs, microservices, and model interactions. The work covers functional, integration, system, regression, database, and acceptance testing. Key Responsibilities:

Design exploratory, automated, and AI-focused product quality tests Build scalable frameworks using Java, Python, or Groovy Validate chatbot accuracy, safety, latency, and hallucination risks Integrate testing and AI checks into CI/CD pipelines Communicate defects, risks, metrics, and release recommendations Requirements:

Five-plus years in quality engineering, automation, or development Five-plus years programming with Java, Python, Groovy, or comparable languages Five-plus years building and maintaining automation frameworks Experience testing AI applications, chatbots, LLMs, APIs, or conversational systems Hands-on Selenium, Playwright, RestAssured, or similar experience Apply senior automation expertise to AI chatbot validation, quality strategy, and reliable DevOps delivery across evolving products.

#J-18808-Ljbffr

Reference: WJ-3875_16351360 · Posted 17 Nov 2026, 01:05 AM

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Browse jobs