Jobs in Vaughan

Newest first

Within 25 km of Vaughan

Added 4 days ago
Retail Store Associate Part Time Homesense- Trinity Commons
TJX Canada – Winners, Marshalls, HomeSense
Brampton, ON
Added 4 days ago
Administrative Coordinator - Assessment Department
McDowall Integrative Psychology & Healthcare
Toronto, ON
Added 4 days ago
Systems Testing/QA Specialist - Senior
isgSearch
Toronto, ON
Added 4 days ago
Future Opportunities: SR&ED Consultant
Ayming
Toronto, ON
Added 4 days ago
R&
Senior Tax Manager, Investment Funds
Robertson & Company Ltd.
Toronto, ON
- $115,000 to $160,000 CAD / year
Added 4 days ago
TC
SQL Developer
Tata Consultancy Services
Toronto, ON
- $90,000 to $120,000 CAD / year
Added 4 days ago
Senior kdb+ Developer
Data Intellect
Toronto, ON
Added 4 days ago
Soup, Sandwich, Chill and Grill Manager Full Time Day
Fortinos Supermarket Ltd
Brampton, ON
Added 4 days ago
Sales Administrator
Dilawri Group of Companies
Toronto, ON
Added 4 days ago
Pre-Sales Manager
MULTIVAC Canada
Brampton, ON
Added 4 days ago
Senior Manager Credit Risk Management
EQ Bank
Toronto, ON
Added 4 days ago
Hiring Now! Teach English Overseas with Full Training, Visa Sponsorship & Career Support
English 1
Richmond Hill, ON
Added 4 days ago
Coordinator, Communications and Public Affairs
Toronto Police Service
Toronto, ON
Added 4 days ago
Department Manager, Produce
Northern/NorthMart
Toronto, ON
Added 4 days ago
Department Manager, Grocery
Northern/NorthMart
Toronto, ON
Added 4 days ago
Python Developer
Apptoza Inc.
Toronto, ON
Added 4 days ago
FB
Assistant Meat Manager
Farm Boy Inc.
Richmond Hill, ON
- $21.5 CAD / hour
Added 4 days ago
Quality Engineer (QE) / SDET – AI Chatbot Validation
Realtek Consulting LLC
Toronto, ON
Added 4 days ago
Python /Pyspark Developer
Atlantis IT Group
Toronto, ON
Added 4 days ago
Operations Manager
Toronto Lawyers Association
Toronto, ON
Added 4 days ago
Future Opportunities: Business Development Manager
Ayming
Toronto, ON
Added 4 days ago
BB
Senior Lead, Strategic Advisory
Bond Brand Loyalty
Toronto, ON
- $106,000 to $137,000 CAD / year
Added 4 days ago
Engineer (Python/AWS + Azure/React) (Senior/NewGrad)
Caddie
Toronto, ON
Added 4 days ago
LL
Personal Injury Content Lead
LEAP Legal Software
Toronto, ON
- $130,000 to $140,000 CAD / year
Added 4 days ago
Store General Manager - 3 Month Contract
Sporting Life Group
Toronto, ON

Realtek Consulting LLC

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Contract

Within 25 km of Vaughan · About 22.9 km from the city centre

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Nov 22, 2026
Posted: Oct 23, 2026

Original job description

Job Title: Quality Engineer (QE) / SDET – AI Chatbot Validation

Locations: ~Brampton, Ontario~Scarborough, Ontario~Etobicoke, Ontario~Guleph, Ontario~Hamilton, Ontario~Kitchener, Ontario~Milton, Ontario~North York, Ontario~Ontario Nes,~Oshawa, Ontario~

Long Term Contract

Experience: 6–8 Years

Work Model: Hybrid – 1 day onsite per week

Job Description:

We are looking for an experienced Quality Engineer / SDET with strong test automation skills and hands-on experience validating AI-powered chatbots, LLMs, Generative AI applications, or conversational platforms. The ideal candidate will ensure the accuracy, relevance, consistency, and reliability of AI-generated responses while developing and maintaining automated testing solutions.

Key Responsibilities:

Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Design, develop, and execute test scenarios, test cases, and regression test suites.
Identify AI hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Analyze chatbot conversations and recommend quality improvements.
Develop and maintain automated test frameworks for chatbot validation.
Collaborate with developers, AI engineers, and content teams to investigate and resolve defects.
Track defects, document test results, and report quality metrics.
Support UAT, release validation, and production quality monitoring.

Required Skills:

5+ years of strong QA / SDET / test automation experience.
Experience testing AI, LLMs, Generative AI applications, chatbots, virtual assistants, or conversational platforms.
Understanding of prompt engineering and AI response validation.
Strong programming and automation skills using Python, Selenium, Playwright, PyTest, or similar tools.
Experience with API testing and automation frameworks.
Familiarity with Jira, Confluence, GitHub, and Agile delivery methodologies.
Strong analytical, troubleshooting, communication, and documentation skills.

Preferred Skills:

Experience with LLM evaluation, hallucination detection, and conversational AI quality metrics.
Experience building automated validation and regression testing frameworks for AI applications.
Knowledge of Generative AI quality engineering practices.

Apply About employer

More about this job

Responsibilities

Validate AI chatbot responses for accuracy, relevance, completeness, and consistency, and design and execute test scenarios and regression suites. Build and maintain automated validation frameworks, investigate defects with cross-functional teams, document results and quality metrics, and support UAT, releases, and production monitoring.

Requirements

Requires at least five years of QA, SDET, or test automation experience, including hands-on testing of AI, LLM, Generative AI, chatbot, or conversational applications. Candidates should have prompt engineering and AI response validation knowledge, strong programming and automation skills, API testing experience, familiarity with Jira, Confluence, GitHub, and Agile, and strong analytical and communication skills.

Skills

Quality Assurance
Software Development Test Engineering
Test Automation
AI Chatbot Validation
Large Language Models
Generative AI
Prompt Engineering
Python
Selenium
Playwright
PyTest
API Testing
Regression Testing
Hallucination Detection
Jira
Agile

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Software Development Test Engineering
Quality Assurance
Test Automation
AI Chatbots
Large Language Models
Generative AI
Conversational Platforms
Prompt Engineering
AI Response Validation
Hallucination Detection
Python
Selenium
Playwright
PyTest
API Testing
Automated Test Frameworks
Regression Testing
UAT
Production Quality Monitoring
Jira
Confluence
GitHub
Agile
Defect Tracking
AI Quality Metrics

Report this job