Full-time jobs in Vaughan, Ontario

Find full-time jobs in Vaughan, Ontario and nearby towns within 25 km. Read the full details and apply.

Newest first

Within 25 km of Vaughan

Added 21 days ago
Sign Language Interpreter 2026/2027
York Region District School Board
Aurora, ON
Added 21 days ago
Senior Technician, Cross Border Individual Tax
MNP
Toronto, ON
Added 21 days ago
P
Financial Analyst
Paymentus
Richmond Hill, ON
- $60,000 to $70,000 CAD / year
Added 21 days ago
Strategist, Enterprise
BrainStation
Toronto, ON
Added 21 days ago
Senior Strategist, Enterprise
BrainStation
Toronto, ON
Added 21 days ago
Software Development Engineer in Test – GenAI / LLM
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Added 21 days ago
Dispatcher
TRILINK LOGISTICS INC.
Bolton, ON
Added 21 days ago
PQ
Director, Estate, Trust & Tax Strategy
Prime Quadrant
Toronto, ON
- $140,000 to $170,000 CAD / year
Added 21 days ago
Account Executive, Enterprise
BrainStation
Toronto, ON
Added 21 days ago
Senior Manager, Finance Business Partner
Deloitte
Toronto, ON
Added 21 days ago
Food Service Attendant (FT) - YTZ Airport
SSP America
Toronto, ON
Added 21 days ago
Server (Full-Time) - Obispo (YTZ)
SSP America
Toronto, ON
Added 21 days ago
Engineering Team Lead - Delo
Deloitte
Toronto, ON
Added 21 days ago
Senior Manager
Deloitte
Toronto, ON
Added 21 days ago
Butler - St. Regis
Marriott
Toronto, ON
Added 21 days ago
Director, Business Continuity Risk Management
The Canada Life Assurance Company
Toronto, ON
Added 21 days ago
Senior Business Analyst
CRC Group
Toronto, ON
Added 21 days ago
GWS Internal Wholesaler - Retail
Manulife
Toronto, ON
Added 21 days ago
Senior Solution Architect - Data & AI
Intact FC
Toronto, ON
Added 21 days ago
Intermediate Geotechnical Instrumentation Engineer
EXP
Brampton, ON
Added 21 days ago
Geotechnical Instrumentation & Monitoring Project Manager
EXP
Brampton, ON
Added 21 days ago
Production Operator
IKO North America
Brampton, ON
Added 21 days ago
Bilingual Renewal Coordinator
Siemens
Toronto, ON
Added 21 days ago
Contract Early Childhood Assistant or Registered Early Childhood Educator (Enhanced Program Support Worker)
BrightPath Early Learning & Child Care
Brampton, ON
Added 21 days ago
Manager, Data Modelling
Venterra Realty
Richmond Hill, ON

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Software Development Engineer in Test – GenAI / LLM

Toronto, ON, Canada

Full-time

Within 25 km of Vaughan · About 22.9 km from the city centre

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 14, 2026
Posted: Oct 15, 2026

Original job description

Software Development Engineer in Test – GenAI / LLM

Role Description

Work Arrangement: 1 day onsite per week

Experience Required: 6–8 years

Key Roles & Responsibilities

Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Create and execute test scenarios, test cases, and regression test suites.
Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Perform chatbot conversation analysis and recommend quality improvements.
Develop and maintain test automation for chatbot validation where possible.
Work closely with developers, AI engineers, and content teams to resolve defects.
Track, document, and report defects, test results, and quality metrics.
Support UAT, release validation, and production quality monitoring.

Key Skillsets

5 years of strong QA SDET test automation experience.
Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.
Knowledge of prompt engineering concepts.
Experience with Jira, Confluence, GitHub, and Agile delivery.
Experience with API testing and automation frameworks.
Strong analytical and troubleshooting skills.
Experience with Python, Selenium, Playwright, PyTest, or similar tools.
Strong communication and documentation skills.

Essential Skills

QA SDET and test automation.
AI, LLM, GenAI, chatbots, and conversational platforms.
Prompt engineering concepts.
API testing and automation frameworks.
Python, Selenium, Playwright, or PyTest.
Jira, Confluence, GitHub, and Agile delivery.
Analytical and troubleshooting skills.
Communication and documentation skills.

Desirable Skills

Digital: Python
Digital: Chatbots / Conversational Agents
Generative AI – Quality Engineering

Apply About employer

More about this job

Responsibilities

Validate chatbot responses for accuracy, relevance, completeness, and consistency; create and execute test scenarios, cases, and regression suites; and identify hallucinations, defects, formatting issues, and knowledge gaps. Develop chatbot test automation, collaborate with development, AI, and content teams to resolve issues, report quality metrics, and support UAT, release validation, and production monitoring.

Requirements

Requires 6–8 years of experience, including strong QA SDET and test automation experience, plus experience testing AI, LLM, GenAI, chatbot, or conversational platforms. Candidates should know prompt engineering, API testing, Python and relevant automation tools, Jira, Confluence, GitHub, and Agile delivery, and have strong analytical, troubleshooting, communication, and documentation skills.

Skills

Quality Assurance
Test Automation
Generative AI
Large Language Models
Chatbot Testing
Prompt Engineering
API Testing
Python
Selenium
Playwright
PyTest
Jira
Confluence
GitHub
Agile Delivery

Visa sponsorship

Not detected in the job text

Keywords

Quality Assurance
Test Automation
Generative AI
Large Language Models
Chatbots
Virtual Assistants
Conversational Platforms
Prompt Engineering
API Testing
Python
Selenium
Playwright
PyTest
Jira
Confluence
GitHub
Agile Delivery
Regression Testing
Test Scenarios
Test Cases
Chatbot Conversation Analysis
Hallucination Detection
User Acceptance Testing
Release Validation
Production Quality Monitoring
Defect Tracking
Quality Metrics

Report this job