Jobs in Vaughan

Newest first

Within 25 km of Vaughan

Added 3 hours ago
H
Director, Store Design & Pre Construction Project Management -Food Restaurants / Stores/ Retail Grocery - (Cantonese / Mandarin speaking- MUST)
Hays
Toronto, ON
- $155,000 to $185,000 CAD / year
Added 3 hours ago
Manuf. Support Technician
Husky Technologies
Bolton, ON
Added 3 hours ago
Credit Coordinator (6-12 months contract)
Roofmart
Brampton, ON
Added 3 hours ago
CI
Student Intern, Program Management
Celestica International LP
Newmarket, ON
- $23 to $30 CAD / hour
Added 3 hours ago
Part Time Sales Representative (Koodo) | Eaton Centre
TELUS
Toronto, ON
Added 3 hours ago
G
Key Account Manager-Ontario
Galderma
Toronto, ON
- $94,400 to $118,000 CAD / year
Added 3 hours ago
Senior Manager - Reefer Fleet Reliability & Technical Support
Charger Logistics Inc
Brampton, ON
Added 3 hours ago
Specialist Asset Performance
Enbridge
Toronto, ON
Added 3 hours ago
PCI Quality Assurance Analyst
GFL Environmental Inc.
Vaughan, ON
Added 3 hours ago
Engineer I-Software
Microchip Technology Inc.
Toronto, ON
Added 3 hours ago
SL - ECE243H1 S - Computer Organization
University of Toronto
Toronto, ON
Added 3 hours ago
UO
Lecturer / Assistant / Associate Professor Diagnostic Neuroradiology - St. Michael's Hospital
University of Toronto
Toronto, ON
- $200,000 CAD / year
Added 3 hours ago
UO
Assistant / Associate / Full Professor Breast Radiology - St. Michael's Hospital
University of Toronto
Toronto, ON
- $200,000 CAD / year
Added 3 hours ago
Veterinary Surgeon
NVA Canada
Toronto, ON
Added 3 hours ago
Big Data Engineer (PySpark / Spark / Kafka)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Added 3 hours ago
Supervisor Operations (Midnight Shift)
Metro Supply Chain
Brampton, ON
Added 3 hours ago
HIS Conversion and Go-Live Manager - Temporary Full-Time - Project REACH - 2026-17882 (2026-17882)
Sunnybrook
Toronto, ON
Added 3 hours ago
TY
Events Coordinator
The York School
Toronto, ON
- $60,000 to $68,000 CAD / year
Added 3 hours ago
Senior Oracle DBA
Flexstaf I.T. Inc.
Toronto, ON
Added 3 hours ago
Senior Database Administrator (Oracle Application DBA / Cloud)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Added 3 hours ago
dump truck driver
Empire Paving Ltd
Toronto, ON
Added 3 hours ago
Dean of Lifelong Learning
UNSW
Toronto, ON
Added 3 hours ago
BS
JR DESIGNER
BVGlazing Systems
Concord, ON
- $50,000 to $65,000 CAD / year
Added 3 hours ago
Deli Department Manager - Full Time
Longo's
Toronto, ON
Added 3 hours ago
administrative officer
Iqbal Foods
Toronto, ON

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Big Data Engineer (PySpark / Spark / Kafka)

Toronto, ON, Canada

Full-time

Within 25 km of Vaughan · About 22.9 km from the city centre

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Dec 2, 2026
Posted: Nov 2, 2026

Original job description

Job Description: Big Data Engineer (PySpark / Spark / Kafka)
Work Mode: Hybrid – 3 Days a Week in Office
Job Overview

We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.

Key Responsibilities

Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.
Build and maintain batch and real-time data processing solutions.
Develop and support Kafka-based streaming applications and event-driven architectures.
Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.
Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.
Implement data ingestion solutions from databases, APIs, files, and streaming sources.
Monitor, troubleshoot, and enhance the performance of Spark jobs and data pipelines.
Collaborate with architects, business analysts, and development teams to deliver high-quality data solutions.
Support platform upgrades, deployments, testing, certification, and production releases.
Ensure data quality, governance, security, and operational excellence across data platforms.

Mandatory Skills

PySpark
Apache Spark (Spark SQL, DataFrames)
Apache Kafka
Hadoop Ecosystem (HDFS, Hive, YARN)
Apache NiFi
SQL
Python

Preferred Skills

Spark Streaming
Airflow / Oozie
Hive
Scala
Jenkins, Bitbucket, Git
JIRA, Confluence
Cloud Platforms (GCP/AWS/Azure)
Data Warehousing Concepts and Dimensional Modeling

Apply About employer

More about this job

Responsibilities

Design, develop, and optimize scalable batch and real-time data pipelines and Kafka-based streaming applications using PySpark, Spark, Hadoop, and Apache NiFi. Build and maintain ETL/ELT workflows, troubleshoot and improve pipeline performance, and support data quality, governance, security, deployments, and production releases.

Requirements

The role requires hands-on expertise in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, Apache NiFi, SQL, and Python. It also calls for experience with large-scale data ingestion and transformation, batch and real-time processing, and collaboration on enterprise data platforms; preferred skills include streaming, workflow orchestration, cloud platforms, and data warehousing.

Skills

PySpark
Apache Spark
Spark SQL
DataFrames
Apache Kafka
Hadoop
HDFS
Hive
YARN
Apache NiFi
SQL
Python
Spark Streaming
Airflow
Oozie
Scala

Visa sponsorship

Not detected in the job text

Keywords

PySpark
Apache Spark
Spark SQL
DataFrames
Apache Kafka
Hadoop
HDFS
Hive
YARN
Apache NiFi
SQL
Python
Spark Streaming
Airflow
Oozie
Scala
Jenkins
Bitbucket
Git
JIRA
Confluence
GCP
AWS
Azure
ETL/ELT
Data Ingestion
Real-Time Processing
Data Warehousing
Dimensional Modeling
Data Governance

Report this job