Job Title: Data Analyst - Expert (Senior Data Engineer)
Location: Once every Thursday, and 2nd Friday in Downtown, Toronto
Line of Business: Global Asset Management Technology
Duration: 6-Month Contract (Potential for extension)
Compensation: T4: $65-$70/HR | IC: $75-$80/HR
About the Role
We are looking for an Expert Data Analyst / Senior Data Engineer to join our Global Asset Management Technology team. Our business is currently undergoing a major data transformation journey, actively exploring and expanding advanced functionalities within Databricks and modern cloud ecosystems. You will work closely with a Data Engineer Lead, Senior Data Engineers, and Business Analysts to build, secure, and optimize enterprise-scale data pipelines supporting institutional execution and quantitative analysis groups.
Key Responsibilities
- Design, build, and optimize end-to-end data pipelines loading large-scale datasets from various sources into Azure Databricks using Azure Data Factory (ADF) and Medallion architecture.
- Engineered silver-layer Delta tables and views, establishing proper table design, properties, schema, and security permissions.
- Migrate Databricks workspaces from Hive Metastore to Unity Catalog, setting up associated permissions and governance configurations.
- Ensure smooth deployment and DevOps pipelines using Azure DevOps or GitHub Enterprise for both ADF and Databricks artifacts.
- Implement Azure Entra ID for Single Sign-On (SSO) and Role-Based Access Control (RBAC).
- Deploy to and manage Azure PaaS resources (such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, and Synapse dedicated SQL databases) in a locked-down, highly regulated windows environment.
- Lead technical problem-solving sessions and guide a small team independently with minimal supervision.
Key Requirements & Qualifications
- Core Technical Stack: 7+ years of hands-on development experience with Azure Data Factory (ADF), Databricks, and Azure Functions (C#).
- Development & Coding: In-depth development experience using Python, notebooks, PySpark, and Pandas on Databricks.
- Governance & Architecture: Expert working knowledge of Unity Catalog and data governance setup, alongside Medallion architecture.
- Cloud & DevOps: In-depth experience with Azure Entra ID (SSO/RBAC), Azure PaaS resources, and CI/CD deployment pipelines (Azure DevOps/GitHub Enterprise).
- Environment: Proven ability to work independently in a locked-down, highly regulated financial services or enterprise environment.
- Nice-to-Haves: Experience with Delta Live Tables, previous Tier-1 financial institution/CIBC background, and strong communication skills.
