Senior Cloudera Data Lake Platform Consultant
Position Summary
The Senior Cloudera Data Lake Platform Consultant will provide ongoing operational support, maintenance, and technical leadership for Ontario's biggest lottery and gaming corporation legacy Cloudera Data Lake environment during the transition to the organization’s modern Microsoft Azure and Databricks-based analytics platform.
The consultant will be responsible for maintaining the stability, availability, security, and performance of the existing data lake ecosystem. This includes supporting business-critical analytics, reporting, batch processing, data integration, and downstream data-consumption workloads.
The consultant will act as a senior technical resource for day-to-day platform operations, incident management, troubleshooting, performance optimization, infrastructure maintenance, security remediation, and vendor coordination. The consultant will work closely with technical teams, business stakeholders, infrastructure teams, security teams, and external vendors to ensure the platform remains reliable and supportable throughout the modernization journey.
This role requires strong hands-on experience with Cloudera and the Hadoop ecosystem, including HDFS, Hive, Impala, Spark, Kudu, Oozie, Hue, Ranger, Atlas, and YARN.
Qualifications / Experience
The successful candidate should have:
- A minimum of 8 years of experience in data platform engineering, infrastructure support, systems administration, or a related technical field.
- A minimum of 5 years of hands-on experience supporting enterprise Cloudera or Hadoop environments.
- Demonstrated experience supporting complex, business-critical production data platforms.
- Strong experience with Cloudera Data Platform, Cloudera Distribution of Hadoop, or comparable enterprise Hadoop implementations.
- Experience providing operational support for high-volume analytics, reporting, data integration, and batch-processing workloads.
- Demonstrated experience managing production incidents, service interruptions, performance degradation, capacity constraints, and platform failures.
- Experience troubleshooting issues across infrastructure, operating systems, storage, networking, applications, and data-processing layers.
- Strong experience with cluster monitoring, health checks, performance tuning, capacity planning, patching, upgrades, and platform maintenance.
- Experience implementing and supporting security controls, access management, encryption, auditing, vulnerability remediation, and compliance requirements.
- Experience coordinating technical issues and escalations with software vendors and external service providers.
- Experience working with cloud modernization or data-platform migration initiatives, preferably involving Microsoft Azure and Databricks.
- Experience supporting legacy platforms during phased migration, decommissioning, or transition activities.
- Experience producing technical documentation, operational procedures, support playbooks, architecture diagrams, and knowledge-transfer materials.
- Strong analytical, troubleshooting, communication, and stakeholder-management skills.
- Ability to work independently, prioritize competing operational demands, and take ownership of complex technical issues from identification through resolution.
Pay Rate:$50-65 HR
Open: Due to addition support need
This Could Contain AI generative Support.