Senior Cloudera Data Lake Platform Consultant
We are seeking an experienced Senior Cloudera Data Lake Platform Consultant to provide operational support, maintenance, and technical leadership for a large enterprise Cloudera environment while supporting a strategic migration to a modern Azure and Databricks platform.
This is a hands-on role responsible for ensuring the stability, security, performance, and availability of a business-critical data platform that supports analytics, reporting, data integration, and downstream business operations.
Key Responsibilities
- Provide day-to-day administration and operational support of the Cloudera Data Lake environment.
- Monitor platform health, performance, storage utilization, workloads, and capacity.
- Investigate and resolve production incidents, service disruptions, and performance issues.
- Perform root cause analysis and implement preventative measures.
- Support patching, upgrades, maintenance activities, and platform lifecycle management.
- Troubleshoot data pipelines, batch processing jobs, reporting workloads, and integrations.
- Administer security controls, user access, authentication, authorization, and auditing processes.
- Collaborate with infrastructure, application, security, and vendor teams to resolve complex technical issues.
- Support migration, cutover, validation, and stabilization activities as workloads transition to Azure and Databricks.
- Develop and maintain operational documentation, runbooks, architecture diagrams, and support procedures.
- Deliver ongoing knowledge transfer to internal teams throughout the engagement.
Required Experience
- 8+ years of experience in Data Platform Engineering, Infrastructure Support, Systems Administration, or a related technical field.
- 5+ years supporting enterprise Cloudera/Hadoop environments.
- Experience supporting large-scale, business-critical production data platforms.
- Strong background in incident management, troubleshooting, performance tuning, capacity planning, and platform operations.
- Experience supporting modernization, migration, or cloud transformation initiatives.
- Strong stakeholder communication and vendor management skills.
Technical Skills
Cloudera / Hadoop Ecosystem:
- Cloudera Manager, CDP/CDH
- HDFS, Hive, Impala, Spark
- Kudu, Oozie, Hue, YARN
- Ranger, Atlas, ZooKeeper
- Kafka and Sqoop
Platform & Infrastructure:
- Linux Administration
- Shell Scripting, Python, SQL
- Performance Tuning & Capacity Management
- High Availability & Disaster Recovery
- Security, Access Management & Compliance
Cloud & Modernization:
- Microsoft Azure
- Azure Data Lake Storage
- Azure Monitoring & Identity Services
- Databricks & Delta Lake
- Cloud Migration & Hybrid Data Platforms
Preferred Qualifications
- Cloudera, Azure, or Databricks certifications.
- Experience supporting legacy platform modernization and cloud migration programs.
- ITIL, Linux Administration, or Security certifications are considered assets.
Ideal Candidate
You are a hands-on Cloudera expert who thrives in complex enterprise environments, enjoys solving challenging operational issues, and can balance platform support responsibilities with modernization and migration initiatives. You'll play a key role in maintaining a stable environment while helping drive the organization's cloud transformation journey.