Original job description
Required Skills & Experience
• Strong hands-on experience with AI modeling, model validation, and evaluation (including LLMs).
• Solid understanding of data modeling principles and their impact on AI model performance.
• Experience working in applied AI environments alongside engineering or data science teams.
• Understanding of model behavior, performance tuning, and common failure points.
• Experience designing or applying model testing, evaluation, or monitoring frameworks.
Strong technical mindset with the ability to work in evolving AI environments.
Nice to Have Skills & Experience
• Exposure to advanced model optimization or performance tuning techniques.
• Experience working on cross-functional or consulting-style projects.
Understanding of scalable AI systems and deployment considerations.
Job Description
We are seeking a hands-on AI Modeling & Validation Manager with a strong focus on data modeling and Artificial Intelligence (AI). This role supports the development, assessment, and optimization of AI solutions across the organization, with a primary emphasis on model performance, validation, and applied implementation.
This position is best suited for a technically strong individual with direct experience working with AI models, including large language models (LLMs), in real-world environments. The role focuses on ensuring models are accurate, scalable, and effective through practical evaluation, testing, and continuous improvement.
• Lead hands-on AI and data model assessments, validation, and performance evaluation (including LLMs).
• Analyze model behavior, outputs, and accuracy to ensure strong real-world performance.
• Design and implement testing, validation, and monitoring approaches across the model lifecycle.
• Support data modeling efforts to ensure high-quality inputs and optimized model performance.
• Partner closely with AI engineering and data teams to support end-to-end model development and deployment.
Contribute to improving model reliability, scalability, and efficiency through ongoing evaluation.
