AI QA & Evaluation Lead

About the role

Jodayn is looking for an AI QA & Evaluation Lead to design, implement and oversee enterprise‑grade quality assurance and validation processes for AI‑powered systems and intelligent automation platforms. The role ensures that AI‑generated outputs are reliable, consistent, secure, explainable and aligned with governance standards for government and enterprise clients.

Key responsibilities

• Design and maintain AI testing and evaluation frameworks, including benchmarking datasets and output validation methods.
• Implement automated regression testing for AI workflows and monitor prompt performance for behavioural consistency.
• Detect model drift, output degradation and validate multilingual AI outputs (Arabic and English).
• Ensure AI outputs comply with enterprise governance, auditability and traceability requirements.
• Conduct AI security and prompt‑injection testing, validating protections against unsafe outputs.
• Produce QA reports, evaluation summaries and recommend improvements to prompts, workflows and models.

Required profile

• Bachelor’s degree in Computer Science, Information Systems, Software Engineering or related field.
• Minimum 5 years of experience in enterprise quality assurance or software testing.
• Strong background in automation testing frameworks and experience with AI‑powered system evaluation.
• Experience in regulated or enterprise environments is preferred.

Required skills

• Quality Assurance
• Enterprise QA methodologies
• Automation testing frameworks
• API testing
• Regression testing methodologies
• Test case development
• AI evaluation of large language models
• Prompt engineering concepts
• AI benchmarking methodologies
• AI governance and validation concepts
• Security & Governance risk assessment
• AI security testing
• Auditability and traceability principles