AI Auditor Job Description and Duties

An AI Auditor assesses the design, development and operation of artificial intelligence systems to ensure they are safe, fair, reliable and compliant. Applicants should have a background in data science, audit, risk or compliance and be comfortable reviewing technical models and communicating findings to business stakeholders.

AI Auditor Job Profile

The AI Auditor is responsible for independent evaluation of AI systems across the model lifecycle. The role focuses on identifying model risk, data quality issues, compliance gaps and ethical concerns, and on recommending mitigations to reduce organisational exposure.

This position serves as a bridge between technical teams and governance functions, applying audit methodologies and risk assessment techniques to provide evidence based assurance on AI performance, robustness and alignment with policy.

AI Auditor Job Description

AI Auditors plan and conduct audits of machine learning models, data pipelines and related processes to assess controls, accuracy and unintended behaviour. The role requires designing audit scopes, executing tests against defined criteria, analysing results and documenting findings in clear, actionable reports for technical and non technical audiences.

Auditors work within a governance framework to prioritise high risk systems, support remediation and help implement ongoing monitoring. They collaborate with data scientists, engineers, product owners and compliance teams to drive improvements in model documentation, validation and deployment practices.

Expect to operate in a cross functional environment with changing priorities, to present findings to senior stakeholders and to contribute to the evolution of audit frameworks, checklists and risk metrics that underpin responsible AI use across the organisation.

AI Auditor: Duties and Responsibilities

• Plan and execute independent audits of AI and machine learning systems across development and production stages
• Evaluate model design, training processes, validation approaches and performance metrics
• Assess data quality, provenance, labelling practices and preprocessing pipelines
• Test for bias, fairness, robustness, performance drift and other unintended behaviours
• Review model documentation, version control, change logs and model cards for completeness
• Verify compliance with applicable data protection laws, sector regulations and internal policies
• Identify vulnerabilities, failure modes and potential harms, and assess their business impact
• Prepare clear audit reports with findings, risk ratings and recommended remediation actions
• Work with data science and engineering teams to validate corrective measures and re testing
• Define and maintain AI audit frameworks, checklists, control matrices and testing protocols
• Develop and support monitoring plans for post deployment model performance and alerts
• Contribute to risk registers, governance forums and audit tracking processes
• Provide training, briefings and guidance on audit findings and best practice for responsible AI
• Support procurement and third party assessments for externally supplied AI solutions

AI Auditor: Requirements and Qualifications

• Bachelor's degree in computer science, statistics, data science, engineering or a related discipline
• Professional qualification in audit, risk management or data protection preferred
• At least three years of relevant experience in audit, data science, AI governance or risk assessment
• Strong understanding of machine learning fundamentals, statistical methods and model evaluation
• Knowledge of data governance, data lineage and data quality principles
• Familiarity with regulatory and ethical issues relevant to AI and personal data
• Experience in risk assessment, control testing and producing audit reports
• Proven analytical, problem solving and critical thinking skills
• Excellent written and verbal communication and stakeholder engagement abilities
• Ability to translate technical issues into business impact and remediation steps
• High attention to detail and strong commitment to ethical AI practice
• Ability to work independently and collaboratively in cross functional teams