UTP ScholarsUnbiasing on the Fly: Explanation-Guided Human Oversight of Machine Learning DecisionsHussainiMammanauthorShuibBasriauthorAbdullateef OluwagbemigaBalogunauthorAbdullahi AbubakarImamauthorGaneshKumarauthorLuiz FernandoCapretzauthorThe widespread adoption of ML systems across critical domains like hiring, finance, and healthcare raises growing concerns about their potential for discriminatory decision-making based on protected attributes. While efforts to ensure fairness during development are crucial, they leave deployed ML systems vulnerable to potentially exhibit discrimination during their operations. To address this gap, we propose a novel framework for on-the-fly tracking and correction of discrimination in deployed ML systems. Leveraging counterfactual explanations, the framework continuously monitors the predictions made by an ML system and flags discriminatory outcomes. When flagged, post-hoc explanations related to the original prediction and the counterfactual alternatives are presented to a human reviewer for real-time intervention. This human-in-the-loop approach empowers reviewers to accept or override the ML system decision, enabling fair and responsible ML operation under dynamic settings. While further work is needed for validation and refinement, this framework offers a promising avenue for mitigating discrimination and building trust in ML systems deployed in a wide range of domains. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.2024Springer Science and Business Media Deutschland GmbHArticle

For work being deposited by its own author: In self-archiving this collection of files and associated bibliographic metadata, I grant UTP Scholars the right to store them and to make them permanently available publicly for free on-line. I declare that this material is my own intellectual property and I understand that UTP Scholars does not assume any responsibility if there is any breach of copyright in distributing these files or metadata. (All authors are urged to prominently assert their copyright on the title page of their work.)

For work being deposited by someone other than its author: I hereby declare that the collection of files and associated bibliographic metadata that I am archiving at UTP Scholars is in the public domain. If this is not the case, I accept full responsibility for any breach of copyright that distributing these files or metadata may entail.

Clicking on the Deposit Item Now button indicates your agreement to these terms.