relation: https://khub.utp.edu.my/scholars/20557/
title: Unbiasing on the Fly: Explanation-Guided Human Oversight of Machine Learning Decisions
creator: Mamman, Hussaini
creator: Basri, Shuib
creator: Balogun, Abdullateef Oluwagbemiga
creator: Imam, Abdullahi Abubakar
creator: Kumar, Ganesh
creator: Capretz, Luiz Fernando
description: The widespread adoption of ML systems across critical domains like hiring, finance, and healthcare raises growing concerns about their potential for discriminatory decision-making based on protected attributes. While efforts to ensure fairness during development are crucial, they leave deployed ML systems vulnerable to potentially exhibit discrimination during their operations. To address this gap, we propose a novel framework for on-the-fly tracking and correction of discrimination in deployed ML systems. Leveraging counterfactual explanations, the framework continuously monitors the predictions made by an ML system and flags discriminatory outcomes. When flagged, post-hoc explanations related to the original prediction and the counterfactual alternatives are presented to a human reviewer for real-time intervention. This human-in-the-loop approach empowers reviewers to accept or override the ML system decision, enabling fair and responsible ML operation under dynamic settings. While further work is needed for validation and refinement, this framework offers a promising avenue for mitigating discrimination and building trust in ML systems deployed in a wide range of domains. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
publisher: Springer Science and Business Media Deutschland GmbH
date: 2024
type: Article
type: PeerReviewed
identifier:   Mamman, Hussaini and Basri, Shuib and Balogun, Abdullateef Oluwagbemiga and Imam, Abdullahi Abubakar and Kumar, Ganesh and Capretz, Luiz Fernando  (2024) Unbiasing on the Fly: Explanation-Guided Human Oversight of Machine Learning Decisions.  Lecture Notes in Networks and Systems, 1119 L.  300 - 311.  ISSN 23673370     
relation: https://www.scopus.com/pages/publications/85208026453?origin=resultslist
relation: 10.1007/978-3-031-70300-3₂₀
identifier: 10.1007/978-3-031-70300-3₂₀