Towards responsible AI: a design space exploration of human-centered artificial intelligence user interfaces to investigate fairness

Nakao, Y., Strappelli, L., Stumpf, S. , Naseer, A., Regoli, D. and Del Gamba, G. (2022) Towards responsible AI: a design space exploration of human-centered artificial intelligence user interfaces to investigate fairness. International Journal of Human–Computer Interaction, 39(9), pp. 1762-1788. (doi: 10.1080/10447318.2022.2067936)

Abstract

With Artificial intelligence (AI) to aid or automate decision-making advancing rapidly, a particular concern is its fairness. In order to create reliable, safe and trustworthy systems through human-centred artificial intelligence (HCAI) design, recent efforts have produced user interfaces (UIs) for AI experts to investigate the fairness of AI models. In this work, we provide a design space exploration that supports not only data scientists but also domain experts to investigate AI fairness. Using loan applications as an example, we held a series of workshops with loan officers and data scientists to elicit their requirements. We instantiated these requirements into FairHIL, a UI to support human-in-the-loop fairness investigations, and describe how this UI could be generalized to other use cases. We evaluated FairHIL through a think-aloud user study. Our work contributes better designs to investigate an AI model’s fairness—and move closer towards responsible AI.

• Item Type: Articles
• Keywords: Human-centred AI, fairness, user interfaces, visualizations, human-in-the-loop, data scientists, domain experts.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Stumpf, Dr Simone
• Authors: Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., and Del Gamba, G.
• Subjects: Q Science > Q Science (General); T Technology > T Technology (General)
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: International Journal of Human–Computer Interaction
• Journal Abbr.: IJHCI
• Publisher: Taylor and Francis
• ISSN: 1044-7318
• ISSN (Online): 1532-7590
• Published Online: 04 May 2022
• Copyright Holders: Copyright © 2022 Taylor and Francis Group, LLC
• First Published: First published in International Journal of Human–Computer Interaction 39(9):1762-1788
• Publisher Policy: Reproduced in accordance with the publisher copyright policy