Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management

Big Data and Society 5 (1) (2018)
  Copy   BIBTEX

Abstract

Algorithms increasingly make managerial decisions that people used to make. Perceptions of algorithms, regardless of the algorithms' actual performance, can significantly influence their adoption, yet we do not fully understand how people perceive decisions made by algorithms as compared with decisions made by humans. To explore perceptions of algorithmic management, we conducted an online experiment using four managerial decisions that required either mechanical or human skills. We manipulated the decision-maker, and measured perceived fairness, trust, and emotional response. With the mechanical tasks, algorithmic and human-made decisions were perceived as equally fair and trustworthy and evoked similar emotions; however, human managers' fairness and trustworthiness were attributed to the manager's authority, whereas algorithms' fairness and trustworthiness were attributed to their perceived efficiency and objectivity. Human decisions evoked some positive emotion due to the possibility of social recognition, whereas algorithmic decisions generated a more mixed response – algorithms were seen as helpful tools but also possible tracking mechanisms. With the human tasks, algorithmic decisions were perceived as less fair and trustworthy and evoked more negative emotion than human decisions. Algorithms' perceived lack of intuition and subjective judgment capabilities contributed to the lower fairness and trustworthiness judgments. Positive emotion from human decisions was attributed to social recognition, while negative emotion from algorithmic decisions was attributed to the dehumanizing experience of being evaluated by machines. This work reveals people's lay concepts of algorithmic versus human decisions in a management context and suggests that task characteristics matter in understanding people's experiences with algorithmic technologies.

Other Versions

No versions found

Links

PhilArchive

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Algorithmic legitimacy in clinical decision-making.Sune Holm - 2023 - Ethics and Information Technology 25 (3):1-10.
Enabling Fairness in Healthcare Through Machine Learning.Geoff Keeling & Thomas Grote - 2022 - Ethics and Information Technology 24 (3):1-13.
Biased Humans, (Un)Biased Algorithms?Florian Pethig & Julia Kroenung - 2022 - Journal of Business Ethics 183 (3):637-652.
Democratizing Algorithmic Fairness.Pak-Hang Wong - 2020 - Philosophy and Technology 33 (2):225-244.

Analytics

Added to PP
2020-11-24

Downloads
191 (#211,447)

6 months
62 (#149,317)

Historical graph of downloads
How can I increase my downloads?

References found in this work

Using Language.Herbert H. Clark - 1996 - Cambridge University Press.
Implicit learning and tacit knowledge.Arthur S. Reber - 1989 - Journal of Experimental Psychology: General 118 (3):219-235.
Implicit learning and tacit knowledge.Arthur S. Reber - 1989 - Journal of Experimental Psychology 118:219-35.

View all 6 references / Add more references