[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/zbw/safewp/370.html
   My bibliography  Save this paper

The effects of discontinuing machine learning decision support

Author

Listed:
  • Bauer, Kevin
  • Nofer, Michael
  • Abdel-Karim, Benjamin M.
  • Hinz, Oliver
Abstract
Advances in Machine Learning (ML) led organizations to increasingly implement predictive decision aids intended to improve employees' decision-making performance. While such systems improve organizational efficiency in many contexts, they might be a double-edged sword when there is the danger of a system discontinuance. Following cognitive theories, the provision of ML-based predictions can adversely affect the development of decision-making skills that come to light when people lose access to the system. The purpose of this study is to put this assertion to the test. Using a novel experiment specifically tailored to deal with organizational obstacles and endogeneity concerns, we show that the initial provision of ML decision aids can latently prevent the development of decision-making skills which later becomes apparent when the system gets discontinued. We also find that the degree to which individuals "blindly" trust observed predictions determines the ultimate performance drop in the post-discontinuance phase. Our results suggest that making it clear to people that ML decision aids are imperfect can have its benefits especially if there is a reasonable danger of (temporary) system discontinuances.

Suggested Citation

  • Bauer, Kevin & Nofer, Michael & Abdel-Karim, Benjamin M. & Hinz, Oliver, 2022. "The effects of discontinuing machine learning decision support," SAFE Working Paper Series 370, Leibniz Institute for Financial Research SAFE.
    • Handle: RePEc:zbw:safewp:370
    DOI: 10.2139/ssrn.4299664
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/266691/1/1827023821.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.2139/ssrn.4299664?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Paul Beaudry & David A. Green & Benjamin M. Sand, 2016. "The Great Reversal in the Demand for Skill and Cognitive Tasks," Journal of Labor Economics, University of Chicago Press, vol. 34(S1), pages 199-247.
    3. Victoria A. Shaffer & C. Adam Probst & Edgar C. Merkle & Hal R. Arkes & Mitchell A. Medow, 2013. "Why Do Patients Derogate Physicians Who Use a Computer-Based Diagnostic Support System?," Medical Decision Making, , vol. 33(1), pages 108-118, January.
    4. repec:ner:ucllon:http://discovery.ucl.ac.uk/17678/ is not listed on IDEAS
    5. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    6. Downey, Mitch, 2021. "Partial automation and the technology-enabled deskilling of routine jobs," Labour Economics, Elsevier, vol. 69(C).
    7. Agrawal, Ajay & Gans, Joshua S. & Goldfarb, Avi, 2019. "Exploring the impact of artificial Intelligence: Prediction versus judgment," Information Economics and Policy, Elsevier, vol. 47(C), pages 1-6.
    8. Kuhnen, Camelia M. & Miu, Andrei C., 2017. "Socioeconomic status and learning from financial information," Journal of Financial Economics, Elsevier, vol. 124(2), pages 349-372.
    9. Aghion, Philippe & Tirole, Jean, 1997. "Formal and Real Authority in Organizations," Journal of Political Economy, University of Chicago Press, vol. 105(1), pages 1-29, February.
    10. Rudy Hirschheim & Mike Newman, 1991. "Symbolism and Information Systems Development: Myth, Metaphor and Magic," Information Systems Research, INFORMS, vol. 2(1), pages 29-62, March.
    11. Button, Scott B. & Mathieu, John E. & Zajac, Dennis M., 1996. "Goal Orientation in Organizational Research: A Conceptual and Empirical Foundation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(1), pages 26-48, July.
    12. Camelia M. Kuhnen, 2015. "Asymmetric Learning from Financial Information," Journal of Finance, American Finance Association, vol. 70(5), pages 2029-2062, October.
    13. Ikujiro Nonaka, 1994. "A Dynamic Theory of Organizational Knowledge Creation," Organization Science, INFORMS, vol. 5(1), pages 14-37, February.
    14. Martin Leo & Suneel Sharma & K. Maddulety, 2019. "Machine Learning in Banking Risk Management: A Literature Review," Risks, MDPI, vol. 7(1), pages 1-22, March.
    15. Garbarino, Ellen C & Edell, Julie A, 1997. "Cognitive Effort, Affect, and Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(2), pages 147-158, September.
    16. Jan De Spiegeleer & Dilip B. Madan & Sofie Reyners & Wim Schoutens, 2018. "Machine learning for quantitative finance: fast derivative pricing, hedging and fitting," Quantitative Finance, Taylor & Francis Journals, vol. 18(10), pages 1635-1643, October.
    17. Agrawal, Ajay & Gans, Joshua & Goldfarb, Avi (ed.), 2019. "The Economics of Artificial Intelligence," National Bureau of Economic Research Books, University of Chicago Press, number 9780226613338, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bauer, Kevin & Pfeuffer, Nicolas & Abdel-Karim, Benjamin M. & Hinz, Oliver & Kosfeld, Michael, 2020. "The terminator of social welfare? The economic consequences of algorithmic discrimination," SAFE Working Paper Series 287, Leibniz Institute for Financial Research SAFE.
    2. Bauer, Kevin & von Zahn, Moritz & Hinz, Oliver, 2022. "Expl(AI)ned: The impact of explainable Artificial Intelligence on cognitive processes," SAFE Working Paper Series 315, Leibniz Institute for Financial Research SAFE, revised 2022.
    3. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    4. Susan C. Athey & Kevin A. Bryan & Joshua S. Gans, 2020. "The Allocation of Decision Authority to Human and Artificial Intelligence," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 80-84, May.
    5. Bauer, Kevin & Gill, Andrej, 2021. "Mirror, mirror on the wall: Machine predictions and self-fulfilling prophecies," SAFE Working Paper Series 313, Leibniz Institute for Financial Research SAFE.
    6. Bauer, Kevin & von Zahn, Moritz & Hinz, Oliver, 2023. "Please take over: XAI, delegation of authority, and domain knowledge," SAFE Working Paper Series 394, Leibniz Institute for Financial Research SAFE.
    7. Vincent, Vinod U., 2021. "Integrating intuition and artificial intelligence in organizational decision-making," Business Horizons, Elsevier, vol. 64(4), pages 425-438.
    8. Yildiz, H. Emre & Murtic, Adis & Zander, Udo, 2024. "Re-conceptualizing absorptive capacity: The importance of teams as a meso-level context," Technological Forecasting and Social Change, Elsevier, vol. 199(C).
    9. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    10. De Bruyn, Arnaud & Viswanathan, Vijay & Beh, Yean Shan & Brock, Jürgen Kai-Uwe & von Wangenheim, Florian, 2020. "Artificial Intelligence and Marketing: Pitfalls and Opportunities," Journal of Interactive Marketing, Elsevier, vol. 51(C), pages 91-105.
    11. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    12. Selale Tuzel & Miao Ben Zhang, 2021. "Economic Stimulus at the Expense of Routine‐Task Jobs," Journal of Finance, American Finance Association, vol. 76(6), pages 3347-3399, December.
    13. Yuki, Kazuhiro, 2012. "Mechanization, task assignment, and inequality," MPRA Paper 37754, University Library of Munich, Germany.
    14. Anders Frederiksen & Lisa B. Kahn & Fabian Lange, 2020. "Supervisors and Performance Management Systems," Journal of Political Economy, University of Chicago Press, vol. 128(6), pages 2123-2187.
    15. Ozgun, Burcu & Broekel, Tom, 2021. "The geography of innovation and technology news - An empirical study of the German news media," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    16. Brice Corgnet, 2023. "An Experimental Test of Algorithmic Dismissals," Working Papers 2302, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    17. Gregory Weitzner, 2024. "Reputational Algorithm Aversion," Papers 2402.15418, arXiv.org, revised Jul 2024.
    18. Zou, Jing & Deng, Xiaojun, 2022. "To inhibit or to promote: How does the digital economy affect urban migrant integration in China?," Technological Forecasting and Social Change, Elsevier, vol. 179(C).
    19. Anna Trunk & Hendrik Birkel & Evi Hartmann, 2020. "On the current state of combining human and artificial intelligence for strategic organizational decision making," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 875-919, November.
    20. Keding, Christoph & Meissner, Philip, 2021. "Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions," Technological Forecasting and Social Change, Elsevier, vol. 171(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:safewp:370. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/csafede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.