[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/bpj/statpp/v15y2024i1p87-113n3.html
   My bibliography  Save this article

Typical Yet Unlikely and Normally Abnormal: The Intuition Behind High-Dimensional Statistics

Author

Listed:
  • Vowels Matthew J.

    (University of Lausanne, Lausanne, Switzerland)

Abstract
Normality, in the colloquial sense, has historically been considered an aspirational trait, synonymous with ideality. The arithmetic average and, by extension, statistics including linear regression coefficients, have often been used to characterize normality, and are often used as a way to summarize samples and identify outliers. We provide intuition behind the behavior of such statistics in high dimensions, and demonstrate that even for datasets with a relatively low number of dimensions, data start to exhibit a number of peculiarities which become severe as the number of dimensions increases. Whilst our main goal is to familiarize researchers with these peculiarities, we also show that normality can be better characterized with ‘typicality’, an information theoretic concept relating to entropy. An application of typicality to both synthetic and real-world data concerning political values reveals that in multi-dimensional space, to be ‘normal’ is actually to be atypical. We briefly explore the ramifications for outlier detection, demonstrating how typicality, in contrast with the popular Mahalanobis distance, represents a viable method for outlier detection.

Suggested Citation

  • Vowels Matthew J., 2024. "Typical Yet Unlikely and Normally Abnormal: The Intuition Behind High-Dimensional Statistics," Statistics, Politics and Policy, De Gruyter, vol. 15(1), pages 87-113, March.
    • Handle: RePEc:bpj:statpp:v:15:y:2024:i:1:p:87-113:n:3
    DOI: 10.1515/spp-2023-0028
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/spp-2023-0028
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.1515/spp-2023-0028?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Amy Orben & Andrew K. Przybylski, 2019. "The association between adolescent well-being and digital technology use," Nature Human Behaviour, Nature, vol. 3(2), pages 173-182, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Omar Hegazi & Samer Alalalmeh & Ahmad Alfaresi & Soheil Dashtinezhad & Ahmed Bahada & Moyad Shahwan & Ammar Abdulrahman Jairoun & Tesleem K. Babalola & Haya Yasin, 2022. "Development, Validation, and Utilization of a Social Media Use and Mental Health Questionnaire among Middle Eastern and Western Adults: A Pilot Study from the UAE," IJERPH, MDPI, vol. 19(23), pages 1-18, November.
    2. Gülsen Erden & Asil Ali Özdoğru & Sami Çoksan & Hale Ögel-Balaban & Yakup Azak & İlkiz Altınoğlu-Dikmeer & Aysun Ergül-Topçu & Yeşim Yasak & Gözde Kıral-Uçar & Seda Oktay & Pelin Karaca-Dinç & Ezgi Di, 2022. "Social Contact, Academic Satisfaction, COVID-19 Knowledge, and Subjective Well-being Among Students at Turkish Universities: a Nine-University Sample," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 17(4), pages 2017-2039, August.
    3. Amy Orben & Andrew K. Przybylski & Sarah-Jayne Blakemore & Rogier A. Kievit, 2022. "Windows of developmental sensitivity to social media," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Xiongkai Tan & Sha Zhang & Ruichen Ge & Hong Zhao, 2024. "Connectivity in crisis: the contrasting roles of mobile and non-mobile Internet on subjective well-being during the COVID-19 pandemic," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    5. Xiao, ZhiMin, 2017. "Of young people and Internet cafés," SocArXiv 2d8rz, Center for Open Science.
    6. Schneider, Sebastian O. & Sutter, Matthias, 2020. "Higher Order Risk Preferences: Experimental Measures, Determinants and Related Field Behavior," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224643, Verein für Socialpolitik / German Economic Association.
    7. Gunnhild Johnsen Hjetland & Viktor Schønning & Bodil Elisabeth Valstad Aasan & Randi Træland Hella & Jens Christoffer Skogen, 2021. "Pupils’ Use of Social Media and Its Relation to Mental Health from a School Personnel Perspective: A Preliminary Qualitative Study," IJERPH, MDPI, vol. 18(17), pages 1-15, August.
    8. Ahmad, Amal, 2022. "Imperfect information and learning: Evidence from cotton cultivation in Pakistan," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 176-204.
    9. Nate Breznau & Eike Mark Rinke & Alexander Wuttke & Hung H. V. Nguyen & Muna Adem & Jule Adriaans & Amalia Alvarez-Benjumea & Henrik K. Andersen & Daniel Auer & Flavio Azevedo & Oke Bahnsen & Dave Bal, 2022. "Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(44), pages 2203150119-, November.
    10. Herrero, Juan & Rodríguez, Francisco J. & Urueña, Alberto, 2023. "Use of smartphone apps for mobile communication and social digital pressure: A longitudinal panel study," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    11. Cecilia M. S. Ma, 2022. "Relationships between Social Networking Sites Use and Self-Esteem: The Moderating Role of Gender," IJERPH, MDPI, vol. 19(18), pages 1-11, September.
    12. Aaron Haddock & Nadia Ward & Rondy Yu & Nicole O’Dea, 2022. "Positive Effects of Digital Technology Use by Adolescents: A Scoping Review of the Literature," IJERPH, MDPI, vol. 19(21), pages 1-17, October.
    13. Lieberman, Alicea & Schroeder, Juliana & Amir, On, 2022. "A voice inside my head: The psychological and behavioral consequences of auditory technologies," Organizational Behavior and Human Decision Processes, Elsevier, vol. 170(C).
    14. Semken, Christoph & Rossell, David, 2020. "Bayesian Specification Curve Analysis," OSF Preprints cahyq, Center for Open Science.
    15. Sauerwein, Markus N. & Rees, Gwyther, 2020. "How children spend their out-of-school time – A comparative view across 14 countries," Children and Youth Services Review, Elsevier, vol. 112(C).
    16. Daniel Falla & Rosario Ortega-Ruiz & Eva M. Romera, 2021. "Mechanisms of Moral Disengagement in the Transition from Cybergossip to Cyberaggression: A Longitudinal Study," IJERPH, MDPI, vol. 18(3), pages 1-12, January.
    17. Aviana O. Rosen & Ashley L. Holmes & Nekane Balluerka & Maria Dolores Hidalgo & Arantxa Gorostiaga & Juana Gómez-Benito & Tania B. Huedo-Medina, 2022. "Is Social Media a New Type of Social Support? Social Media Use in Spain during the COVID-19 Pandemic: A Mixed Methods Study," IJERPH, MDPI, vol. 19(7), pages 1-20, March.
    18. Chantie Charissa Luijten & Daphne Bongardt & Anna Petra Nieboer, 2022. "The Roles of Social Media Use and Friendship Quality in Adolescents’ Internalizing Problems and Well-being," Journal of Happiness Studies, Springer, vol. 23(7), pages 3161-3178, October.
    19. Pedro Bação & Marta Simões, 0. "Is the Welfare State Relevant for Economic Growth? Evidence for Portugal," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 0, pages 1-27.
    20. Chavalarias David & Beatrice De Gelder & Guido Caldarelli & Melanie Dulong de Rosnay & Antonio A. Casilli & Alexandre Delanoë & Luisa Fassi & Divina Frau-Meigs & Bertrand Jouve & Andrzej Nowak & Vícto, 2023. "Toward a Research Agenda on Digital Media and Humanity Well-Being," SciencePo Working papers Main hal-04091733, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:statpp:v:15:y:2024:i:1:p:87-113:n:3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.