[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/bla/jecsur/v35y2021i5p1428-1451.html
   My bibliography  Save this article

Bibliometric Techniques And Their Use In Business And Economics Research

Author

Listed:
  • Sandra Rousseau
  • Ronald Rousseau
Abstract
Bibliometric indicators and bibliometric techniques have been used in the domains of business and economics (BE) in the context of network studies and the evaluation of universities, journals and researchers, among other purposes. Using a strengths, weaknesses, opportunities and threats analysis as a general framework, we present an overview of the strengths, weaknesses, opportunities and threats related to the use of mainstream bibliometrics in BE. Several weaknesses in the use of bibliometric indicators for research evaluation in BE, and, in general, are discussed. Misuse of bibliometric indicators may lead to goal displacement and gender bias. Yet, being aware of possible problems leads to opportunities for further developments and applications of bibliometrics in the field of BE. We propose that traditional research evaluation should evolve into evaluative inquiry, a method where bibliometric indicators play a role, but in which all aspects of life and work of a scientific professional can be taken into account and assessment is relabelled in positive terms such as organizational and individual development, care and support.

Suggested Citation

  • Sandra Rousseau & Ronald Rousseau, 2021. "Bibliometric Techniques And Their Use In Business And Economics Research," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1428-1451, December.
    • Handle: RePEc:bla:jecsur:v:35:y:2021:i:5:p:1428-1451
    DOI: 10.1111/joes.12415
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/joes.12415
    Download Restriction: no
    File URL: https://libkey.io/10.1111/joes.12415?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2016. "A farewell to the MNCS and like size-independent indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 646-651.
    2. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    3. Ju-fang Shao & Hui-yun Shen, 2012. "Research assessment and monetary rewards: the overemphasized impact factor in China," Research Evaluation, Oxford University Press, vol. 21(3), pages 199-203, June.
    4. Inga Ivanova & Øivind Strand & Loet Leydesdorff, 2019. "What Is the Effect of Synergy Provided by International Collaborations on Regional Economies?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(1), pages 18-34, March.
    5. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    6. John Mingers & Evangelia A. E. C. G. Lipitakis, 2010. "Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 613-625, November.
    7. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    8. Diane Coyle, 2020. "Economists must collaborate courageously," Nature, Nature, vol. 582(7810), pages 9-9, June.
    9. Erik Ernø-Kjølhede & Finn Hansson, 2011. "Measuring research performance during a changing relationship between science and society," Research Evaluation, Oxford University Press, vol. 20(2), pages 131-143, June.
    10. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Trends in Economic Research: An International Perspective," Kyklos, Wiley Blackwell, vol. 63(4), pages 479-494, November.
    11. Ruth Müller & Sarah de Rijcke, 2017. "Exploring the epistemic impacts of academic performance indicators in the life sciences," Research Evaluation, Oxford University Press, vol. 26(3), pages 157-168.
    12. Nederhof, A. J. & van Raan, A. F. J., 1993. "A bibliometric analysis of six economics research groups: A comparison with peer review," Research Policy, Elsevier, vol. 22(4), pages 353-368, August.
    13. Bornmann, Lutz & Tekles, Alexander & Zhang, Helena H. & Ye, Fred Y., 2019. "Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime data," Journal of Informetrics, Elsevier, vol. 13(4).
    14. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    15. Marcella Corsi & Carlo D'Ippoliti & Federico Lucidi, 2011. "On the Evaluation of Economic Research: The Case of Italy," Economia politica, Società editrice il Mulino, issue 3, pages 369-402.
    16. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    17. José Luis Ortega, 2017. "Are peer-review activities related to reviewer bibliometric performance? A scientometric analysis of Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 947-962, August.
    18. Loet Leydesdorff & Henry Etzkowitz, 1996. "Emergence of a Triple Helix of university—industry—government relations," Science and Public Policy, Oxford University Press, vol. 23(5), pages 279-286, October.
    19. Eline Poelmans & Sandra Rousseau, 2015. "Factors determining authors’ willingness to wait for editorial decisions from economic history journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1347-1374, February.
    20. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2014. "How do you define and measure research productivity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1129-1144, November.
    21. Denis Bouyssou & Thierry Marchant, 2011. "Ranking scientists and departments in a consistent manner," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(9), pages 1761-1769, September.
    22. Sandra Rousseau & Ronald Rousseau, 2012. "Interactions between journal attributes and authors' willingness to wait for editorial decisions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(6), pages 1213-1225, June.
    23. Yves Fassin, 2018. "A new qualitative rating system for scientific publications and a fame index for academics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(11), pages 1396-1399, November.
    24. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    25. Qi Wang, 2018. "A bibliometric model for identifying emerging research topics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(2), pages 290-304, February.
    26. Otmane Azeroual & Joachim Schöpfel, 2019. "Quality Issues of CRIS Data: An Exploratory Investigation with Universities from Twelve Countries," Publications, MDPI, vol. 7(1), pages 1-18, February.
    27. Amanda Bayer & Cecilia Elena Rouse, 2016. "Diversity in the Economics Profession: A New Attack on an Old Problem," Journal of Economic Perspectives, American Economic Association, vol. 30(4), pages 221-242, Fall.
    28. Claudio A. Bonilla & José M. Merigó & Carolina Torres-Abad, 2015. "Economics in Latin America: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1239-1252, November.
    29. Brian M. Belcher & Katherine E. Rasmussen & Matthew R. Kemshaw & Deborah A. Zornes, 2016. "Defining and assessing research quality in a transdisciplinary context," Research Evaluation, Oxford University Press, vol. 25(1), pages 1-17.
    30. Bornmann, Lutz, 2014. "Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime," Journal of Informetrics, Elsevier, vol. 8(4), pages 935-950.
    31. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    32. Necker, Sarah, 2014. "Scientific misbehavior in economics," Research Policy, Elsevier, vol. 43(10), pages 1747-1759.
    33. John H. Huston & Roger W. Spencer, 2018. "Using Network Centrality to Inform Our View of Nobel Economists," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 44(4), pages 616-628, September.
    34. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    35. Bedoor K. AlShebli & Talal Rahwan & Wei Lee Woon, 2018. "The preeminence of ethnic diversity in scientific collaboration," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    36. Ruth Müller & Sarah de Rijcke, 2017. "Thinking with Indicators. Exploring the Epistemic Impacts of Academic Performance Indicators in the Life Sciences," Research Evaluation, Oxford University Press, vol. 26(4), pages 361-361.
    37. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    38. Wolfgang Glänzel & Balázs Schlemmer & Bart Thijs, 2003. "Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(3), pages 571-586, November.
    39. Groot, Tom & Garcia-Valderrama, Teresa, 2006. "Research quality and efficiency: An analysis of assessments and management issues in Dutch economics and business research programs," Research Policy, Elsevier, vol. 35(9), pages 1362-1376, November.
    40. Yue Wang & Xiaoxuan Li & Yonghe Zheng, 2011. "The interactive heuristic review mechanism: a new method of assessing pioneering research projects of the National Natural Science Foundation of China," Research Evaluation, Oxford University Press, vol. 20(4), pages 267-274, October.
    41. Nianhang Xu & Winnie P. H. Poon & Kam C. Chan, 2014. "Contributing Institutions and Authors in International Business Research: A Quality-Based Assessment," Management International Review, Springer, vol. 54(5), pages 735-755, October.
    42. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "Empirical analysis and classification of database errors in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 10(4), pages 933-953.
    43. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    44. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    45. Lin Zhang & Ronald Rousseau & Gunnar Sivertsen, 2017. "Science deserves to be judged by its contents, not by its wrapping: Revisiting Seglen's work on journal impact and research evaluation," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-18, March.
    46. Alberto Anfossi & Alberto Ciolfi & Filippo Costa & Giorgio Parisi & Sergio Benedetto, 2016. "Large-scale assessment of research outputs through a weighted combination of bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 671-683, May.
    47. Bei Wen & Edwin Horlings & Mariëlle van der Zouwen & Peter van den Besselaar, 2017. "Mapping science through bibliometric triangulation: An experimental approach applied to water research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 724-738, March.
    48. Mike Thelwall & Kayvan Kousha, 2017. "ResearchGate articles: Age, discipline, audience size, and impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(2), pages 468-479, February.
    49. Giovanni Abramo & Tindaro Cicero & Ciriaco Andrea D’Angelo, 2013. "National peer-review research assessment exercises for the hard sciences can be a complete waste of money: the Italian case," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 311-324, April.
    50. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Umar Farooq & Adeel Nasir & Kanwal Iqbal Khan, 2023. "An assessment of the quality of the search strategy: a case of bibliometric studies published in business and economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4855-4874, August.
    2. Shaen Corbet & Les Oxley, 2023. "Investigating the Academic Response to Cryptocurrencies: Insights from Research Diversification as Separated by Journal Ranking," Review of Corporate Finance, now publishers, vol. 3(4), pages 487-528, September.
    3. Matteo Migheli & Giovanni B. Ramello, 2021. "The unbearable lightness of scientometric indices," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 1933-1944, December.
    4. Ana Teresa Santos & Sandro Mendonça, 2022. "Do papers (really) match journals’ “aims and scope”? A computational assessment of innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7449-7470, December.
    5. Ana Teresa Santos & Sandro Mendonça, 2022. "The small world of innovation studies: an “editormetrics” perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7471-7486, December.
    6. Hong Liao & Xiang Li, 2023. "Status and Trends of Research on China’s Third Front Construction in English Language and Brief Comparison With Chinese Counterpart," SAGE Open, , vol. 13(1), pages 21582440231, February.
    7. Giovanni Abramo & Les Oxley, 2021. "Scientometric‐based analysis in business and economics: Introduction, examples, and guidelines," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1261-1270, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    2. Eugenio Petrovich, 2022. "Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2195-2233, May.
    3. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    4. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    5. Abramo, Giovanni, 2018. "Revisiting the scientometric conceptualization of impact and its measurement," Journal of Informetrics, Elsevier, vol. 12(3), pages 590-597.
    6. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    7. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    8. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    9. Loet Leydesdorff & Paul Wouters & Lutz Bornmann, 2016. "Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—a state-of-the-art report," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2129-2150, December.
    10. Elizabeth S. Vieira, 2023. "The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3555-3579, June.
    11. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    12. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    13. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2020. "Comparison of research performance of Italian and Norwegian professors and universities," Journal of Informetrics, Elsevier, vol. 14(2).
    14. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    15. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    16. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    17. Brito, Ricardo & Rodríguez-Navarro, Alonso, 2019. "Evaluating research and researchers by the journal impact factor: Is it better than coin flipping?," Journal of Informetrics, Elsevier, vol. 13(1), pages 314-324.
    18. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    19. Gerson Pech & Catarina Delgado, 2020. "Percentile and stochastic-based approach to the comparison of the number of citations of articles indexed in different bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 223-252, April.
    20. Gerson Pech & Catarina Delgado, 2020. "Assessing the publication impact using citation data from both Scopus and WoS databases: an approach validated in 15 research fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 909-924, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jecsur:v:35:y:2021:i:5:p:1428-1451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.