[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/bla/jecsur/v20y2006i1p111-156.html
   My bibliography  Save this article

Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand

Author

Listed:
  • Joseph Macri
  • Dipendra Sinha
Abstract
. The objectives of this paper are threefold. First, we critically survey and analyse the different methodologies that have been adopted in the rankings literature. Second, using journal articles included in the ECONLIT database and on the basis of two criteria – one based on citations and the other on perceptions of journal quality, we rank economics teaching departments in Australia and New Zealand for 1988–2002 and 1996–2002 and for individual academic economists for the periods 1988–2002, 1988–1995 and 1996–2002. Furthermore, we identify individual star performers and recognize them in a designated ‘Hall of Fame’ for 1988–2002. Third, our methodology enables us to make international comparisons on total and per capita bases. Previous multi‐country ranking studies in economics do not rank economics departments. They provide rankings based on total publications in economics in universities regardless of whether the economists are in the economics departments or in other departments. Thus, no rankings on per capita bases are provided. We correct this shortcoming by providing total and per capita rankings and analysing the correlations between total and per capita rankings. This is the first study to examine whether the size of the economics department matters with regard to productivity.

Suggested Citation

  • Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    • Handle: RePEc:bla:jecsur:v:20:y:2006:i:1:p:111-156
    DOI: 10.1111/j.0950-0804.2006.00277.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.0950-0804.2006.00277.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.0950-0804.2006.00277.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lovell, Michael C, 1973. "The Production of Economic Literature: An Interpretation," Journal of Economic Literature, American Economic Association, vol. 11(1), pages 27-55, March.
    2. Ian King, 2002. "Quality versus quantity: Ranking research records of economics departments in New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 36(1), pages 97-112.
    3. Davis, Paul & Papanek, Gustav F, 1984. "Faculty Ratings of Major Economics Departments by Citations," American Economic Review, American Economic Association, vol. 74(1), pages 225-230, March.
    4. Paul Dalziel & Ross Cullen & Caroline Saunders, 2002. "Ranking research records of economics departments in New Zealand: Comment," New Zealand Economic Papers, Taylor & Francis Journals, vol. 36(1), pages 113-122.
    5. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    6. R. F. Lucas, 1995. "Contributions to Economics Journals by the Canadian Economics Profession, 1981-90," Canadian Journal of Economics, Canadian Economics Association, vol. 28(4a), pages 945-960, November.
    7. Daniel B. Klein & Eric Chiang, 2004. "The Social Science Citation Index: A Black Box—with an Ideological Bias?," Econ Journal Watch, Econ Journal Watch, vol. 1(1), pages 134-165, April.
    8. Harris, G T, 1990. "Research Output in Australian University Economics Departments: An Update for 1984-88," Australian Economic Papers, Wiley Blackwell, vol. 29(55), pages 249-259, December.
    9. repec:bla:ecorec:v:71:y:1995:i:212:p:8-17 is not listed on IDEAS
    10. Burton, M P & Phimister, Euan, 1995. "Core Journals: A Reappraisal of the Diamond List," Economic Journal, Royal Economic Society, vol. 105(429), pages 361-373, March.
    11. Scott, Loren C & Mitias, Peter M, 1996. "Trends in Rankings of Economics Departments in the U.S.: An Update," Economic Inquiry, Western Economic Association International, vol. 34(2), pages 378-400, April.
    12. Graves, Philip E & Marchand, James R & Thompson, Randal, 1982. "Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency," American Economic Review, American Economic Association, vol. 72(5), pages 1131-1141, December.
    13. repec:bla:ecorec:v:75:y:1999:i:230:p:256-67 is not listed on IDEAS
    14. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    15. D J Smyth & A J Smyth, 2001. "The Research Output of United Kingdom Economics Departments: Some League Tables," Economic Issues Journal Articles, Economic Issues, vol. 6(2), pages 79-85, September.
    16. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    17. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    18. John Gibson, 2000. "Research productivity in New Zealand university economics departments: Comment and update," New Zealand Economic Papers, Taylor & Francis Journals, vol. 34(1), pages 73-87.
    19. J. Peter Neary & James A. Mirrlees & Jean Tirole, 2003. "Evaluating Economics Research in Europe: An Introduction," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1239-1249, December.
    20. Kevin J. Fox & Ross Milbourne, 1999. "What Determines Research Output of Academic Economists?," The Economic Record, The Economic Society of Australia, vol. 75(3), pages 256-267, September.
    21. repec:bla:ecorec:v:78:y:2002:i:241:p:136-46 is not listed on IDEAS
    22. Harris, Geoffrey Thomas, 1988. "Research Output in Australian University Economics Departments, 1974-83," Australian Economic Papers, Wiley Blackwell, vol. 27(50), pages 102-110, June.
    23. Baltagi, Badi H, 1999. "Applied Econometrics Rankings: 1989-1995," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 423-441, July-Aug..
    24. Michael McAleer, 2005. "The ten commandments for ranking university quality," Journal of Economic Surveys, Wiley Blackwell, vol. 19(4), pages 649-653, September.
    25. Jerry G. Thursby, 2000. "What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 383-404, June.
    26. Jin, Jang C & Yau, Louis, 1999. "Research Productivity of the Economics Profession in East Asia," Economic Inquiry, Western Economic Association International, vol. 37(4), pages 706-710, October.
    27. Baltagi, Badi H., 1998. "Worldwide Institutional Rankings In Econometrics: 1989–1995," Econometric Theory, Cambridge University Press, vol. 14(1), pages 1-43, February.
    28. Juan Dolado & Antonio García-Romero & Gema Zamarro, 2003. "Publishing performance in economics: Spanish rankings (1990-1999)," Spanish Economic Review, Springer;Spanish Economic Association, vol. 5(4), pages 317-317, November.
    29. Cribari-Neto, Francisco & Jensen, Mark J. & Novo, Álvaro A., 1999. "Research In Econometric Theory: Quantitative And Qualitative Productivity Rankings," Econometric Theory, Cambridge University Press, vol. 15(5), pages 719-752, October.
    30. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    31. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    32. Richard Pomfret & Liang Choon Wang, 2003. "Evaluating The Research Output Of Australian Universities' Economics Departments," Australian Economic Papers, Wiley Blackwell, vol. 42(4), pages 418-441, December.
    33. Hansen, W Lee & Weisbrod, Burton A & Strauss, Robert P, 1978. "Modeling the Earnings and Research Productivity of Academic Economists," Journal of Political Economy, University of Chicago Press, vol. 86(4), pages 729-741, August.
    34. John B. Davis, 1998. "Problems in Using the Social Sciences Citation Index to Rank Economics Journals," The American Economist, Sage Publications, vol. 42(2), pages 59-64, October.
    35. Baltagi, Badi H., 2003. "Worldwide Institutional And Individual Rankings In Econometrics Over The Period 1989–1999: An Update," Econometric Theory, Cambridge University Press, vol. 19(1), pages 165-224, February.
    36. Hall, A. D., 1987. "Worldwide Rankings of Research Activity in Econometrics: 1980–1985," Econometric Theory, Cambridge University Press, vol. 3(2), pages 171-194, April.
    37. Siegfried, John J, 1972. "The Publishing of Economic Papers and Its Impact on Graduate Faculty Ratings, 1960-1969," Journal of Economic Literature, American Economic Association, vol. 10(1), pages 31-49, March.
    38. Ian King, 2002. "Ranking research records of economics departments in New Zealand: Reply," New Zealand Economic Papers, Taylor & Francis Journals, vol. 36(1), pages 123-126.
    39. Hall, A. D., 1990. "Worldwide Rankings of Research Activity in Econometrics: An Update: 1980–1988," Econometric Theory, Cambridge University Press, vol. 6(1), pages 1-16, March.
    40. Malcolm Anderson & Richard Blandy, 1992. "What Australian Economics Professors Think," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 25(4), pages 17-40, October.
    41. Joseph Macri & Dipendra Sinha, 2004. "Rankings of Economists in Teaching Economics Departments in Australia, 1988-2000," Economics Bulletin, AccessEcon, vol. 1(4), pages 1-19.
    42. Tom Coupé & Patrick Paul Walsh, 2003. "Quality Based Rankings of Irish Economists 1990-2000," The Economic and Social Review, Economic and Social Studies, vol. 34(2), pages 145-149.
    43. Michael E. Conroy & Richard Dusansky, 1995. "The Productivity of Economics Departments in the U.S.: Publications in the Core Journals," Journal of Economic Literature, American Economic Association, vol. 33(4), pages 1966-1971, December.
    44. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    45. Alan Barrett & Brian Lucey, 2003. "An Analysis of the Journal Article Output of Irish-based Economists, 1970 to 2001," The Economic and Social Review, Economic and Social Studies, vol. 34(2), pages 109-143.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baltagi, Badi H., 2007. "Worldwide Econometrics Rankings: 1989–2005," Econometric Theory, Cambridge University Press, vol. 23(5), pages 952-1012, October.
    2. David Anderson & John Tressler, 2008. "Research output in New Zealand economics departments 2000-2006: A stock approach," New Zealand Economic Papers, Taylor & Francis Journals, vol. 42(2), pages 155-189.
    3. Martin Gregor, 2006. "Hodnocení ekonomických pracovišť a ekonomů: Koho, proč, čím a jak [A survey of rankings of economic departments: Global, american, european and national]," Politická ekonomie, Prague University of Economics and Business, vol. 2006(3), pages 394-414.
    4. Joseph Macri & Michael McAleer & Dipendra Sinha, 2009. "On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments," CIRJE F-Series CIRJE-F-660, CIRJE, Faculty of Economics, University of Tokyo.
    5. Konstantinos Chatzimichael & Pantelis Kalaitzidakis & Vangelis Tzouvelekas, 2017. "Measuring the publishing productivity of economics departments in Europe," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 889-908, November.
    6. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    7. Frank Neri & Joan R. Rodgers, 2006. "Ranking Australian Economics Departments by Research Productivity," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 74-84, September.
    8. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    9. Jang C. Jin, 2009. "Publications in mathematical economics and econometrics: ranking of Asian universities and an application of Zipf's law," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 23(2), pages 116-122, November.
    10. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    11. Vicente Royuela & Juan Carlos Duque & Raul Ramos, 2005. "Regional and Urban Research in Italy during the Nineties: Evidence from Publications in Nine Top International Journals," SCIENZE REGIONALI, FrancoAngeli Editore, vol. 2005(3).
    12. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    13. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    14. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    15. James B. Davies & Martin G. Kocher & Matthias Sutter, 2008. "Economics research in Canada: a long-run assessment of journal publications," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 22-45, February.
    16. Issler, João Victor & Ferreira, Rachel Couto, 2003. "Avaliando pesquisadores e departamentos de economia no Brasil a partir de citações internacionais," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 500, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    17. Tilak Mukhopadhyay & Subrata Sarar, 2010. "Rankings of Economics Journals and Departments in India," Indira Gandhi Institute of Development Research, Mumbai Working Papers 2010-021, Indira Gandhi Institute of Development Research, Mumbai, India.
    18. Richard Pomfret & Liang Choon Wang, 2003. "Evaluating The Research Output Of Australian Universities' Economics Departments," Australian Economic Papers, Wiley Blackwell, vol. 42(4), pages 418-441, December.
    19. Jin, Jang C. & Hong, Jin-Heon, 2008. "East Asian rankings of economics departments," Journal of Asian Economics, Elsevier, vol. 19(1), pages 74-82, February.
    20. repec:ebl:ecbull:v:1:y:2004:i:4:p:1-19 is not listed on IDEAS
    21. Paul Gopuran Devassy Bino & Sasidharan Subash & Ananthakrishnan Ramanathan, 2005. "Concentration in Knowledge Output: A case of Economics Journals," European Journal of Comparative Economics, Cattaneo University (LIUC), vol. 2(2), pages 261-279, December.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Rankings of Economists, Economics Departments and Economics Journals

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jecsur:v:20:y:2006:i:1:p:111-156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.