[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/118139.html
   My bibliography  Save this paper

When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities

Author

Listed:
  • Cantner, Uwe
  • Grashof, Nils
  • Grebel, Thomas
  • Zhang, Xijie
Abstract
Since the Bologna Process, universities have experienced a tremendous increase in competitive pressure. The Excellence Initiative is a path-breaking initiative to the historically-based egalitarian higher education system in Germany to boost universities' competitiveness and the competition among universities. Despite this systematic change, it remains rather unclear to what extent the Excellence Initiative influences the performance. In this paper, we investigate the effect of the Excellence Initiative on universities relative productivity in teaching and research and hence on the divergence or convergence of universities in these performance dimensions. Based on a unique dataset that combines publication and detailed university-level data, we apply a two-step approach by calculating relative productivity with a non-parametric procedure in the first step and using a difference-in-difference approach for estimating treatment effects of the Excellence Initiative in the second step. Overall, we note only a few moments when universities funded by the Excellence Initiative seem to excel and make progress compared to non-funded universities. In research, only some of the Excellence-funded universities, particularly the winners of the Graduate Schools and Clusters of Excellence funding line, manage to improve significantly, even if only for a few years. In teaching, we found no significant average treatment effect of the Excellence Initiative, but a slightly significant time-specific decline in relative teaching productivity two years after funding.

Suggested Citation

  • Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:118139
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/118139/1/When%20Excellence%20is%20not%20Excellent_The%20Impact%20of%20the%20Excellence%20Initiative%20on%20the%20Relative%20Productivity%20of%20German%20Universities.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    2. Cristian Barra & Roberto Zotti, 2016. "Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 22(1), pages 11-33, February.
    3. Gautier, Axel & Wauthy, Xavier, 2007. "Teaching versus research: A multi-tasking approach to multi-department universities," European Economic Review, Elsevier, vol. 51(2), pages 273-295, February.
    4. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    5. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    6. Cherchye, L. & Abeele, P. Vanden, 2005. "On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management," Research Policy, Elsevier, vol. 34(4), pages 495-516, May.
    7. De Fraja, Gianni & Iossa, Elisabetta, 2002. "Competition among Universities and the Emergence of the Elite Institution," Bulletin of Economic Research, Wiley Blackwell, vol. 54(3), pages 275-293, July.
    8. Rey, Elena Del, 2001. "Teaching versus Research: A Model of State University Competition," Journal of Urban Economics, Elsevier, vol. 49(2), pages 356-373, March.
    9. Mira Fischer & Patrick Kampkötter, 2017. "Effects of German Universities' Excellence Initiative on Ability Sorting of Students and Perceptions of Educational Quality," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 173(4), pages 662-687, December.
    10. Alberto Abadie & Guido W. Imbens, 2016. "Matching on the Estimated Propensity Score," Econometrica, Econometric Society, vol. 84, pages 781-807, March.
    11. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    12. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    13. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    14. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    15. Matthias Menter & Erik E. Lehmann & Torben Klarl, 2018. "In search of excellence: a case study of the first excellence initiative of Germany," Journal of Business Economics, Springer, vol. 88(9), pages 1105-1132, December.
    16. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    17. Katrin Obermeit, 2012. "Students' choice of universities in Germany: structure, factors and information sources used," Journal of Marketing for Higher Education, Taylor & Francis Journals, vol. 22(2), pages 206-230, December.
    18. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    19. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    20. Almus, Matthias & Czarnitzki, Dirk, 2003. "The Effects of Public R&D Subsidies on Firms' Innovation Activities: The Case of Eastern Germany," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(2), pages 226-236, April.
    21. John Robst, 2001. "Cost Efficiency in Public Higher Education Institutions," The Journal of Higher Education, Taylor & Francis Journals, vol. 72(6), pages 730-750, November.
    22. Maria Olivares & Heike Wetzel, 2014. "Editor's Choice Competing in the Higher Education Market: Empirical Evidence for Economies of Scale and Scope in German Higher Education Institutions," CESifo Economic Studies, CESifo Group, vol. 60(4), pages 653-680.
    23. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "The Economic Theory of Index Numbers and the Measurement of Input, Output, and Productivity," Econometrica, Econometric Society, vol. 50(6), pages 1393-1414, November.
    24. Gordon C. Winston, 1999. "Subsidies, Hierarchy and Peers: The Awkward Economics of Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 13(1), pages 13-36, Winter.
    25. Horstschräer, Julia, 2012. "University rankings in action? The importance of rankings and an excellence competition for university choice of high-ability students," Economics of Education Review, Elsevier, vol. 31(6), pages 1162-1176.
    26. Zhao, Zhong, 2008. "Sensitivity of propensity score methods to the specifications," Economics Letters, Elsevier, vol. 98(3), pages 309-319, March.
    27. Melanie Wiener & Daniela Maresch & Robert J. Breitenecker, 2020. "The shift towards entrepreneurial universities and the relevance of third-party funding of business and economics units in Austria: a research note," Review of Managerial Science, Springer, vol. 14(2), pages 345-363, April.
    28. Cantner, Uwe & Krüger, Jens & Hanusch, Horst, 2007. "Produktivitäts- und Effizienzanalyse : der nichtparametrische Ansatz," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 34367, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    29. Enrico Vanino & Stephen Roper & Bettina Becker, 2020. "Knowledge to Money: Assessing the Business Performance Effects of Publicly Funded R&D Grants," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 17(04), pages 20-24, January.
    30. Autio, Erkko & Rannikko, Heikki, 2016. "Retaining winners: Can policy boost high-growth entrepreneurship?," Research Policy, Elsevier, vol. 45(1), pages 42-55.
    31. Buenstorf, Guido & Koenig, Johannes, 2020. "Interrelated funding streams in a multi-funder university system: Evidence from the German Exzellenzinitiative," Research Policy, Elsevier, vol. 49(3).
    32. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    33. Gawellek, Bastian & Sunder, Marco, 2016. "The German excellence initiative and efficiency change among universities, 2001-2011," Working Papers 142, University of Leipzig, Faculty of Economics and Management Science.
    34. Frietsch, Rainer & Schubert, Torben & Rothengatter, Oliver, 2017. "An analysis of the Excellence Initiative and its effects on the funded universities," Studien zum deutschen Innovationssystem 11-2017, Expertenkommission Forschung und Innovation (EFI) - Commission of Experts for Research and Innovation, Berlin.
    35. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    36. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    37. Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
    38. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    39. Brantly Callaway, 2022. "Difference-in-Differences for Policy Evaluation," Papers 2203.15646, arXiv.org.
    40. Kaiser, Ulrich & Kuhn, Johan M., 2012. "Long-run effects of public–private research joint ventures: The case of the Danish Innovation Consortia support scheme," Research Policy, Elsevier, vol. 41(5), pages 913-927.
    41. Jason Gush & Adam Jaffe & Victoria Larsen & Athene Laws, 2018. "The effect of public funding on research output: the New Zealand Marsden Fund," New Zealand Economic Papers, Taylor & Francis Journals, vol. 52(2), pages 227-248, May.
    42. Andrea Bonaccorsi & Cinzia Daraio & Léopold Simar, 2006. "Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 389-410, February.
    43. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    44. Matheus Eduardo Leusin, 2022. "The Development of Al in Multinational Enterprises - Effects upon Technological Trajectories and Innovation Performance," Bremen Papers on Economics & Innovation 2201, University of Bremen, Faculty of Business Studies and Economics.
    45. Guerzoni, Marco & Raiteri, Emilio, 2015. "Demand-side vs. supply-side technology policies: Hidden treatment and new empirical evidence on the policy mix," Research Policy, Elsevier, vol. 44(3), pages 726-747.
    46. Gerhard Kempkes & Carsten Pohl, 2008. "Do Institutions Matter for University Cost Efficiency? Evidence from Germany," CESifo Economic Studies, CESifo Group, vol. 54(2), pages 177-203.
    47. Dennis Epple & Richard Romano & Holger Sieg, 2006. "Admission, Tuition, and Financial Aid Policies in the Market for Higher Education," Econometrica, Econometric Society, vol. 74(4), pages 885-928, July.
    48. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    49. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    50. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    51. Sabine Gralka, 2018. "Persistent inefficiency in the higher education sector: evidence from Germany," Education Economics, Taylor & Francis Journals, vol. 26(4), pages 373-392, July.
    52. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    53. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    54. Egon P. Franck & Bruno Schönfelder, 2000. "On The Role Of Competition In Higher Education – Uses And Abuses Of The Economic Metaphor," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 52(3), pages 214-237, July.
    55. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    56. Gerhard Kempkes, 2008. "Do Institutions Matter for University Cost Efficiency? Evidence from Germany," CESifo Economic Studies, CESifo Group, vol. 54(2), pages 177-203, June.
    57. Bolli, Thomas & Olivares, Maria & Bonaccorsi, Andrea & Daraio, Cinzia & Aracil, Adela Garcia & Lepori, Benedetto, 2016. "The differential effects of competitive funding on the production frontier and the efficiency of universities," Economics of Education Review, Elsevier, vol. 52(C), pages 91-104.
    58. Torger Möller & Marion Schmidt & Stefan Hornbostel, 2016. "Assessing the effects of the German Excellence Initiative with bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2217-2239, December.
    59. Franz Strehl & Sabine Reisinger & Michael Kalatschan, 2007. "Funding Systems and their Effects on Higher Education Systems," OECD Education Working Papers 6, OECD Publishing.
    60. Fandel, Gunter, 2007. "On the performance of universities in North Rhine-Westphalia, Germany: Government's redistribution of funds judged using DEA efficiency measures," European Journal of Operational Research, Elsevier, vol. 176(1), pages 521-533, January.
    61. Nicolas Carayol & Marianne Lanoë, 2018. "The Impact and Design of Project-Based Funding in Science : Lessons from the ANR Experience," Post-Print hal-02274256, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Uwe Cantner & Nils Grashof & Thomas Grebel & Anna Kosmützky & Georg Krücken & Xijie Zhang, 2023. "Competitive positioning of German Universities: Deliberate Decision, Fate, or Fiction?," Jena Economics Research Papers 2023-012, Friedrich-Schiller-University Jena.
    2. Massimiliano Coda-Zabetta & Francesco Lissoni & Ernest Miguelez, 2024. "Star recruitment and internationalization effects: an analysis of the Alexander von Humboldt professorship programme," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 51(3), pages 667-690, September.
    3. Massimiliano Coda-Zabetta & Francesco Lissoni & Ernest Miguelez, 2024. "Star recruitment and internationalization effects: an analysis of the alexander von humboldt professorship programme," Post-Print hal-04648037, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sabine Gralka & Klaus Wohlrabe & Lutz Bornmann, 2018. "How to Measure Research Efficiency in Higher Education? Research Grants vs. Publication Output," CESifo Working Paper Series 7055, CESifo.
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    4. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    5. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    6. Bolli, Thomas & Olivares, Maria & Bonaccorsi, Andrea & Daraio, Cinzia & Aracil, Adela Garcia & Lepori, Benedetto, 2016. "The differential effects of competitive funding on the production frontier and the efficiency of universities," Economics of Education Review, Elsevier, vol. 52(C), pages 91-104.
    7. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    8. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    9. Uwe Cantner & Nils Grashof & Thomas Grebel & Anna Kosmützky & Georg Krücken & Xijie Zhang, 2023. "Competitive positioning of German Universities: Deliberate Decision, Fate, or Fiction?," Jena Economics Research Papers 2023-012, Friedrich-Schiller-University Jena.
    10. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    11. Wohlrabe, Klaus & Bornmann, Lutz & de Moya Anegon, Felix, 2017. "Wie effizient sind Universitäten in Deutschland, deren Zukunftskonzepte im Rahmen der Exzellenzinitiative ausgezeichnet wurden? Ein empirischer Vergleich von Input- und Output-Daten zur Forschung [," MPRA Paper 76218, University Library of Munich, Germany.
    12. Tommaso Agasisti & Guo-liang Yang & Yao-yao Song & Carolyn-Thi Thanh Dung Tran, 2021. "Evaluating the higher education productivity of Chinese and European “elite” universities using a meta-frontier approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5819-5853, July.
    13. Klaus Wohlrabe & Sabine Gralka & Lutz Bornmann, 2019. "Zur Effizienz deutscher Universitäten und deren Entwicklung zwischen 2004 und 2015," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 72(21), pages 15-21, November.
    14. Isabelle Chort & Berk Öktem, 2024. "Agricultural shocks, coping policies and deforestation: Evidence from the coffee leaf rust epidemic in Mexico," American Journal of Agricultural Economics, John Wiley & Sons, vol. 106(3), pages 1020-1057, May.
    15. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    16. Mounu Prem & Juan Vargas & Miguel E. Purroy, 2021. "Landmines: The Local Effects of Demining," Empirical Studies of Conflict Project (ESOC) Working Papers 28, Empirical Studies of Conflict Project.
    17. Berardino Cesi & Dimitri Paolini, 2014. "Peer Group and Distance: When Widening University Participation is Better," Manchester School, University of Manchester, vol. 82, pages 110-132, December.
    18. Albanese, Andrea & Nieto, Adrián & Tatsiramos, Konstantinos, 2022. "Job Location Decisions and the Effect of Children on the Employment Gender Gap," GLO Discussion Paper Series 1113, Global Labor Organization (GLO).
    19. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    20. Krieger, Bastian, 2023. "Heterogeneous regional university funding and firm innovation: An empirical analysis of the German excellence initiative," ZEW Discussion Papers 23-006, ZEW - Leibniz Centre for European Economic Research.

    More about this item

    Keywords

    Excellence Initiative; Universities; Relative Productivity; DEA; Difference-in-difference; Funding;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:118139. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.