[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/369.html
   My bibliography  Save this paper

Stress-testing macro stress testing: does it live up to expectations?

Author

Listed:
  • Claudio Borio
  • Mathias Drehmann
  • Kostas Tsatsaronis
Abstract
We critically review the state of the art in macro stress testing, assessing its strengths and weaknesses. We argue that, given current technology, macro stress tests are ill-suited as early warning devices, ie as tools for identifying vulnerabilities during seemingly tranquil times and for triggering remedial action. By contrast, as long as properly designed, stress tests can be quite effective as crisis management and resolution tools. We also see additional side benefits, stemming largely from the way such tests can discipline thinking about financial stability. We suggest possible ways to improve their performance.

Suggested Citation

  • Claudio Borio & Mathias Drehmann & Kostas Tsatsaronis, 2012. "Stress-testing macro stress testing: does it live up to expectations?," BIS Working Papers 369, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:369
    as

    Download full text from publisher

    File URL: http://www.bis.org/publ/work369.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: http://www.bis.org/publ/work369.htm
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Aikman & Piergiorgio Alessandri & Bruno Eklund & Prasanna Gai & Sujit Kapadia & Elizabeth Martin & Nada Mora & Gabriel Sterne & Matthew Willison, 2011. "Funding Liquidity Risk in a Quantitative Model of Systemic Stability," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 12, pages 371-410, Central Bank of Chile.
    2. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    3. Beverly Hirtle & Til Schuermann & Kevin J. Stiroh, 2009. "Macroprudential supervision of financial institutions: lessons from the SCAP," Staff Reports 409, Federal Reserve Bank of New York.
    4. Drehmann, Mathias & Juselius, Mikael, 2014. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," International Journal of Forecasting, Elsevier, vol. 30(3), pages 759-780.
    5. Carmen M. Reinhart & Kenneth S. Rogoff, 2014. "This Time is Different: A Panoramic View of Eight Centuries of Financial Crises," Annals of Economics and Finance, Society for AEF, vol. 15(2), pages 215-268, November.
    6. Céline Gauthier & Moez Souissi, 2012. "Understanding Systemic Risk in the Banking Sector: A MacroFinancial Risk Assessment Framework," Bank of Canada Review, Bank of Canada, vol. 2012(Spring), pages 29-38.
    7. Darrell Duffie, 2013. "Systemic Risk Exposures: A 10-by-10-by-10 Approach," NBER Chapters, in: Risk Topography: Systemic Risk and Macro Modeling, pages 47-56, National Bureau of Economic Research, Inc.
    8. Daníelsson, Jón, 2008. "Blame the models," Journal of Financial Stability, Elsevier, vol. 4(4), pages 321-328, December.
    9. Carmen M. Reinhart & Kenneth S. Rogoff, 2009. "Varieties of Crises and Their Dates," Introductory Chapters, in: This Time Is Different: Eight Centuries of Financial Folly, Princeton University Press.
    10. Bank for International Settlements, 2005. "Stress testing at major financial institutions: survey results and practice," CGFS Papers, Bank for International Settlements, number 24, december.
    11. Gary Gorton, 2009. "Information, Liquidity, and the (Ongoing) Panic of 2007," American Economic Review, American Economic Association, vol. 99(2), pages 567-572, May.
    12. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    13. Claudio E. V. Borio, 2004. "Market distress and vanishing liquidity: anatomy and policy options," BIS Working Papers 158, Bank for International Settlements.
    14. Jacobson, Tor & Linde, Jesper & Roszbach, Kasper, 2005. "Exploring interactions between real activity and the financial stance," Journal of Financial Stability, Elsevier, vol. 1(3), pages 308-341, April.
    15. Adam, Klaus & Marcet, Albert, 2011. "Internal rationality, imperfect market knowledge and asset prices," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1224-1252, May.
    16. Klaus Duellmann & Martin Erdelmeier, 2009. "Crash Testing German Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 139-175, September.
    17. Helmut Elsinger & Alfred Lehar & Martin Summer, 2006. "Risk Assessment for Banking Systems," Management Science, INFORMS, vol. 52(9), pages 1301-1314, September.
    18. Markus K. Brunnermeier, 2009. "Deciphering the Liquidity and Credit Crunch 2007-2008," Journal of Economic Perspectives, American Economic Association, vol. 23(1), pages 77-100, Winter.
    19. Quagliariello,Mario (ed.), 2009. "Stress-testing the Banking System," Cambridge Books, Cambridge University Press, number 9780521767309, September.
    20. Haubrich, Joseph G. & Lo, Andrew W. (ed.), 2013. "Quantifying Systemic Risk," National Bureau of Economic Research Books, University of Chicago Press, number 9780226921969, Febrero.
    21. Castrén, Olli & Dées, Stéphane & Zaher, Fadi, 2008. "Global macro-financial shocks and expected default frequencies in the euro area," Working Paper Series 875, European Central Bank.
    22. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    23. Mathias Drehmann & Claudio Borio & Kostas Tsatsaronis, 2012. "Characterising the financial cycle: don't lose sight of the medium term!," BIS Working Papers 380, Bank for International Settlements.
    24. Mathias Drehmann & Mikael Juselius, 2012. "Do debt service costs affect macroeconomic and financial stability?," BIS Quarterly Review, Bank for International Settlements, September.
    25. Moritz Schularick & Alan M. Taylor, 2012. "Credit Booms Gone Bust: Monetary Policy, Leverage Cycles, and Financial Crises, 1870-2008," American Economic Review, American Economic Association, vol. 102(2), pages 1029-1061, April.
    26. Christiano, Lawrence & Motto, Roberto & Rostagno, Massimo, 2010. "Financial factors in economic fluctuations," Working Paper Series 1192, European Central Bank.
    27. Miss Liliana B Schumacher & Mr. Theodore M. Barnhill, 2011. "Modeling Correlated Systemic Liquidity and Solvency Risks in a Financial Environment with Incomplete Information," IMF Working Papers 2011/263, International Monetary Fund.
    28. Ricardo J. Caballero & Takeo Hoshi & Anil K. Kashyap, 2008. "Zombie Lending and Depressed Restructuring in Japan," American Economic Review, American Economic Association, vol. 98(5), pages 1943-1977, December.
    29. Pierre-Olivier Gourinchas & Maurice Obstfeld, 2012. "Stories of the Twentieth Century for the Twenty-First," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(1), pages 226-265, January.
    30. Mathias Drehmann & Claudio Borio & Kostas Tsatsaronis, 2011. "Anchoring Countercyclical Capital Buffers: The role of Credit Aggregates," International Journal of Central Banking, International Journal of Central Banking, vol. 7(4), pages 189-240, December.
    31. Miroslav Misina & David Tessier & Shubhasis Dey, 2006. "Stress Testing the Corporate Loans Portfolio of the Canadian Banking Sector," Staff Working Papers 06-47, Bank of Canada.
    32. Ingo Fender & Nikola Tarashev & Haibin Zhu, 2008. "Credit fundamentals, ratings and value-at-risk: CDOs versus corporate exposures," BIS Quarterly Review, Bank for International Settlements, March.
    33. Claudio Borio & Bent Vale & Goetz von Peter, 2010. "Resolving the financial crisis: are we heeding the lessons from the Nordics?," Working Paper 2010/17, Norges Bank.
    34. Borio Claudio, 2011. "Implementing a Macroprudential Framework: Blending Boldness and Realism," Capitalism and Society, De Gruyter, vol. 6(1), pages 1-25, August.
    35. Antonella Foglia, 2009. "Stress Testing Credit Risk: A Survey of Authorities' Aproaches," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 9-45, September.
    36. Céline Gauthier & Toni Gravelle & Xuezhi Liu & Moez Souissi, 2011. "What Matters in Determining Capital Surcharges for Systemically Important Financial Institutions?," Discussion Papers 11-9, Bank of Canada.
    37. Michael Boss & Gerhard Fenz & Gerald Krenn & Johannes Pann & Claus Puhr & Thomas Scheiber & Stefan W. Schmitz & Martin Schneider & Eva Ubl, 2008. "Stress Tests for the Austrian FSAP Update 2007: Methodology, Scenarios and Results," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 15, pages 68-92.
    38. Jin, Xisong & Nadal De Simone, Francisco de A., 2014. "Banking systemic vulnerabilities: A tail-risk dynamic CIMDO approach," Journal of Financial Stability, Elsevier, vol. 14(C), pages 81-101.
    39. repec:onb:oenbwp:y:2008:i:15:b:1 is not listed on IDEAS
    40. Drehmann, Mathias & Sorensen, Steffen & Stringa, Marco, 2010. "The integrated impact of credit and interest rate risk on banks: A dynamic framework and stress testing application," Journal of Banking & Finance, Elsevier, vol. 34(4), pages 713-729, April.
    41. Miguel A. Segoviano, 2006. "Portfolio Credit Risk and Macroeconomic Shocks: Applications to Stress Testing Under Data-Restricted Environments," IMF Working Papers 2006/283, International Monetary Fund.
    42. De Graeve, F. & Kick, T. & Koetter, M., 2008. "Monetary policy and financial (in)stability: An integrated micro-macro approach," Journal of Financial Stability, Elsevier, vol. 4(3), pages 205-231, September.
    43. Claudio Borio, 2013. "The Great Financial Crisis: Setting priorities for new statistics," Journal of Banking Regulation, Palgrave Macmillan, vol. 14(3-4), pages 306-317, July.
    44. Lucia Alessi & Carsten Detken, 2009. "Global liquidity as an early warning indicator for asset price boom/bust cycles," Research Bulletin, European Central Bank, vol. 8, pages 7-9.
    45. Òscar Jordà, 2005. "Estimation and Inference of Impulse Responses by Local Projections," American Economic Review, American Economic Association, vol. 95(1), pages 161-182, March.
    46. Detken, Carsten & Alessi, Lucia, 2009. "'Real time'early warning indicators for costly asset price boom/bust cycles: a role for global liquidity," Working Paper Series 1039, European Central Bank.
    47. Miroslav Misina & David Tessier, 2008. "Non-Linearities, Model Uncertainty, and Macro Stress Testing," Staff Working Papers 08-30, Bank of Canada.
    48. Jan Willem van den End, 2010. "Liquidity Stress-Tester: A Model for Stress-testing Banks' Liquidity Risk," CESifo Economic Studies, CESifo, vol. 56(1), pages 38-69, March.
    49. Ms. Li L Ong & Mr. Rodolfo Maino & Ms. Nombulelo Braiton, 2010. "Into the Great Unknown: Stress Testing with Weak Data," IMF Working Papers 2010/282, International Monetary Fund.
    50. Rodrigo Alfaro & Mathias Drehmann, 2009. "Macro stress tests and crises: what can we learn?," BIS Quarterly Review, Bank for International Settlements, December.
    51. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    52. Maria Soledad Martinez Peria & Mr. Giovanni Majnoni & Mr. Matthew T Jones & Mr. Winfrid Blaschke, 2001. "Stress Testing of Financial Systems: An Overview of Issues, Methodologies, and FSAP Experiences," IMF Working Papers 2001/088, International Monetary Fund.
    53. Meh, Césaire A. & Moran, Kevin, 2010. "The role of bank capital in the propagation of shocks," Journal of Economic Dynamics and Control, Elsevier, vol. 34(3), pages 555-576, March.
    54. Mathias Drehmann & Nikola Tarashev, 2011. "Systemic importance: some simple indicators," BIS Quarterly Review, Bank for International Settlements, March.
    55. Mr. Martin Cihak, 2007. "Introduction to Applied Stress Testing," IMF Working Papers 2007/059, International Monetary Fund.
    56. Dale F. Gray & Robert C. Merton & Zvi Bodie, 2006. "A New Framework for Analyzing and Managing Macrofinancial Risks of an Economy," NBER Working Papers 12637, National Bureau of Economic Research, Inc.
    57. Allen Frankel, 2006. "Prime or not so prime? An exploration of US housing finance in the new century," BIS Quarterly Review, Bank for International Settlements, March.
    58. Mr. Martin Cihak & Ms. Li L Ong, 2010. "Of Runes and Sagas: Perspectives on Liquidity Stress Testing Using an Iceland Example," IMF Working Papers 2010/156, International Monetary Fund.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claudio Borio, 2011. "Rediscovering the Macroeconomic Roots of Financial Stability Policy: Journey, Challenges, and a Way Forward," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 87-117, December.
    2. Claudio Borio & Mathias Drehmann, 2011. "Toward an Operational Framework for Financial Stability: “Fuzzy” Measurement and Its Consequences," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 4, pages 063-123, Central Bank of Chile.
    3. Jaimes Caruana, 2013. "Measuring Systemic Risk," Chapters, in: Andreas Dombret & Otto Lucius (ed.), Stability of the Financial System, chapter 9, Edward Elgar Publishing.
    4. Borio, Claudio, 2014. "The financial cycle and macroeconomics: What have we learnt?," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 182-198.
    5. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    6. Claudio Borio, 2014. "The financial cycle and macroeconomics: what have we learned and what are the policy implications?," Chapters, in: Ewald Nowotny & Doris Ritzberger-Grünwald & Peter Backé (ed.), Financial Cycles and the Real Economy, chapter 2, pages 10-35, Edward Elgar Publishing.
    7. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2019. "Does machine learning help us predict banking crises?," Journal of Financial Stability, Elsevier, vol. 45(C).
    8. Ebrahimi Kahou, Mahdi & Lehar, Alfred, 2017. "Macroprudential policy: A review," Journal of Financial Stability, Elsevier, vol. 29(C), pages 92-105.
    9. Ruja, Catalin, 2014. "Macro Stress-Testing Credit Risk in Romanian Banking System," MPRA Paper 58244, University Library of Munich, Germany.
    10. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    11. Gertler, Pavel & Hofmann, Boris, 2018. "Monetary facts revisited," Journal of International Money and Finance, Elsevier, vol. 86(C), pages 154-170.
    12. Dimitrios Bisias & Mark Flood & Andrew W. Lo & Stavros Valavanis, 2012. "A Survey of Systemic Risk Analytics," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 255-296, October.
    13. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2018. "An evaluation of early warning models for systemic banking crises: Does machine learning improve predictions?," Discussion Papers 48/2018, Deutsche Bundesbank.
    14. Mikael Juselius & Mathias Drehmann, 2015. "Leverage dynamics and the real burden of debt," BIS Working Papers 501, Bank for International Settlements.
    15. Piergiorgio Alessandri & Pierluigi Bologna & Roberta Fiori & Enrico Sette, 2015. "A note on the implementation of the countercyclical capital buffer in Italy," Questioni di Economia e Finanza (Occasional Papers) 278, Bank of Italy, Economic Research and International Relations Area.
    16. Ferrari, Stijn & Van Roy, Patrick & Vespro, Cristina, 2021. "Sensitivity of credit risk stress test results: Modelling issues with an application to Belgium," Journal of Financial Stability, Elsevier, vol. 52(C).
    17. Mathias Drehmann & Claudio Borio & Kostas Tsatsaronis, 2012. "Characterising the financial cycle: don't lose sight of the medium term!," BIS Working Papers 380, Bank for International Settlements.
    18. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    19. Waelchli Boris, 2016. "A proximity based macro stress testing framework," Dependence Modeling, De Gruyter, vol. 4(1), pages 1-26, November.
    20. Drakos, Anastassios A. & Kouretas, Georgios P., 2015. "Bank ownership, financial segments and the measurement of systemic risk: An application of CoVaR," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 127-140.

    More about this item

    Keywords

    stress tests; financial instability; macroprudential;
    All these keywords.

    JEL classification:

    • E30 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - General (includes Measurement and Data)
    • E44 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Financial Markets and the Macroeconomy
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • G20 - Financial Economics - - Financial Institutions and Services - - - General
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:369. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.