[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.18185.html
   My bibliography  Save this paper

Learning Optimal Behavior Through Reasoning and Experiences

Author

Listed:
  • Cosmin Ilut
  • Rosen Valchev
Abstract
We develop a novel framework of bounded rationality under cognitive frictions that studies learning over optimal behavior through both deliberative reasoning and accumulated experiences. Using both types of information, agents engage in Bayesian non-parametric estimation of the unknown action value function. Reasoning signals are produced internally through mental deliberation, subject to a cognitive cost. Experience signals are the observed utility outcomes at previous actions. Agents' subjective estimation uncertainty, which evolves through information accumulation, modulates the two modes of learning in a state- and history-dependent way. We discuss how the model draws on and bridges conceptual, methodological and empirical insights from both economics and the cognitive sciences literature on reinforcement learning.

Suggested Citation

  • Cosmin Ilut & Rosen Valchev, 2024. "Learning Optimal Behavior Through Reasoning and Experiences," Papers 2403.18185, arXiv.org.
    • Handle: RePEc:arx:papers:2403.18185
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.18185
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cosmin Ilut & Rosen Valchev & Nicolas Vincent, 2020. "Paralyzed by Fear: Rigid and Discrete Pricing Under Demand Uncertainty," Econometrica, Econometric Society, vol. 88(5), pages 1899-1938, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Cheng & Senga, Tatsuro & Sun, Chang & Zhang, Hongyong, 2023. "Uncertainty, imperfect information, and expectation formation over the firm’s life cycle," Journal of Monetary Economics, Elsevier, vol. 140(C), pages 60-77.
    2. Claudio Michelacci & Luigi Paciello, 2020. "Ambiguous Policy Announcements," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(5), pages 2356-2398.
    3. Claudio Michelacci & Luigi Paciello, 2020. "Aggregate Risk or Aggregate Uncertainty? Evidence from UK Households," EIEF Working Papers Series 2006, Einaudi Institute for Economics and Finance (EIEF), revised Apr 2020.
    4. Hahn, Volker & Marenčák, Michal, 2020. "Price points and price dynamics," Journal of Monetary Economics, Elsevier, vol. 115(C), pages 127-144.
    5. Radoslaw Paluszynski & Pei Cheng Yu, 2023. "Commitment versus Flexibility and Sticky Prices: Evidence from Life Insurance," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 49, pages 99-122, July.
    6. repec:zbw:bofrdp:2022_005 is not listed on IDEAS
    7. Ogawa, Shogo, 2022. "Survey of non-Walrasian disequilibrium economic theory," MPRA Paper 115011, University Library of Munich, Germany.
    8. Axelle Ferriere & Anastasios G. Karantounias, 2019. "Fiscal Austerity in Ambiguous Times," American Economic Journal: Macroeconomics, American Economic Association, vol. 11(1), pages 89-131, January.
    9. James Costain & Anton Nakov, 2019. "Logit Price Dynamics," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(1), pages 43-78, February.
    10. Rosen Valchev & Cosmin Ilut, 2017. "Economic Agents as Imperfect Problem Solvers," 2017 Meeting Papers 1285, Society for Economic Dynamics.
    11. Olivier Coibion & Yuriy Gorodnichenko & Tiziano Ropele, 2020. "Inflation Expectations and Firm Decisions: New Causal Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 165-219.
    12. Michael Reiter & Adrian Wende, 2024. "Generalized Rotemberg Price-Setting," CESifo Working Paper Series 11297, CESifo.
    13. Staffa, Ruben Marek, 2023. "Macroeconomic effects from sovereign risk vs. Knightian uncertainty," IWH Discussion Papers 27/2023, Halle Institute for Economic Research (IWH).
    14. Xu, Xiangyun & Li, Xing & Meng, Jie & Hu, Xueqi & Ge, Yingfan, 2024. "The impact of the tail risk of demand on corporate investment: Evidence from Chinese manufacturing firms," Pacific-Basin Finance Journal, Elsevier, vol. 85(C).
    15. Cosmin L. Ilut & Martin Schneider, 2022. "Modeling Uncertainty as Ambiguity: a Review," NBER Working Papers 29915, National Bureau of Economic Research, Inc.
    16. Harding, Martín & Lindé, Jesper & Trabandt, Mathias, 2023. "Understanding post-COVID inflation dynamics," Journal of Monetary Economics, Elsevier, vol. 140(S), pages 101-118.
    17. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.
    18. Cosmin Ilut & Rosen Valchev & Nicolas Vincent, 2020. "Paralyzed by Fear: Rigid and Discrete Pricing Under Demand Uncertainty," Econometrica, Econometric Society, vol. 88(5), pages 1899-1938, September.
    19. Stéphane Dupraz, 2024. "A Kinked‐Demand Theory of Price Rigidity," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 56(2-3), pages 325-363, March.
    20. Jean-Paul L'Huillier & Gregory Phelan, 2023. "Can Supply Shocks Be Inflationary with a Flat Phillips Curve?," Working Papers 23-36, Federal Reserve Bank of Cleveland.
    21. Pascal Seiler & Barbara Rudolf, 2022. "Price Setting Before and During the Pandemic: Evidence from Swiss Consumer Prices," KOF Working papers 22-506, KOF Swiss Economic Institute, ETH Zurich.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.18185. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.