[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/eee/transa/v183y2024ics0965856424001174.html
   My bibliography  Save this article

DeepAD: An integrated decision-making framework for intelligent autonomous driving

Author

Listed:
  • Shi, Yunyang
  • Liu, Jinghan
  • Liu, Chengqi
  • Gu, Ziyuan
Abstract
Autonomous vehicles have the potential to revolutionize intelligent transportation by improving traffic safety, increasing energy efficiency, and reducing congestion. In this study, a novel framework termed DeepAD was proposed and validated for decision making in intelligent autonomous driving via deep reinforcement learning. This framework incorporates multiple driving objectives such as efficiency, safety, and comfort to make informed decisions regarding autonomous vehicles (AVs). The decision-making process utilizes the origin–destination information for macrolevel routing and determines microlevel car-following and lane-changing behaviors. The lane-changing behavior is discretized and learned through a deep Q-network, and the continuous car-following behavior is learned through a deep deterministic policy gradient. Comprehensive simulation experiments on a real-world network demonstrated that DeepAD outperformed human driving while maintaining a desirable level of efficiency, safety, and comfort. In the real-world road networks experiment, multiple indexes of vehicles in the high AVs penetration rate group significantly outperformed that of the group with lower AVs penetration rate. Overall, the proposed framework provides insights into intelligent autonomous driving to improve urban mobility.

Suggested Citation

  • Shi, Yunyang & Liu, Jinghan & Liu, Chengqi & Gu, Ziyuan, 2024. "DeepAD: An integrated decision-making framework for intelligent autonomous driving," Transportation Research Part A: Policy and Practice, Elsevier, vol. 183(C).
    • Handle: RePEc:eee:transa:v:183:y:2024:i:c:s0965856424001174
    DOI: 10.1016/j.tra.2024.104069
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0965856424001174
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.tra.2024.104069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mordue, Greig & Yeung, Anders & Wu, Fan, 2020. "The looming challenges of regulating high level autonomous vehicles," Transportation Research Part A: Policy and Practice, Elsevier, vol. 132(C), pages 174-187.
    2. Gu, Ziyuan & Safarighouzhdi, Farshid & Saberi, Meead & Rashidi, Taha H., 2021. "A macro-micro approach to modeling parking," Transportation Research Part B: Methodological, Elsevier, vol. 147(C), pages 220-244.
    3. Shuo Feng & Haowei Sun & Xintao Yan & Haojie Zhu & Zhengxia Zou & Shengyin Shen & Henry X. Liu, 2023. "Dense reinforcement learning for safety validation of autonomous vehicles," Nature, Nature, vol. 615(7953), pages 620-627, March.
    4. Yoo, Sunbin & Kumagai, Junya & Morita, Tamaki & Park, Y. Gina & Managi, Shunsuke, 2023. "Who to sacrifice? Modeling the driver’s dilemma," Transportation Research Part A: Policy and Practice, Elsevier, vol. 178(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Xinying & Pitera, Kelly & Wang, Yuanqing, 2024. "Exploring parking choices under the coexistence of autonomous and conventional vehicles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 636(C).
    2. Huang, Ruchen & He, Hongwen & Gao, Miaojue, 2023. "Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework," Applied Energy, Elsevier, vol. 346(C).
    3. Jinxiao Duan & Guanwen Zeng & Nimrod Serok & Daqing Li & Efrat Blumenfeld Lieberthal & Hai-Jun Huang & Shlomo Havlin, 2023. "Spatiotemporal dynamics of traffic bottlenecks yields an early signal of heavy congestions," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    4. Henry X. Liu & Shuo Feng, 2024. "Curse of rarity for autonomous vehicles," Nature Communications, Nature, vol. 15(1), pages 1-5, December.
    5. Gupta, Namrata & Patil, Gopal R. & Vu, Hai L., 2023. "Simple abstract models to study stability of urban networks with decentralized signal control," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 93-116.
    6. Geva, Sharon & Fulman, Nir & Ben-Elia, Eran, 2022. "Getting the prices right: Drivers' cruising choices in a serious parking game," Transportation Research Part A: Policy and Practice, Elsevier, vol. 165(C), pages 54-75.
    7. Manivasakan, Hesavar & Kalra, Riddhi & O'Hern, Steve & Fang, Yihai & Xi, Yinfei & Zheng, Nan, 2021. "Infrastructure requirement for autonomous vehicle integration for future urban and suburban roads – Current practice and a case study of Melbourne, Australia," Transportation Research Part A: Policy and Practice, Elsevier, vol. 152(C), pages 36-53.
    8. Ali Louati & Hassen Louati & Elham Kariri & Wafa Neifar & Mohamed K. Hassan & Mutaz H. H. Khairi & Mohammed A. Farahat & Heba M. El-Hoseny, 2024. "Sustainable Smart Cities through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles," Sustainability, MDPI, vol. 16(5), pages 1-18, February.
    9. Sikai Chen & Shuya Zong & Tiantian Chen & Zilin Huang & Yanshen Chen & Samuel Labi, 2023. "A Taxonomy for Autonomous Vehicles Considering Ambient Road Infrastructure," Sustainability, MDPI, vol. 15(14), pages 1-27, July.
    10. Gu, Ziyuan & Li, Yifan & Saberi, Meead & Rashidi, Taha H. & Liu, Zhiyuan, 2023. "Macroscopic parking dynamics and equitable pricing: Integrating trip-based modeling with simulation-based robust optimization," Transportation Research Part B: Methodological, Elsevier, vol. 173(C), pages 354-381.
    11. Biruk Gebremedhin Mesfin & Zihao Li & Daniel (Jian) Sun & Deming Chen & Yueting Xi, 2024. "Urban traffic-parking system dynamics model with macroscopic properties: a comparative study between Shanghai and Zurich," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    12. Ben-Dor, Golan & Ogulenko, Aleksey & Klein, Ido & Ben-Elia, Eran & Benenson, Itzhak, 2024. "Simulation-based policy evaluation of monetary car driving disincentives in Jerusalem," Transportation Research Part A: Policy and Practice, Elsevier, vol. 183(C).
    13. Lu, Xiao-Shan & Huang, Hai-Jun & Guo, Ren-Yong & Xiong, Fen, 2021. "Linear location-dependent parking fees and integrated daily commuting patterns with late arrival and early departure in a linear city," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 293-322.
    14. Ardeshiri, Ali & Safarighouzhdi, Farshid & Hossein Rashidi, Taha, 2021. "Measuring willingness to pay for shared parking," Transportation Research Part A: Policy and Practice, Elsevier, vol. 152(C), pages 186-202.
    15. Sajjad Shafiei & Ziyuan Gu & Hanna Grzybowska & Chen Cai, 2023. "Impact of self-parking autonomous vehicles on urban traffic congestion," Transportation, Springer, vol. 50(1), pages 183-203, February.
    16. Hansson, Lisa, 2020. "Regulatory governance in emerging technologies: The case of autonomous vehicles in Sweden and Norway," Research in Transportation Economics, Elsevier, vol. 83(C).
    17. Jo-Ann Pattinson & Haibo Chen & Subhajit Basu, 2020. "Legal issues in automated vehicles: critically considering the potential role of consent and interactive digital interfaces," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-10, December.
    18. Yoo, Sunbin & Kumagai, Junya & Kawabata, Yuta & Keeley, Alexander & Managi, Shunsuke, 2021. "Willingness to Buy and/or Pay Disparity: Evidence from Fully Autonomous Vehicles," MPRA Paper 108882, University Library of Munich, Germany.
    19. Schepis, Daniel & Purchase, Sharon & Olaru, Doina & Smith, Brett & Ellis, Nick, 2023. "How governments influence autonomous vehicle (AV) innovation," Transportation Research Part A: Policy and Practice, Elsevier, vol. 178(C).
    20. He, Hongwen & Meng, Xiangfei & Wang, Yong & Khajepour, Amir & An, Xiaowen & Wang, Renguang & Sun, Fengchun, 2024. "Deep reinforcement learning based energy management strategies for electrified vehicles: Recent advances and perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transa:v:183:y:2024:i:c:s0965856424001174. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/547/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.