default search action

combined dblp search
author search
venue search
publication search

ask others

"High-throughput Generative Inference of Large Language Models with a ..."

Ying Sheng et al. (2023)

> Home

Details and statistics

DOI: 10.48550/ARXIV.2303.06865

access: open

type: Informal or Other Publication

metadata version: 2024-02-20

- view
  - electronic edition via DOI (open access)
  authority control:
- export record
  dblp key:
  - journals/corr/abs-2303-06865
- ask others
- share record
  persistent URL:
  - https://dblp.org/rec/journals/corr/abs-2303-06865
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang:
High-throughput Generative Inference of Large Language Models with a Single GPU. CoRR abs/2303.06865 (2023)

manage site settings

To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.