default search action
Iz Beltagy
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
showing all ?? records
2020 – today
- 2024
- [c30]Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Raghavi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Evan Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo:
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research. ACL (1) 2024: 15725-15788 - [c29]Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi:
OLMo: Accelerating the Science of Language Models. ACL (1) 2024: 15789-15809 - [c28]Rabeeh Karimi Mahabadi, Hamish Ivison, Jaesung Tae, James Henderson, Iz Beltagy, Matthew E. Peters, Arman Cohan:
TESS: Text-to-Text Self-Conditioned Simplex Diffusion. EACL (1) 2024: 2347-2361 - [i39]Luca Soldaini, Rodney Kinney, Akshita Bhagia
, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Raghavi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo:
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research. CoRR abs/2402.00159 (2024) - [i38]Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia
OLMo: Accelerating the Science of Language Models. CoRR abs/2402.00838 (2024) - [i37]Muhammad Khalifa, David Wadden, Emma Strubell, Honglak Lee, Lu Wang, Iz Beltagy, Hao Peng:
Source-Aware Training Enables Knowledge Attribution in Language Models. CoRR abs/2404.01019 (2024) - 2023
- [j2]Zhaofeng Wu, William Merrill, Hao Peng, Iz Beltagy, Noah A. Smith:
Transparency Helps Reveal When Language Models Learn Meaning. Trans. Assoc. Comput. Linguistics 11: 617-634 (2023) - [c27]Xinxi Lyu, Sewon Min, Iz Beltagy, Luke Zettlemoyer, Hannaneh Hajishirzi:
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations. ACL (1) 2023: 2304-2317 - [c26]Qinyuan Ye, Iz Beltagy, Matthew E. Peters, Xiang Ren, Hannaneh Hajishirzi:
FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning. ACL (1) 2023: 8158-8185 - [c25]Yizhong Wang, Hamish Ivison, Pradeep Dasigi, Jack Hessel, Tushar Khot, Khyathi Raghavi Chandu, David Wadden, Kelsey MacMillan, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi:
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources. NeurIPS 2023 - [i36]Rodney Kinney, Chloe Anastasiades, Russell Authur, Iz Beltagy, Jonathan Bragg
The Semantic Scholar Open Data Platform. CoRR abs/2301.10140 (2023) - [i35]Rabeeh Karimi Mahabadi, Jaesung Tae, Hamish Ivison, James Henderson, Iz Beltagy, Matthew E. Peters, Arman Cohan
TESS: Text-to-Text Self-Conditioned Simplex Diffusion. CoRR abs/2305.08379 (2023) - [i34]Ananya Harsh Jha, Dirk Groeneveld, Emma Strubell, Iz Beltagy:
Large Language Model Distillation Doesn't Need a Teacher. CoRR abs/2305.14864 (2023) - [i33]Yizhong Wang, Hamish Ivison, Pradeep Dasigi, Jack Hessel, Tushar Khot, Khyathi Raghavi Chandu, David Wadden, Kelsey MacMillan, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi:
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources. CoRR abs/2306.04751 (2023) - [i32]Hao Peng, Qingqing Cao, Jesse Dodge, Matthew E. Peters, Jared Fernandez, Tom Sherborne, Kyle Lo, Sam Skjonsberg, Emma Strubell, Darrell Plessas, Iz Beltagy, Evan Pete Walsh, Noah A. Smith, Hannaneh Hajishirzi:
Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation. CoRR abs/2307.09701 (2023) - [i31]Hamish Ivison, Yizhong Wang, Valentina Pyatkin, Nathan Lambert, Matthew E. Peters, Pradeep Dasigi, Joel Jang, David Wadden, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi:
Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2. CoRR abs/2311.10702 (2023) - [i30]Dirk Groeneveld, Anas Awadalla, Iz Beltagy, Akshita Bhagia
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets. CoRR abs/2312.10253 (2023) - [i29]Ian Magnusson, Akshita Bhagia
Paloma: A Benchmark for Evaluating Language Model Fit. CoRR abs/2312.10523 (2023) - 2022
- [j1]Michael J. Cafarella, Michael R. Anderson, Iz Beltagy, Arie Cattan, Sarah E. Chasins
Infrastructure for Rapid Open Knowledge Network Development. AI Mag. 43(1): 59-68 (2022) - [c24]Iz Beltagy, Arman Cohan
Zero- and Few-Shot NLP with Pretrained Language Models. ACL (tutorial) 2022: 32-37 - [c23]Wen Xiao, Iz Beltagy, Giuseppe Carenini, Arman Cohan:
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization. ACL (1) 2022: 5245-5263 - [c22]Teven Le Scao, Thomas Wang, Daniel Hesslow, Stas Bekman, M. Saiful Bari
What Language Model to Train if You Have One Million GPU Hours? EMNLP (Findings) 2022: 765-782 - [c21]Zhaofeng Wu, Robert L. Logan IV, Pete Walsh, Akshita Bhagia, Dirk Groeneveld, Sameer Singh, Iz Beltagy:
Continued Pretraining for Better Zero- and Few-Shot Promptability. EMNLP 2022: 4517-4531 - [c20]David Wadden, Kyle Lo, Bailey Kuehl, Arman Cohan, Iz Beltagy, Lucy Lu Wang, Hannaneh Hajishirzi:
SciFact-Open: Towards open-domain scientific claim verification. EMNLP (Findings) 2022: 4719-4734 - [c19]Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy:
Staged Training for Transformer Language Models. ICML 2022: 19893-19908 - [c18]Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel:
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML 2022: 22964-22984 - [c17]David Wadden, Kyle Lo, Lucy Lu Wang
MultiVerS: Improving scientific claim verification with weak supervision and full-document context. NAACL-HLT (Findings) 2022: 61-76 - [c16]Ana Marasovic, Iz Beltagy, Doug Downey, Matthew E. Peters:
Few-Shot Self-Rationalization with Natural Language Prompts. NAACL-HLT (Findings) 2022: 410-424 - [i28]Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy:
Staged Training for Transformer Language Models. CoRR abs/2203.06211 (2022) - [i27]Daniel King, Zejiang Shen, Nishant Subramani, Daniel S. Weld, Iz Beltagy, Doug Downey:
Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search. CoRR abs/2203.08436 (2022) - [i26]Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel:
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? CoRR abs/2204.05832 (2022) - [i25]Zhaofeng Wu, William Merrill, Hao Peng, Iz Beltagy, Noah A. Smith:
Transparency Helps Reveal When Language Models Learn Meaning. CoRR abs/2210.07468 (2022) - [i24]Zhaofeng Wu, Robert L. Logan IV, Pete Walsh, Akshita Bhagia
Continued Pretraining for Better Zero- and Few-Shot Promptability. CoRR abs/2210.10258 (2022) - [i23]David Wadden, Kyle Lo, Bailey Kuehl, Arman Cohan, Iz Beltagy, Lucy Lu Wang
SciFact-Open: Towards open-domain scientific claim verification. CoRR abs/2210.13777 (2022) - [i22]Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari
What Language Model to Train if You Have One Million GPU Hours? CoRR abs/2210.15424 (2022) - [i21]Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. CoRR abs/2211.05100 (2022) - [i20]Xinxi Lyu, Sewon Min, Iz Beltagy, Luke Zettlemoyer, Hannaneh Hajishirzi:
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations. CoRR abs/2212.09865 (2022) - 2021
- [c15]Arie Cattan, Sophie Johnson, Daniel S. Weld, Ido Dagan, Iz Beltagy, Doug Downey
SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts. AKBC 2021 - [c14]Rahul Nadkarni, David Wadden, Iz Beltagy, Noah A. Smith, Hannaneh Hajishirzi, Tom Hope:
Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study. AKBC 2021 - [c13]Avi Caciularu, Arman Cohan
CDLM: Cross-Document Language Modeling. EMNLP (Findings) 2021: 2648-2662 - [c12]Jay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl, Lucy Lu Wang
MS\^2: Multi-Document Summarization of Medical Studies. EMNLP (1) 2021: 7494-7513 - [c11]Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers. NAACL-HLT 2021: 4599-4610 - [c10]Jonathan Bragg, Arman Cohan
FLEX: Unifying Evaluation for Few-Shot NLP. NeurIPS 2021: 15787-15800 - [e1]Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tür, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakraborty, Yichao Zhou:
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6-11, 2021. Association for Computational Linguistics 2021, ISBN 978-1-954085-46-6 [contents] - [i19]Avi Caciularu, Arman Cohan, Iz Beltagy, Matthew E. Peters, Arie Cattan, Ido Dagan:
Cross-Document Language Modeling. CoRR abs/2101.00406 (2021) - [i18]Jay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl, Lucy Lu Wang:
MS2: Multi-Document Summarization of Medical Studies. CoRR abs/2104.06486 (2021) - [i17]Arie Cattan, Sophie Johnson, Daniel S. Weld, Ido Dagan, Iz Beltagy, Doug Downey, Tom Hope:
SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts. CoRR abs/2104.08809 (2021) - [i16]Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, Matt Gardner:
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers. CoRR abs/2105.03011 (2021) - [i15]Rahul Nadkarni, David Wadden, Iz Beltagy, Noah A. Smith, Hannaneh Hajishirzi, Tom Hope:
Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study. CoRR abs/2106.09700 (2021) - [i14]Jonathan Bragg, Arman Cohan, Kyle Lo, Iz Beltagy:
FLEX: Unifying Evaluation for Few-Shot NLP. CoRR abs/2107.07170 (2021) - [i13]Wen Xiao, Iz Beltagy, Giuseppe Carenini, Arman Cohan:
PRIMER: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization. CoRR abs/2110.08499 (2021) - [i12]Ana Marasovic, Iz Beltagy, Doug Downey, Matthew E. Peters:
Few-Shot Self-Rationalization with Natural Language Prompts. CoRR abs/2111.08284 (2021) - [i11]David Wadden, Kyle Lo, Lucy Lu Wang, Arman Cohan, Iz Beltagy, Hannaneh Hajishirzi:
LongChecker: Improving scientific claim verification by modeling full-abstract context. CoRR abs/2112.01640 (2021) - 2020
- [c9]Arman Cohan
SPECTER: Document-level Representation Learning using Citation-informed Transformers. ACL 2020: 2270-2282 - [c8]Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, Iz Beltagy:
SciREX: A Challenge Dataset for Document-Level Information Extraction. ACL 2020: 7506-7516 - [c7]Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith:
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. ACL 2020: 8342-8360 - [i10]Iz Beltagy, Matthew E. Peters, Arman Cohan:
Longformer: The Long-Document Transformer. CoRR abs/2004.05150 (2020) - [i9]Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey
SPECTER: Document-level Representation Learning using Citation-informed Transformers. CoRR abs/2004.07180 (2020) - [i8]Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. CoRR abs/2004.10964 (2020) - [i7]Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, Iz Beltagy:
SciREX: A Challenge Dataset for Document-Level Information Extraction. CoRR abs/2005.00512 (2020)
2010 – 2019
- 2019
- [c6]Mark Neumann, Daniel King
ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing. BioNLP@ACL 2019: 319-327 - [c5]Iz Beltagy, Kyle Lo, Arman Cohan
SciBERT: A Pretrained Language Model for Scientific Text. EMNLP/IJCNLP (1) 2019: 3613-3618 - [c4]Arman Cohan
Pretrained Language Models for Sequential Sentence Classification. EMNLP/IJCNLP (1) 2019: 3691-3697 - [c3]Iz Beltagy, Kyle Lo, Waleed Ammar:
Combining Distant and Direct Supervision for Neural Relation Extraction. NAACL-HLT (1) 2019: 1858-1867 - [i6]Mark Neumann, Daniel King
ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing. CoRR abs/1902.07669 (2019) - [i5]Iz Beltagy, Arman Cohan, Kyle Lo:
SciBERT: Pretrained Contextualized Embeddings for Scientific Text. CoRR abs/1903.10676 (2019) - [i4]Arman Cohan, Iz Beltagy, Daniel King
Pretrained Language Models for Sequential Sentence Classification. CoRR abs/1909.04054 (2019) - 2018
- [c2]Ahmed Alkhateeb, Iz Beltagy, Sam Alex:
Machine Learning for Reliable MMWAVE Systems: Blockage Prediction and Proactive Handoff. GlobalSIP 2018: 1055-1059 - [c1]Waleed Ammar, Dirk Groeneveld
Construction of the Literature Graph in Semantic Scholar. NAACL-HLT (3) 2018: 84-91 - [i3]Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, Rodney Kinney, Sebastian Kohlmeier, Kyle Lo, Tyler Murray, Hsu-Han Ooi, Matthew E. Peters, Joanna Power, Sam Skjonsberg, Lucy Lu Wang
Construction of the Literature Graph in Semantic Scholar. CoRR abs/1805.02262 (2018) - [i2]Ahmed Alkhateeb, Iz Beltagy:
Machine Learning for Reliable mmWave Systems: Blockage Prediction and Proactive Handoff. CoRR abs/1807.02723 (2018) - [i1]Iz Beltagy, Kyle Lo, Waleed Ammar:
Improving Distant Supervision with Maxpooled Attention and Sentence-Level Supervision. CoRR abs/1810.12956 (2018)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from ,
, and
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and
to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from .
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-10-07 21:15 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by: