I think this is a new failure mode caused by the unusual Digital Library of India files, which start with the PDF and have enormous >2GB JP2 archives caused by bad compression on the IA's back end.
Example:
Uploading from: https://archive.org/details/in.ernet.dli.2015.226478
Log: https://ia-upload.wmcloud.org/log/in.ernet.dli.2015.226478
[2021-11-29T17:48:01.603585+00:00] LOG.INFO: Creating DjVu for in.ernet.dli.2015.226478 from Pdf [] [] [2021-11-29T17:48:01.605676+00:00] LOG.INFO: Requesting start of conversion of in.ernet.dli.2015.226478 [] [] [2021-11-29T17:48:01.997408+00:00] LOG.INFO: Starting download to /ia-upload/jobqueue/in.ernet.dli.2015.226478/in.ernet.dli.2015.226478.djvu [] [] [2021-11-29T17:48:01.997593+00:00] LOG.DEBUG: Getting in.ernet.dli.2015.226478 [] [] [2021-11-29T17:48:02.359769+00:00] LOG.DEBUG: Can't locate djvu file, ia id is valid, perhaps conversion failed or is in progress [] [] [2021-11-29T17:48:07.360127+00:00] LOG.DEBUG: Getting in.ernet.dli.2015.226478 [] [] [2021-11-29T17:48:07.694135+00:00] LOG.DEBUG: Can't locate djvu file, ia id is valid, perhaps conversion failed or is in progress [] [] [2021-11-29T17:48:12.694512+00:00] LOG.DEBUG: Getting in.ernet.dli.2015.226478 [] [] [2021-11-29T17:48:13.021762+00:00] LOG.DEBUG: Can't locate djvu file, ia id is valid, perhaps conversion failed or is in progress [] [] [2021-11-29T17:48:18.022152+00:00] LOG.DEBUG: Getting in.ernet.dli.2015.226478 [] []
And then this repeats for thousands of lines.