Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster)
Closed, DuplicatePublicBUG REPORT
Actions

Assigned To

None

Authored By

	doctaxon
	Mar 25 2023, 1:14 AM

Description

Steps to replicate the issue (include links if applicable):

open https://commons.wikimedia.org/wiki/Freudenberg_(Baden)
or open https://commons.wikimedia.org/wiki/Category:Coats_of_arms_from_Freudenberg_(Baden)
using any browser

What happens?:

thumbnails of https://commons.wikimedia.org/wiki/File:DEU_Freudenberg_COA.svg are returned as old file version but in new file ratio size
this only happens in Commons not any other project AFAIR
this only happens in categories and galleries including on pages with < 50 thumbnails
in dewiki the thumbnail is returned alright: https://de.wikipedia.org/wiki/Freudenberg_(Baden)

What should have happened instead?:
the thumbnail has to be returned as actual file

Software version (skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):
all browsers I tried in actual releases

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Duplicate	BUG REPORT	None	T333042 Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster)
		Resolved		Ladsgroup	T331138 FileBackendMultiWrite multi-dc and thumbnail handling

Event Timeline

doctaxon created this task.Mar 25 2023, 1:14 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 25 2023, 1:15 AM

doctaxon added a subscriber: AntiCompositeNumber.Mar 25 2023, 1:16 AM

okay, happens also at dewiki on pages with >50 thumbnails like https://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Wappen

thumbnails of https://commons.wikimedia.org/wiki/File:DEU_Freudenberg_COA.svg are returned as old file version but in new file ratio size

Cannot reproduce. Please bypass your local browser cache.

But I can reproduce, see attached file:

I attached page's source code:

T333042.xml40 KBDownload

; as HTML: {F36926828}

I bypassed local browser cache and purged the pages multiple times without success.

Here snippet of Chrome's DevTools from https://commons.wikimedia.org/wiki/Category:Coats_of_arms_from_Freudenberg_(Baden) , the page of attached file

<ul class="gallery mw-gallery-traditional">
		<li class="gallerybox" style="width: 155px"><div style="width: 155px">
			<div class="thumb" style="width: 150px;"><div style="margin:15px auto;"><a href="/wiki/File:Wappen_Freudenberg_Baden.png" class="image"><img alt="" src="https://upload.wikimedia.org/wikipedia/commons/thumb/9/94/Wappen_Freudenberg_Baden.png/96px-Wappen_Freudenberg_Baden.png" decoding="async" loading="lazy" width="96" height="120" srcset="https://upload.wikimedia.org/wikipedia/commons/thumb/9/94/Wappen_Freudenberg_Baden.png/143px-Wappen_Freudenberg_Baden.png 1.5x, https://upload.wikimedia.org/wikipedia/commons/thumb/9/94/Wappen_Freudenberg_Baden.png/191px-Wappen_Freudenberg_Baden.png 2x" data-file-width="224" data-file-height="281"></a></div></div>
			<div class="gallerytext">
<a href="/wiki/File:Wappen_Freudenberg_Baden.png" class="galleryfilename galleryfilename-truncate" title="File:Wappen Freudenberg Baden.png">Wappen Freudenberg Baden.png</a>
224 × 281; 11 KB<br>

			</div>
		</div></li>
		<li class="gallerybox" style="width: 155px"><div style="width: 155px">
			<div class="thumb" style="width: 150px;"><div style="margin:15px auto;"><a href="/wiki/File:DEU_Freudenberg_COA.svg" class="image"><img alt="" src="https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/98px-DEU_Freudenberg_COA.svg.png" decoding="async" loading="lazy" width="98" height="120" srcset="https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/146px-DEU_Freudenberg_COA.svg.png 1.5x, https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/195px-DEU_Freudenberg_COA.svg.png 2x" data-file-width="447" data-file-height="549"></a></div></div>
			<div class="gallerytext">
<a href="/wiki/File:DEU_Freudenberg_COA.svg" class="galleryfilename galleryfilename-truncate" title="File:DEU Freudenberg COA.svg">DEU Freudenberg COA.svg</a>
447 × 549; 27 KB<br>

			</div>
		</div></li>
</ul>

I reopened the task because like I said in cache description above, that I got the problem at any other browsers like Firefox, and Edge, and Internet Explorer too, opening the pages mentioned above first time.

So this cannot be a browser cache problem. Nothing is changing after browser cache deletions and I reproduce the same problem with another computer. But at mobile phone the files is loaded correctly. This sounds weird to me.

I called another user in another town here in Germany. He get's the same like screenshot above.

Ah, I can only reproduce for https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/146px-DEU_Freudenberg_COA.svg.png
Please provide full URLs for problematic sizes that you experience.

Thank you!

I'd like to understand how this is possible, what is the error causing this.

Please provide full URLs to thumbnails for problematic thumbnail sizes that you experience.

Yes, I got it.

But, I mean: I want to understand why in several times thumbnails are not be updated when uploading a new file version. Maybe someone can explain it.

You (or someone else) will inevitably find out when investigating the code and working on a fix. If anyone already knew, then this bug likely would not exist.

If it's not logged yet, maybe the first step is to log what happens on the servers when uploading a file to Commons.

I don't see anything wrong with https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/146px-DEU_Freudenberg_COA.svg.png. That points to the thumbnail being stuck in the European caching cluster.

Have you tried purging the file description page?

@AntiCompositeNumber: Yes, I purged it several times, without success.

AntiCompositeNumber edited projects, added Traffic; removed Thumbor.Mar 26 2023, 1:40 AM

Maintenance_bot added a project: SRE.Mar 26 2023, 1:45 AM

I tried a forcerecursivelinkupdate purge once more, without success

Aklapper renamed this task from thumbnails in categories or galleries show old file versions to Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster).Mar 26 2023, 9:24 AM

Aklapper mentioned this in T333105: Wrong display of a picture of QR code on Wikimedia Commons.Mar 27 2023, 9:03 AM

Aklapper merged a task: T333105: Wrong display of a picture of QR code on Wikimedia Commons.

Aklapper added a subscriber: Lionel_Scheepmans.

Hi folks.

I'm in front of a very strange phenomenon probably linked to this bug, and this time it concerns a PDF File.

So.

Go to https://commons.wikimedia.org/wiki/File:Couverture_blanche_Le_mouvement_Wikim%C3%A9dia.pdf?uselang=fr

When I use Firefox 102.9.0esr (64 bits) on Debian 11, I see that the last uploaded file don't display on the top of the webpage.

Same with Chromium Version 111.0.5563.110 (Build officiel) built on Debian 11.6, running on Debian 11.6 (64 bits)

And also when I use my smartphone android

But... When I use the Wikimedia common app on my phone, the PDF display correctly 2 seconds before to display blank...

And ...

When I go to this page : https://fr.wikibooks.org/wiki/Le_mouvement_Wikim%C3%A9dia

The file displayed is the first version uploaded and not the last...

But... Not when I go to the page with my mobile phone android, the correct last uploaded file display correctly !

I don't understand anything...

In T333042#8736491, @Lionel_Scheepmans wrote:

Hi folks.

I'm in front of a very strange phenomenon probably linked to this bug, and this time it concerns a PDF File.

There is definitely something weird going on wrt the Datacenters, different centers return different images. ~~I don't think it's related to doc taxon's issue, as their issue cannot be reproduced.~~ Your issue instead seems to be another case of T331138.

for DC in esams eqiad codfw ulsfo eqsin ; do echo -ne "$DC\t" ; curl -s -D- --resolve upload.wikimedia.org:443:$(dig +short upload-lb.$DC.wikimedia.org) https://upload.wikimedia.org/wikipedia/commons/thumb/e/e6/Couverture_blanche_Le_mouvement_Wikimédia.pdf/page1-543px-Couverture_blanche_Le_mouvement_Wikimédia.pdf.jpg\?20230328230242 -o /dev/null ; done

esams	HTTP/2 200
content-length: 62865
eqiad	HTTP/2 200
content-length: 62865
codfw	HTTP/2 200
content-length: 61845
ulsfo	HTTP/2 200
content-length: 61845
eqsin	HTTP/2 200
content-length: 61845

TheDJ mentioned this in T331138: FileBackendMultiWrite multi-dc and thumbnail handling.Mar 29 2023, 8:47 AM

OK, for doc taxon I can also reproduce now with that one specific link that AntiCompositeNumber found:

for DC in esams eqiad codfw ulsfo eqsin ; do echo -ne "$DC\t" ; curl -s -D- --resolve upload.wikimedia.org:443:$(dig +short upload-lb.$DC.wikimedia.org) https://upload.wikimedia.org/wikipedia/commons/thumb/3/33/DEU_Freudenberg_COA.svg/146px-DEU_Freudenberg_COA.svg.png -o /dev/null ; done
esams HTTP/2 200
content-length: 14871
eqiad HTTP/2 200
content-length: 14871
codfw HTTP/2 200
content-length: 15595
ulsfo HTTP/2 200
content-length: 15595
eqsin HTTP/2 200
content-length: 15595

TheDJ added a subtask: T331138: FileBackendMultiWrite multi-dc and thumbnail handling.Mar 29 2023, 8:54 AM

I think in these cases, removing the incorrect thumbnail will allow it to be recreated on next GET.

Mormegil mentioned this in T333679: Thumbnail did not update after new file was uploaded.Mar 31 2023, 12:29 PM

Aklapper merged a task: T333679: Thumbnail did not update after new file was uploaded.Mar 31 2023, 4:19 PM

Aklapper added a subscriber: Mormegil.

Ladsgroup mentioned this in T330942: Latest image thumbnails aren't replaced correctly after image reupload.Apr 4 2023, 4:40 PM

Hello. I still have a problem with the display of a PDF on this page : https://fr.wikibooks.org/wiki/Utilisateur:Lionel_Scheepmans/Brouillon
The last version of the file uploaded on commons didn't display...

Is ther some news about this bug ?

@Lionel_Scheepmans In general in all tickets, all known news can be found in the ticket itself. Thus no need to ever ask. Thanks!

bd808 mentioned this in T334303: PNG thumbnail of Wikimedia Commons SVG file sometimes not updated.Apr 7 2023, 7:46 PM

IKhitron subscribed.Apr 8 2023, 1:01 AM

For more than a month I have not seen new versions of files.

https://commons.wikimedia.org/wiki/File:Vake_District.svg

It seems that here in Phabricator, no new is bad new.

In T333042#8776941, @Umar wrote:

For more than a month I have not seen new versions of files.

https://commons.wikimedia.org/wiki/File:Vake_District.svg

That was uploaded less than a month ago? Anyhow, I have removed the old thumbnails, so new ones will be generated as the CDN expires its cached copies of the old ones.

In T333042#8764707, @Lionel_Scheepmans wrote:

Hello. I still have a problem with the display of a PDF on this page : https://fr.wikibooks.org/wiki/Utilisateur:Lionel_Scheepmans/Brouillon
The last version of the file uploaded on commons didn't display...

The thumbnails seem to match the latest PDF on that page?

Ladsgroup closed this task as a duplicate of T331138: FileBackendMultiWrite multi-dc and thumbnail handling.Apr 13 2023, 11:38 AM

Ladsgroup closed subtask T331138: FileBackendMultiWrite multi-dc and thumbnail handling as Resolved.Apr 17 2023, 11:53 AM

	F36926807: T333042.xml
	Mar 25 2023, 1:31 PM

	F36926800: T333042.PNG
	Mar 25 2023, 1:31 PM

Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster)Closed, DuplicatePublicBUG REPORTActions

Description

Related ObjectsSearch...

Event Timeline

Specific PNG thumbnail of SVG file is outdated / stuck (European caching cluster)
Closed, DuplicatePublicBUG REPORT
Actions

Related Objects
Search...