When we need to have parsoid output in the ParserCache for use by VE, but we don't want to use it for page views, then we should perform the pre-population on edit asynchronously.
Specifically, DerivedPageDataUpdater::doParsoidCacheUpdate should enqueue a job, rather than parsing directly.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| jobqueue: Warm parsoid parser cache using a job | mediawiki/core | master | +209 -45 |
Please note that, both for this task and its duplicate, deployment in production should be coordinated with SRE as it will most likely need:
All of the above require time and coordination.
Change 860567 had a related patch set uploaded (by D3r1ck01; author: Derick Alangi):
[mediawiki/core@master] jobqueue: Warm parsoid parser cache using a job
Change 860567 merged by jenkins-bot:
[mediawiki/core@master] jobqueue: Warm parsoid parser cache using a job
It is. The code is behind a switch (ParsoidCacheConfig->WarmParsoidParserCache). We just made it async when turned on.
InitializeSettings has:
17406-'wgParsoidCacheConfig' => [ 17407- 'default' => [ 17408- 'StashType' => null, // defaults to using MainStash 17409- 'StashDuration' => 24 * 60 * 60, // 24h in production, VE will fail to save after this time. 17410- 'CacheThresholdTime' => 0.0, // 0 means cache all 17411: 'WarmParsoidParserCache' => false, // whether parsoid output should be generated and cached after every edit 17412- ], 17413- 'testwiki' => [ 17414- 'StashType' => null, // defaults to using MainStash 17415- 'StashDuration' => 24 * 60 * 60, // 24h in production, VE will fail to save after this time. 17416- 'CacheThresholdTime' => 0.0, // 0 means cache all 17417: 'WarmParsoidParserCache' => true, // T320535: enable cache warming 17418- ], 17419- 'mediawikiwiki' => [ 17420- 'StashType' => null, // defaults to using MainStash 17421- 'StashDuration' => 24 * 60 * 60, // 24h in production, VE will fail to save after this time. 17422- 'CacheThresholdTime' => 0.0, // 0 means cache all 17423: 'WarmParsoidParserCache' => true, // T320534: enable cache warming 17424- ], 17425-],