[go: up one dir, main page]
Page MenuHomePhabricator
Create Task
Maniphest T379037

Implement batching for collections data
Open, HighPublic
Actions

Description

Collections can have a large number of links so batching is needed to be able to get all the links and all the page infos. For instance, enwiki Vital articles/3 has about 1000 links and the API will only return 500 at a time.

There is a WIP patch but it needs serious updates and testing.

Details

SubjectRepoBranchLines +/-
Update recommendation api to 2024-11-13-183159-productionoperations/deployment-chartsmaster+2 -2
API Continue supportresearch/recommendation-apimaster+52 -30
Update recommendation-api to 2024-11-08-142328-productionoperations/deployment-chartsmaster+2 -2
Remove print()research/recommendation-apimaster+1 -1
Implement batching in get_wiki_page_inforesearch/recommendation-apimaster+20 -18
Customize query in gerrit

Event Timeline

SBisson created this task.Tue, Nov 5, 2:32 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, Nov 5, 2:32 AM
SBisson triaged this task as High priority.Tue, Nov 5, 2:32 AM
SBisson moved this task from Backlog to Prioritized on the LPL Hypothesis board.
SBisson claimed this task.Tue, Nov 5, 6:44 PM
SBisson moved this task from Prioritized to In-progress on the LPL Hypothesis board.
gerritbot added a comment.Wed, Nov 6, 6:42 PM

Change #1061713 had a related patch set uploaded (by Sbisson; author: Santhosh):

[research/recommendation-api@master] API Continue support

https://gerrit.wikimedia.org/r/1061713

gerritbot added a project: Patch-For-Review.Wed, Nov 6, 6:42 PM
gerritbot added a comment.Wed, Nov 6, 7:38 PM

Change #1087962 had a related patch set uploaded (by Sbisson; author: Sbisson):

[research/recommendation-api@master] Implement batching in get_wiki_page_info

https://gerrit.wikimedia.org/r/1087962

SBisson moved this task from In-progress to Needs Code Review on the LPL Hypothesis board.Wed, Nov 6, 7:39 PM
gerritbot added a comment.Thu, Nov 7, 4:14 PM

Change #1087962 merged by jenkins-bot:

[research/recommendation-api@master] Implement batching in get_wiki_page_info

https://gerrit.wikimedia.org/r/1087962

gerritbot added a comment.Thu, Nov 7, 4:28 PM

Change #1088333 had a related patch set uploaded (by Sbisson; author: Sbisson):

[research/recommendation-api@master] Remove print()

https://gerrit.wikimedia.org/r/1088333

gerritbot added a comment.Thu, Nov 7, 4:45 PM

Change #1088333 merged by jenkins-bot:

[research/recommendation-api@master] Remove print()

https://gerrit.wikimedia.org/r/1088333

gerritbot added a comment.Mon, Nov 11, 3:58 AM

Change #1088276 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update recommendation-api to 2024-11-08-142328-production

https://gerrit.wikimedia.org/r/1088276

gerritbot added a comment.Mon, Nov 11, 7:11 AM

Change #1088276 merged by jenkins-bot:

[operations/deployment-charts@master] Update recommendation-api to 2024-11-08-142328-production

https://gerrit.wikimedia.org/r/1088276

gerritbot added a comment.Mon, Nov 11, 3:32 PM

Change #1061713 merged by jenkins-bot:

[research/recommendation-api@master] API Continue support

https://gerrit.wikimedia.org/r/1061713

SBisson moved this task from Needs Code Review to Pending deployment on the LPL Hypothesis board.Mon, Nov 11, 3:45 PM
Maintenance_bot removed a project: Patch-For-Review.Mon, Nov 11, 4:30 PM
gerritbot added a comment.Tue, Nov 12, 4:20 AM

Change #1089964 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update recommendation api to 2024-11-11-200548-production

https://gerrit.wikimedia.org/r/1089964

gerritbot added a project: Patch-For-Review.Tue, Nov 12, 4:20 AM
ngkountas moved this task from Pending deployment to Needs QA on the LPL Hypothesis board.Wed, Nov 13, 7:11 PM
ngkountas moved this task from Needs QA to Pending deployment on the LPL Hypothesis board.Wed, Nov 13, 7:17 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits