[go: up one dir, main page]
Page MenuHomePhabricator
Create Task
Maniphest T70867

Undeploy OAI extension
Closed, ResolvedPublic
Actions

Description

Since 20140724215329

mysql:wikiadmin@db1038 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|         0 | NULL         |             1055 |
|         6 | lsearch2     |           126808 |
|        12 | fresheye.com |             5967 |
|        13 | dbpedia      |            38854 |
+-----------+--------------+------------------+
4 rows in set (0.37 sec)

Seems all the NULL are oa_agent are MediaWiki OAI Harvester 0.2 (http://www.mediawiki.org/) (client id: nttr.co.jp; experimental).

Will file a bug for that.

Version: unspecified
Severity: normal

Details

Reference
bz68867
SubjectRepoBranchLines +/-
Get rid of undeployed extension OAI's schema creationmediawiki/extensions/WikimediaMaintenancemaster+0 -1
Stop translating OAItranslatewikimaster+2 -5
Don't branch OAI anymoremediawiki/tools/releasemaster+0 -1
Disable OAI extensionoperations/mediawiki-configmaster+0 -9
Customize query in gerrit

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
OpenNoneT106123 Extensions needing to be removed from Wikimedia wikis
ResolvedAklapperT129864 Archive (or similar) OAI extension
ResolvedReedyT70867 Undeploy OAI extension
ResolvedoriT70538 Get dbpedia off OAI
ResolvedReedyT70866 Get fresheye.com off OAI
ResolvedReedyT70868 Get nttr.co.jp off OAI
· · ·

Event Timeline

• bzimport raised the priority of this task from to Low.Nov 22 2014, 3:36 AM
• bzimport added projects: WMF-General-or-Unknown, Tracking-Neverending.
• bzimport set Reference to bz68867.
• bzimport added a subscriber: Unknown Object (MLST).
Reedy created this task.Jul 30 2014, 5:19 PM
TTO added a comment.Jul 31 2014, 10:23 AM

How does this bug relate to bug 576?

Reedy added a comment.Jul 31 2014, 12:29 PM

(In reply to This, that and the other (TTO) from comment #1)

How does this bug relate to bug 576?

Presumably it doesn't as that's a feature that apparently doesn't exist....

Reedy added a comment.Sep 2 2014, 12:01 AM

mysql:wikiadmin@db1038 [oai]> select oa_agent, count(oa_agent) from oaiaudit where oa_client = 0 group by oa_agent;
+-----------------------------------------------------------------------------------------------+-----------------+

oa_agentcount(oa_agent)

+-----------------------------------------------------------------------------------------------+-----------------+

MediaWiki OAI Harvester 0.2 (http://www.mediawiki.org/) (client id: nttr.co.jp; experimental)5228

+-----------------------------------------------------------------------------------------------+-----------------+
1 row in set (0.58 sec)

mysql:wikiadmin@db1038 [oai]> select oa_agent, count(oa_agent) from oaiaudit group by oa_agent;
+-----------------------------------------------------------------------------------------------+-----------------+

oa_agentcount(oa_agent)

+-----------------------------------------------------------------------------------------------+-----------------+

DBpedia Sync - http://dbpedia.org - morsey@informatik.uni-leipzig.de250216
Java/1.6.0_381061315
MediaWiki OAI Harvester 0.2 (http://www.mediawiki.org/)37351
MediaWiki OAI Harvester 0.2 (http://www.mediawiki.org/) (client id: nttr.co.jp; experimental)5228

+-----------------------------------------------------------------------------------------------+-----------------+
4 rows in set (9.06 sec)

mysql:wikiadmin@db1038 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id group by oa_client;

+-----------+--------------+------------------+

oa_clientou_namecount(oa_client)

+-----------+--------------+------------------+

0NULL5228
6lsearch21061348
12fresheye.com37351
13dbpedia250217

+-----------+--------------+------------------+
4 rows in set (1.48 sec)

mysql:wikiadmin@db1038 [oai]>

hashar renamed this task from Undeploy OAI extension to Undeploy OAI extension (tracking).Nov 25 2014, 2:28 PM
hashar updated the task description. (Show Details)
hashar set Security to None.
Reedy closed subtask T70868: Get nttr.co.jp off OAI as Resolved.Apr 14 2015, 5:16 PM
Reedy added a comment.Apr 14 2015, 5:19 PM

nttr.co.jp are not using it, and no longer is lsearch since January!

Bugreporter added a parent task: T106123: Extensions needing to be removed from Wikimedia wikis.Jul 17 2015, 6:28 AM
Ricordisamoa subscribed.Jul 17 2015, 7:31 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 17 2015, 7:31 AM
Jimkont subscribed.Jul 24 2015, 2:01 PM
• demon subscribed.Aug 13 2015, 4:38 PM

As of today:

mysql:wikiadmin@db1038 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|        12 | fresheye.com |            29986 |
|        13 | dbpedia      |           243113 |
+-----------+--------------+------------------+
2 rows in set (0.30 sec)

Can we work with dbpedia and fresheye.com to not need this anymore?

greg added a comment.Aug 13 2015, 4:53 PM
In T70867#1535693, @demon wrote:

Can we work with dbpedia and fresheye.com to not need this anymore?

There's two blocker bugs with discussion for them. dbpedia needs a working replacement for their use case (not sure if RCStream gives them what they need) and I have no idea if we know anyone at fresheye...

Reedy added a comment.Aug 13 2015, 6:28 PM
mysql:wikiadmin@db1038 [oai]> delete from oaiaudit where oa_timestamp < 20150801000000;
Query OK, 201778 rows affected (19.36 sec)

mysql:wikiadmin@db1038 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|        12 | fresheye.com |             8453 |
|        13 | dbpedia      |            63124 |
+-----------+--------------+------------------+
2 rows in set (0.05 sec)

mysql:wikiadmin@db1038 [oai]
Reedy added a comment.Sep 18 2015, 10:06 AM
mysql:wikiadmin@db1035 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|        12 | fresheye.com |            32820 |
|        13 | dbpedia      |           232478 |
+-----------+--------------+------------------+
2 rows in set (0.41 sec)

mysql:wikiadmin@db1035 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id where oa_timestamp < 20150901000000 group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|        12 | fresheye.com |            20747 |
|        13 | dbpedia      |           149791 |
+-----------+--------------+------------------+
2 rows in set (0.24 sec)

mysql:wikiadmin@db1035 [oai]>
Reedy updated the task description. (Show Details)Sep 18 2015, 10:14 AM
• demon mentioned this in T61702: Examine which extensions are installed on login.wikimedia.org (loginwiki) and vote.wikimedia.org (votewiki).Sep 23 2015, 5:37 PM
Reedy added a comment.Oct 21 2015, 10:37 PM
mysql:wikiadmin@db1035 [oai]> select oa_client, ou_name, count(oa_client) from oaiaudit left join oaiuser on oa_client = ou_id where oa_timestamp >= 20150901000000 and oa_timestamp < 20151001000000 group by oa_client;
+-----------+--------------+------------------+
| oa_client | ou_name      | count(oa_client) |
+-----------+--------------+------------------+
|        12 | fresheye.com |            21127 |
|        13 | dbpedia      |           140873 |
+-----------+--------------+------------------+
2 rows in set (1.07 sec)

mysql:wikiadmin@db1035 [oai]>
gerritbot subscribed.Mar 11 2016, 8:31 PM

Change 276817 had a related patch set uploaded (by Ori.livneh):
Disable OAI extension

https://gerrit.wikimedia.org/r/276817

gerritbot added a project: Patch-For-Review.Mar 11 2016, 8:31 PM

Change 276817 merged by jenkins-bot:
Disable OAI extension

https://gerrit.wikimedia.org/r/276817

ori closed subtask T70538: Get dbpedia off OAI as Resolved.Mar 11 2016, 8:53 PM
Ricordisamoa removed a project: Patch-For-Review.Mar 11 2016, 10:31 PM
Ricordisamoa removed a subscriber: gerritbot.
Reedy raised the priority of this task from Low to High.Mar 14 2016, 12:36 PM
gerritbot added a comment.Mar 14 2016, 12:40 PM

Change 277231 had a related patch set uploaded (by Reedy):
Don't branch OAI anymore

https://gerrit.wikimedia.org/r/277231

gerritbot added a project: Patch-For-Review.Mar 14 2016, 12:40 PM
gerritbot added a comment.Mar 14 2016, 2:07 PM

Change 277237 had a related patch set uploaded (by Reedy):
Stop translating OAI

https://gerrit.wikimedia.org/r/277237

Reedy closed subtask T70866: Get fresheye.com off OAI as Resolved.Mar 14 2016, 2:08 PM
Reedy mentioned this in T129864: Archive (or similar) OAI extension.Mar 14 2016, 3:05 PM
Reedy added a parent task: T129864: Archive (or similar) OAI extension.
Reedy closed this task as Resolved.Mar 15 2016, 12:08 AM
Reedy claimed this task.

It has been disabled

gerritbot added a comment.Mar 15 2016, 12:23 AM

Change 277231 merged by jenkins-bot:
Don't branch OAI anymore

https://gerrit.wikimedia.org/r/277231

gerritbot added a comment.Mar 30 2016, 10:45 AM

Change 277237 merged by jenkins-bot:
Stop translating OAI

https://gerrit.wikimedia.org/r/277237

gerritbot added a comment.May 3 2016, 12:58 AM

Change 286554 had a related patch set uploaded (by Alex Monk):
Get rid of undeployed extension OAI's schema creation

https://gerrit.wikimedia.org/r/286554

gerritbot added a comment.May 3 2016, 1:01 AM

Change 286554 merged by jenkins-bot:
Get rid of undeployed extension OAI's schema creation

https://gerrit.wikimedia.org/r/286554

Reedy mentioned this in T54921: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking).Jul 5 2016, 10:01 AM
jcrespo mentioned this in T139342: DROP OAI-related tables.Jul 5 2016, 10:13 AM
Danny_B removed a parent task: T4007: [DO NOT USE] Tracking bug [superseded by #Tracking].Jul 20 2016, 1:43 AM
Danny_B moved this task from Tag to Should be Goal instead on the Tracking-Neverending board.
• Phabricator_maintenance added a project: Goal.Aug 13 2016, 8:41 PM
• Phabricator_maintenance removed a subscriber: • wikibugs-l-list.
• Phabricator_maintenance renamed this task from Undeploy OAI extension (tracking) to Undeploy OAI extension.Aug 13 2016, 9:49 PM
• Phabricator_maintenance removed a project: Tracking-Neverending.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits