[go: up one dir, main page]

Page MenuHomePhabricator

Image instrumentation: minimal quality gate
Closed, ResolvedPublic

Description

Associated feature: T293316: Add an image: minimal quality gate


After the user completes their 25th suggestion of the day, they will start encountering the quality gate. We should record events around these actions:

  • User completes 25th suggestion of the day (counting "yes" and "no", but not "skip").
  • When the user is navigating their suggested edits feed and taps on an image task, triggering the dialog telling them they have reached their limit.

Event Timeline

Change 737126 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/GrowthExperiments@master] Add Image: Instrumentation for quality gate dialogs

https://gerrit.wikimedia.org/r/737126

Sample events:

dailyLimit quality gate:

event: {
     "action": "impression",
     "action_data": "dailyLimit",
     "is_mobile": true,
     "active_interface": "qualitygate_dialog",
     "newcomer_task_token": "ce54037df45c71a64c2b",
     "page_id": 1620,
     "page_title": "Ma'amoul",
     "homepage_pageview_token": "on0toqau638njocngctcqts48gschts7",
     "$schema": "/analytics/mediawiki/structured_task/article/image_suggestion_interaction/1.1.0",
     "meta": {
       "stream": "mediawiki.structured_task.article.image_suggestion_interaction",
       "domain": "localhost",
       "id": "89f5a491-c022-406c-a75b-3d37ad983e22",
       "dt": "2021-11-05T20:48:41.724Z",
       "request_id": "c286c5a0-3e79-11ec-88e8-4db7b1fa7a98"
     },
     "dt": "2021-11-05T20:48:40.711Z",
     "http": {
       "request_headers": {
         "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:92.0) Gecko/20100101 Firefox/92.0"
       },
       "client_ip": "127.0.0.1"
     }
   }

mobileOnly quality gate:

event: {
  "action": "impression",
  "action_data": "mobileOnly",
  "is_mobile": false,
  "active_interface": "qualitygate_dialog",
  "newcomer_task_token": "b8602392c3099751e6cf",
  "page_id": 1620,
  "page_title": "Ma'amoul",
  "homepage_pageview_token": "h7dd8c67pf8fqnv7c2eku47l77d5ggmn",
  "$schema": "/analytics/mediawiki/structured_task/article/image_suggestion_interaction/1.1.0",
  "meta": {
    "stream": "mediawiki.structured_task.article.image_suggestion_interaction",
    "domain": "localhost",
    "id": "4e05bbfe-9c1b-40d4-8b6f-06384221e74c",
    "dt": "2021-11-05T20:45:01.370Z",
    "request_id": "3f2f9290-3e79-11ec-88e8-4db7b1fa7a98"
  },
  "dt": "2021-11-05T20:45:00.368Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:92.0) Gecko/20100101 Firefox/92.0"
    },
    "client_ip": "127.0.0.1"
  }
}

Change 737126 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] Add Image: Instrumentation for quality gate dialogs

https://gerrit.wikimedia.org/r/737126

Checked - both events are present.

Note: "action_data": "dailyLimit" is only for Special:Homepage dialog.
When the post-edit dialog with the quality gate message "All available add image articles for today are complete." appears, there will be no additional events for that aside from HelpPanel post-edit impression event:

Screen Shot 2021-11-30 at 4.14.56 PM.png (718×1 px, 103 KB)

{event: {…}, schema: 'HelpPanel', webHost: 'en.wikipedia.beta.wmflabs.org', wiki: 'enwiki', $schema: '/analytics/legacy/helppanel/1.1.0', …}
$schema: "/analytics/legacy/helppanel/1.1.0"
client_dt: "2021-12-01T00:13:47.152Z"
event: {action: 'postedit-impression', action_data: 'type=small;savedTaskType=image-recommendation', user_id: 6900, user_editcount: 135, context: 'postedit', …}
meta: {stream: 'eventlogging_HelpPanel', domain: 'en.wikipedia.beta.wmflabs.org'}
schema: "HelpPanel"
webHost: "en.wikipedia.beta.wmflabs.org"
wiki: "enwiki"

Based on event data, this is working, the mobileOnly event occurs every now and then in our data (nobody's hitting the daily limit, but from our leading indicators I'd be surprised if they did). Closing as resolved.