This task represents the work with running an A/B test to evaluate whether disabling the MobileFrontend talk page overlay and introducing the mobile Reply Tool, New Discussion Tool, Topic Subscriptions, and Usability has caused:
1. Junior Contributors to be more successful publishing new talk page comments and discussion topics
2. Junior Contributors to more quickly recognize talk pages as spaces to communicate with other volunteers
3. Senior Contributors to assess the level of activity on a talk page with less effort
4. People, across experience levels, to receive more timely responses to the talk page comments they post and discussion topics they start.
=== Decision to be made
This A/B test will help us make the following decision: **Are the [set of mobile Talk Pages Project features](https://www.mediawiki.org/wiki/Talk_pages_project#Active_initiatives) fit to be made available to everyone, at all wikis, by default?**
//Note: we have yet to define what "more people" means in this context and defining it depends on knowing all of the people who have access to the sticky header at the time the test is run.//
=== Hypotheses
To help evaluate the impact of the impact of introducing an edit affordance within desktop reading experience's fixed "sticky" site header, **we would like to know if doing so...**
|ID|Hypothesis|Metric(s) for evaluation
|---|---|---
|KPI|. | .
|Curiosity #1| .|.
|Guardrail #1|.|.
=== Decision Matrix
|ID|Scenario|Plan of action
|---|---|---
|1.| .| .
=== Wikis
//This section will contain the list of wikis participating in the A/B test.//
NOTE: In aggregate, there should be at least **2,000 people** using mobile web talk pages at the wikis included in the A/B test and a minimum of **15 distinct wikis** included in the test. Also, to draw conclusions about any individual wiki in the test, there will need to be ~200 unique people using talk pages while the test is running. //More in T298271#7641238.//
=== Open Questions
- [ ] 1. Per [the question](https://docs.google.com/document/d/1cE-Puua7_HEkUn8p5z2-YHNr5M2QknPSdSW8BtrA3tY/edit?disco=AAAARsV4Lww) @dchan raised in [Editing Scratch](https://docs.google.com/document/d/1cE-Puua7_HEkUn8p5z2-YHNr5M2QknPSdSW8BtrA3tY/edit), how long do anticipate the A/B test needing to run given the number of people using mobile talk pages and they frequency with which they are using them? //See T295180 for more details on mobile talk page usage.//
- [ ] 2. Should the A/B test be limited to wikis that have **NOT** had access to any mobile talk page improvements via T298221 or T298222 to-date? //See T297448#7575858 for more context.//
=== Done
- [ ] A report is published that evaluates the `===Hypotheses` above