[go: up one dir, main page]

Page MenuHomePhabricator

Exploratory testing of Zebra update
Closed, ResolvedPublic3 Estimated Story PointsBUG REPORT

Description

Before we roll out the Zebra update as an A/B test, we'd like to do some exploratory testing of the update (as a sanity check) to ensure there are no regressions when compared with the current (non feature flagged) version.

Main namespace

Check article pages across different projects. Things to look out for:

  • Are indicators positioned correctly.
  • Does the ToC look as expected in all it's configurations? (in sidebar, near page title, in sticky header, at narrow resolutions)
  • ToC headings that contain html, like <em> or <strong> tags.

Talk pages

  • Does the TOC look correct on talk pages?
  • Do large templates like on the Village pump look correct?

Special pages

  • Do special page, e.g. recent changes, history page, still look correct?

Editing workflow

  • When going through a basic editing workflow, can users still edit/preview/save changes correctly?
  • Does the visualEditor toolbar still look correct?
  • Does the source editor still look correct?

General layout

  • Does full-width layout look correct? Full/fixed width toggle still works.
  • All menus look as they should. E.g: Long menu items don't cause horizontal scrolling, words wrap as expected, long menus can be scrolled normally.
  • ToC and Page Tools remain sticky when scrolling.
  • ToC sections still expand and collapse as expected.

Event Timeline

LGoto set the point value for this task to 3.
LGoto subscribed.

Edward let us know if you want to adjust the estimate.

Change 917887 had a related patch set uploaded (by Jdrewniak; author: Jdrewniak):

[mediawiki/skins/Vector@master] [Zebra] Remove horizontal scrolling from ToC

https://gerrit.wikimedia.org/r/917887

Just FYI I'm attaching any bug fixes related to newly found Zebra bugs to this ticket. The patch above resolved a horizontal scrolling issue found by @Jdlrobson on the Zebra ToC.

screenshot_2023-05-08_at_3.18.08_pm_480.png (480×363 px, 54 KB)

Change 917887 merged by jenkins-bot:

[mediawiki/skins/Vector@master] [Zebra] Remove horizontal scrolling from ToC

https://gerrit.wikimedia.org/r/917887

Edtadros subscribed.

Test Result - Beta

Status: ❌ / ❓
Environment: beta, hebeta
OS: macOS Ventura
Browser: Chrome
Device: MBP
Emulated Device:NA

Test Artifact(s):

QA Steps

@Jdrewniak see below.

❓ AC1: Main namespace
Check article pages across different projects. Things to look out for:

  • ❌ Are indicators positioned correctly.

I added a good article indicator to the page. The coordinates don't play nice with it. This happens without zebra as well.

Screenshot 2023-05-09 at 7.39.31 PM.png (485×1 px, 153 KB)

  • ❓ Does the ToC look as expected in all it's configurations? (in sidebar, near page title, in sticky header, at narrow resolutions)

Long section headings look like this. Is this the correct behavior?

Screenshot 2023-05-09 at 7.43.21 PM.png (650×1 px, 224 KB)

  • ✅ ToC headings that contain html, like <em> or <strong> tags.

Screenshot 2023-05-09 at 7.57.41 PM.png (860×820 px, 240 KB)

❌ AC2: Talk pages

  • ✅ Does the TOC look correct on talk pages?
Screenshot 2023-05-09 at 8.06.42 PM.png (749×925 px, 198 KB)
Screenshot 2023-05-09 at 8.06.51 PM.png (822×851 px, 243 KB)
Screenshot 2023-05-09 at 8.07.06 PM.png (821×1 px, 181 KB)
  • ❌ Do large templates like on the Village pump look correct?

Screenshot 2023-05-09 at 8.10.48 PM.png (938×1 px, 250 KB)

✅ AC3: Special pages

  • ✅ Do special page, e.g. recent changes, history page, still look correct?
Screenshot 2023-05-09 at 8.13.43 PM.png (1×1 px, 274 KB)
Screenshot 2023-05-09 at 8.16.04 PM.png (1×1 px, 321 KB)
Screenshot 2023-05-09 at 8.17.19 PM.png (891×1 px, 329 KB)

✅ AC4: Editing workflow

  • ✅ When going through a basic editing workflow, can users still edit/preview/save changes correctly?
  • ✅ Does the visualEditor toolbar still look correct?
Screenshot 2023-05-10 at 10.25.42 AM.png (377×1 px, 70 KB)
Screenshot 2023-05-10 at 10.26.22 AM.png (543×1 px, 196 KB)
  • ✅ Does the source editor still look correct?
Screenshot 2023-05-10 at 10.24.44 AM.png (384×1 px, 80 KB)
Screenshot 2023-05-10 at 10.24.31 AM.png (502×1 px, 151 KB)

✅ AC5: General layout

  • ✅ Does full-width layout look correct? Full/fixed width toggle still works.
  • ✅ All menus look as they should. E.g: Long menu items don't cause horizontal scrolling, words wrap as expected, long menus can be scrolled normally.
  • ✅ ToC and Page Tools remain sticky when scrolling.
  • ✅ ToC sections still expand and collapse as expected.

Thanks @Edtadros I've made a ticket for the coordinates issue https://phabricator.wikimedia.org/T336876 other than that, the following are non-issues so I think this ticket can be signed off.

  • The very wide TOC is intentional. We made the dropdown TOC able to be very wide to accommodate talk-page better (which typically have longer headings).
  • The Village pump template is also a non-issue. It looks like the template on beta is outdated, and the village pump template in production is actually quite responsive.
bwang removed bwang as the assignee of this task.
bwang subscribed.