Open Bug 1674060 Opened 4 years ago Updated 2 years ago

Perma Windows ccov-qr or macosx-qr devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. -

Categories

(DevTools :: Accessibility Tools, defect, P5)

Product:
DevTools
Component:
Accessibility Tools
Type:
defect

Tracking

(firefox-esr78 unaffected, firefox82 unaffected, firefox83 unaffected, firefox84 affected)

Tracking Flags:
Tracking Status
firefox-esr78 --- unaffected
firefox82 --- unaffected
firefox83 --- unaffected
firefox84 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=320093790&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/K3UvvVviQqq7GO-Rb5venA/runs/0/artifacts/public/logs/live_backing.log

[task 2020-10-29T06:12:08.311Z] 06:12:08     INFO - TEST-START | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js
[task 2020-10-29T06:12:09.991Z] 06:12:09     INFO - TEST-INFO | started process screenshot
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - TEST-INFO | screenshot: exit 0
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Buffered messages logged at 06:12:08
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Entering test bound a11YPanelTask
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Test Accessibility panel scroll into view pref.
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Adding a new test tab with URL: 'data:text/html;charset=UTF-8,%3Chtml%3E%0A%20%20%3Chead%3E%0A%20%20%20%20%3Cmeta%20charset%3D%22utf-8%22%2F%3E%0A%20%20%20%20%3Ctitle%3EAccessibility%20Panel%20Test%3C%2Ftitle%3E%0A%20%20%3C%2Fhead%3E%0A%20%20%3Cbody%3E%3C%2Fbody%3E%0A%3C%2Fhtml%3E'
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Adding a new tab with URL: data:text/html;charset=UTF-8,%3Chtml%3E%0A%20%20%3Chead%3E%0A%20%20%20%20%3Cmeta%20charset%3D%22utf-8%22%2F%3E%0A%20%20%20%20%3Ctitle%3EAccessibility%20Panel%20Test%3C%2Ftitle%3E%0A%20%20%3C%2Fhead%3E%0A%20%20%3Cbody%3E%3C%2Fbody%3E%0A%3C%2Fhtml%3E
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Tab added and finished loading
[task 2020-10-29T06:12:10.070Z] 06:12:10     INFO - Buffered messages logged at 06:12:09
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO - Waiting for state predicate "state =>
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.accessibles.size === 1 &&
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.details.accessible &&
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.details.accessible.role === "document""
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO - Found state predicate "state =>
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.accessibles.size === 1 &&
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.details.accessible &&
[task 2020-10-29T06:12:10.071Z] 06:12:10     INFO -       state.details.accessible.role === "document""
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO - Check initial state. All filters are disabled (except none). Scroll into view pref disabled.
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO - Checking toolbar state.
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Toolbar state is correct. - 
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO - Checking toolbar prefs state.
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO - Waiting for state predicate "({ ui }) => {
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO -       for (const name in toolbarPrefValues) {
[task 2020-10-29T06:12:10.072Z] 06:12:10     INFO -         if (ui[name] !== toolbarPrefValues[name]) {
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -           return false;
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -         }
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -       }
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO - 
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -       ok(true, "UI pref state is correct.");
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -       return true;
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -     }"
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | UI pref state is correct. - 
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO - Found state predicate "({ ui }) => {
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -       for (const name in toolbarPrefValues) {
[task 2020-10-29T06:12:10.073Z] 06:12:10     INFO -         if (ui[name] !== toolbarPrefValues[name]) {
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -           return false;
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -         }
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -       }
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - 
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -       ok(true, "UI pref state is correct.");
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -       return true;
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO -     }"
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Prefs state is correct. - 
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - Toggle scroll into view checkbox to set the pref. Scroll into view pref should be enabled.
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Expected menu button - 
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Expected menu item - 
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - Buffered messages finished
[task 2020-10-29T06:12:10.074Z] 06:12:10     INFO - TEST-UNEXPECTED-FAIL | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible.```
Summary: Intermittent [tier2] devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. - → Intermittent perma [tier2] devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. -
Summary: Intermittent perma [tier2] devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. - → Intermittent perma Windows ccov devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. -

I'm pretty sure this happened because I switched windows ccov jobs from running without WebRender to running with WebRender. I think this test is permafailing with WebRender regardless of platform, because I'm seeing the same failure on macOS in try pushes where I'm running the devtools mochitests with WR enabled on macOS.

Regressed by: 1669478
Has Regression Range: --- → yes
Keywords: regression
Summary: Intermittent perma Windows ccov devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. - → Perma Windows ccov-qr or macOS devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. -
Summary: Perma Windows ccov-qr or macOS devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. - → Perma Windows ccov-qr or macosx-qr devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Menu item is visible. -

Also note that there's two tests failing here: browser_accessibility_panel_toolbar_pref_scroll.js and browser_accessibility_simulation.js. The latter actually checks for WR being enabled and takes a different codepath so presumably the bug is in the test rather than in the WR code, but I don't know for sure.

Set release status flags based on info from the regressing bug 1669478

status-firefox82: --- → unaffected
status-firefox83: --- → unaffected
status-firefox84: --- → affected
status-firefox-esr78: --- → unaffected
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.