commit | a7fda17019fb0c5ed3ddbd787af288c440ddc21b | [log] [tgz] |
---|---|---|
author | seobrien <seobrien@chromium.org> | Fri Oct 20 15:49:26 2023 |
committer | Chromeos LUCI <chromeos-scoped@luci-project-accounts.iam.gserviceaccount.com> | Mon Oct 23 21:37:56 2023 |
tree | 2a1d9b4fd4ef1223fc2a0dafcc898b5fb3955823 | |
parent | 6a1a3f5aa8dfa163e0506363c99626e05d51b01e [diff] |
Make score threshold for regression more lenient The preupload check uses 10 significant figures to check that the score hasn't changed. This is excessive and reports many false regressions. This CL reduces the threshold to 5 significant figures. BUG=b:268180311 TEST=run preupload check fro gestures repo. tests no longer fail with a delta of `-0.0000` Change-Id: I41f44aa1f572055f4b779e730a206e28edca1def Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/platform/touchpad-tests/+/4958758 Reviewed-by: Henry Barnor <hbarnor@chromium.org> Commit-Queue: Sean O'Brien <seobrien@chromium.org> Tested-by: Sean O'Brien <seobrien@chromium.org>
This repository contains automated tests for Chromium OS's Gestures library. Each test has a log of evdev events which are replayed, a properties file containing gesture properties to set while the Gestures library runs, and a Python function which verifies the output and returns a test score.
Assuming that you've followed the developer guide, simply run the following inside your chroot:
(inside) $ cd ~/trunk/src/platform/touchpad-tests $ sudo make setup-in-place
To run all tests, simply run touchtests
. To run one or more specific tests, you can pass a test name or a glob:
(inside) $ touchtests atlas-1.0/fat-thumb-fail $ touchtests atlas-1.0/palm-while-typing*
Each test will return a status, with the following meanings:
The --out
(or -o
) switch creates a report file that future runs can be compared against with the --ref
(or -r
) switch:
(inside) $ touchtests --out baseline.json # (cause some regressions) $ touchtests --ref baseline.json
The output table will contain a delta column that indicates any regressions or improvements, and an error message will be shown if regressions exist.