Generate FYI bot config for linux-blink-wpt-reset-rel.
Updates trybot configs to add a blink web/wpt test runner that resets
the BrowsingInstance in between every test. Flakiness data from this bot will be compared the wpt/web test flakiness on linux-rel to determine which tests may benefit from having the reset applied.
This bot is modeled on linux-blink-rel, but with a longer timeout since the BrowsingInstance reset slows down the tests.
Bug: 1227911, 1366972
Change-Id: Ib71396f7e0d273913eceba3ebc65fd7435a2a777
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/3869445
Commit-Queue: James Maclean <[email protected]>
Reviewed-by: Ben Pastene <[email protected]>
Cr-Commit-Position: refs/heads/main@{#1055354}
diff --git a/testing/buildbot/test_suite_exceptions.pyl b/testing/buildbot/test_suite_exceptions.pyl
index b5d4831..6059d34e 100644
--- a/testing/buildbot/test_suite_exceptions.pyl
+++ b/testing/buildbot/test_suite_exceptions.pyl
@@ -464,6 +464,18 @@
'--flag-specific=force-renderer-accessibility',
],
},
+ 'linux-blink-wpt-reset-rel': {
+ 'args': [
+ '--additional-driver-flag=--force-browsing-instance-reset-between-tests',
+ ],
+ # The flag above will slow the tests down, and we don't want the bot to
+ # timeout, so set a higher timeout here.
+ # TODO(wjmaclean): It would be nice if we could somehow specify a delta
+ # to the default/inherited timeout instead of an absolute.
+ 'swarming': {
+ 'hard_timeout': 1500,
+ },
+ },
'linux-code-coverage': {
'args': [
'--additional-env-var=LLVM_PROFILE_FILE=${ISOLATED_OUTDIR}/profraw/default-%2m.profraw',
@@ -762,6 +774,11 @@
'--flag-specific=force-renderer-accessibility',
],
},
+ 'linux-blink-wpt-reset-rel': {
+ 'args': [
+ '--additional-driver-flag=--force-browsing-instance-reset-between-tests',
+ ],
+ },
'linux-code-coverage': {
'args': [
'--additional-env-var=LLVM_PROFILE_FILE=${ISOLATED_OUTDIR}/profraw/default-%2m.profraw',
