dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 1 | # Accessibility |
| 2 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 3 | Here's a quick overview of all of the locations in the codebase where you'll |
| 4 | find accessibility tests, and a brief overview of the purpose of all of them. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 5 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 6 | ## Web Tests |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 7 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 8 | This is the primary place where we test accessibility code in Blink. This code |
| 9 | should have no platform-specific code. Use this to test anything where there's |
| 10 | any interesting web platform logic, or where you need to be able to query things |
| 11 | synchronously from the renderer thread to test them. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 12 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 13 | Don't add tests for trivial features like ARIA attributes that we just expose |
| 14 | directly to the next layer up. In those cases the Blink tests are trivial and |
| 15 | it's more valuable to test these features at a higher level where we can ensure |
| 16 | they actually work. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 17 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 18 | Note that many of these tests are inherited from WebKit and the coding style has |
| 19 | evolved a lot since then. Look for more recent tests as a guide if writing a new |
| 20 | one. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 21 | |
| 22 | Test files: |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 23 | [third_party/blink/web_tests/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:third_party/blink/web_tests/accessibility/) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 24 | |
| 25 | Source code to AccessibilityController and WebAXObjectProxy: |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 26 | [content/web_test/renderer](https://source.chromium.org/chromium/chromium/src/+/main:content/web_test/renderer/) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 27 | |
Josiah K | c405f43 | 2020-09-02 04:30:19 | [diff] [blame] | 28 | First, you'll need to build the tests: |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 29 | ``` |
Josiah K | c405f43 | 2020-09-02 04:30:19 | [diff] [blame] | 30 | autoninja -C out/release blink_tests |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 31 | ``` |
| 32 | |
Josiah K | c405f43 | 2020-09-02 04:30:19 | [diff] [blame] | 33 | Then, to run all accessibility web tests: |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 34 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 35 | ``` |
Josiah K | c405f43 | 2020-09-02 04:30:19 | [diff] [blame] | 36 | third_party/blink/tools/run_web_tests.py --build-directory=out --target=release accessibility/ |
| 37 | ``` |
| 38 | |
| 39 | Or, to run just one test by itself, without invoking the `run_web_tests.py` script: |
| 40 | |
| 41 | ``` |
| 42 | out/release/content_shell \ |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 43 | --run-web-tests third_party/blink/web_tests/accessibility/name-calc-inputs.html |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 44 | ``` |
| 45 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 46 | For information on modifying or adding web tests, see the main |
Kyungjun Lee | 91806c6 | 2022-10-10 22:24:57 | [diff] [blame^] | 47 | [web tests documentation](../../testing/web_tests.md). |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 48 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 49 | ## DumpAccessibilityTree tests |
| 50 | |
| 51 | This is the best way to write both cross-platform and platform-specific tests |
| 52 | using only an input HTML file, some magic strings to describe what attributes |
| 53 | you're interested in, and one or more expectation files to enable checking |
| 54 | whether the resulting accessibility tree is correct or not. In particular, |
| 55 | almost no test code is required. |
| 56 | |
Kyungjun Lee | 91806c6 | 2022-10-10 22:24:57 | [diff] [blame^] | 57 | [More documentation on DumpAccessibilityTree](../../../content/test/data/accessibility/readme.md) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 58 | |
| 59 | Test files: |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 60 | [content/test/data/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:content/test/data/accessibility/) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 61 | |
| 62 | Test runner: |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 63 | [content/browser/accessibility/dump_accessibility_tree_browsertest.h](https://source.chromium.org/chromium/chromium/src/+/main:content/browser/accessibility/dump_accessibility_tree_browsertest.h) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 64 | |
| 65 | To run all tests: |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 66 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 67 | ``` |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 68 | autoninja -C out/release content_browsertests && \ |
Mark Schillaci | 00c48fb | 2019-12-06 18:46:02 | [diff] [blame] | 69 | out/release/content_browsertests --gtest_filter="All/DumpAccessibilityTree*" |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 70 | ``` |
| 71 | |
| 72 | ## Other content_browsertests |
| 73 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 74 | There are many other tests in content/ that relate to accessibility. All of |
| 75 | these tests work by launching a full multi-process browser shell, loading a web |
| 76 | page in a renderer, then accessing the resulting accessibility tree from the |
| 77 | browser process, and running some test from there. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 78 | |
| 79 | To run all tests: |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 80 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 81 | ``` |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 82 | autoninja -C out/release content_browsertests && \ |
| 83 | out/release/content_browsertests --gtest_filter="*ccessib*" |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 84 | ``` |
| 85 | |
| 86 | ## Accessibility unittests |
| 87 | |
| 88 | This tests the core accessibility code that's shared by both web and non-web |
| 89 | accessibility infrastructure. |
| 90 | |
| 91 | Code location: |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 92 | [ui/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:ui/accessibility/) |
| 93 | and subdirectories; check the |
| 94 | [`*_unittest.cc` files](https://source.chromium.org/search?q=path:accessibility%20path:_unittest&sq=&ss=chromium%2Fchromium%2Fsrc:ui%2Faccessibility%2F), |
| 95 | next to every file that it's being tested. |
| 96 | |
| 97 | List of sources: |
| 98 | [ui/accessibility/BUILD.gn](https://source.chromium.org/chromium/chromium/src/+/main:ui/accessibility/BUILD.gn?q=%22test(%22accessibility_unittests%22)%20%7B%22) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 99 | |
| 100 | To run all tests: |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 101 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 102 | ``` |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 103 | autoninja -C out/release accessibility_unittests && \ |
| 104 | out/release/accessibility_unittests |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 105 | ``` |
| 106 | |
| 107 | ## ChromeVox tests |
| 108 | |
James Cook | 1380ad16 | 2018-10-25 00:51:19 | [diff] [blame] | 109 | ChromeVox tests are part of the browser_tests suite. You must build with |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 110 | `target_os = "chromeos"` in your GN args. |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 111 | |
| 112 | To run all tests: |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 113 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 114 | ``` |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 115 | autoninja -C out/release browser_tests && \ |
| 116 | out/release/browser_tests --test-launcher-jobs=20 --gtest_filter=ChromeVox* |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 117 | ``` |
| 118 | |
Katie Dektar | 4a165e1b | 2017-09-27 16:15:13 | [diff] [blame] | 119 | ### Select-To-Speak tests |
| 120 | |
| 121 | ``` |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 122 | autoninja -C out/Default unit_tests browser_tests && \ |
| 123 | out/Default/unit_tests --gtest_filter=*SelectToSpeak* && \ |
| 124 | out/Default/browser_tests --gtest_filter=*SelectToSpeak* |
Katie Dektar | 4a165e1b | 2017-09-27 16:15:13 | [diff] [blame] | 125 | ``` |
| 126 | |
Dominic Mazzoni | b11c82d | 2018-08-29 17:01:58 | [diff] [blame] | 127 | ## Performance tests |
| 128 | |
Kyungjun Lee | 91806c6 | 2022-10-10 22:24:57 | [diff] [blame^] | 129 | We also have a page on [Performance Tests](./perf.md). |
Dominic Mazzoni | b11c82d | 2018-08-29 17:01:58 | [diff] [blame] | 130 | |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 131 | ## Other locations of accessibility tests: |
| 132 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 133 | Even this isn't a complete list. The tests described above cover more than 90% |
| 134 | of the accessibility tests, and the remainder are scattered throughout the |
| 135 | codebase. Here are a few other locations to check: |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 136 | |
Jacobo Aragunde Pérez | ae45fe8 | 2021-10-28 09:04:29 | [diff] [blame] | 137 | * [chrome/android/javatests/src/org/chromium/chrome/browser/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:chrome/android/javatests/src/org/chromium/chrome/browser/accessibility/) |
| 138 | * [chrome/browser/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:chrome/browser/accessibility/) |
| 139 | * [chrome/browser/ash/accessibility/](https://source.chromium.org/chromium/chromium/src/+/main:chrome/browser/ash/accessibility/) |
| 140 | * [ui/chromeos](https://source.chromium.org/chromium/chromium/src/+/main:ui/chromeos/) |
| 141 | * [ui/views/accessibility](https://source.chromium.org/chromium/chromium/src/+/main:ui/views/accessibility/) |
dmazzoni | 9cd17124 | 2017-03-02 06:58:46 | [diff] [blame] | 142 | |
Katie Dektar | 4a165e1b | 2017-09-27 16:15:13 | [diff] [blame] | 143 | ## Helpful flags: |
| 144 | |
| 145 | Across all tests there are some helpful flags that will make testing easier. |
| 146 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 147 | * Run tests multiple times in parallel (useful for finding flakes): |
| 148 | `--test-launcher-jobs=10` |
Katie Dektar | 4a165e1b | 2017-09-27 16:15:13 | [diff] [blame] | 149 | |
Aran Gilman | e7035589cd | 2019-05-01 23:47:30 | [diff] [blame] | 150 | * Filter which tests to run: `--gtest_filter="*Cats*"` |