121 Commits

Author SHA1 Message Date
Jim Graham
0e92250c2a Display list test executables (flutter/engine#32973) 2022-04-27 17:04:07 -07:00
Chris Bracken
92e109f579 Add API consistency test (flutter/engine#32408) 2022-04-07 15:26:04 -07:00
gaaclarke
9b0587193e added dart plugin registrant test executables to run_tests.py (flutter/engine#31726) 2022-02-28 19:51:57 -08:00
godofredoc
65ca495690 Skip font-tests for host_profile variants. (flutter/engine#31515)
font-tests are not built by default in the host_profile variant. The
test was working properly because all the variants were being built
sequentially in the same host. With the separation of builds and tests
every variant is built in a separate host and host_profile does not have
access to font-tests built by host_debug.

Bug: https://github.com/flutter/flutter/issues/98642
2022-02-17 09:13:52 -08:00
Chris Bracken
81c662ef3d Enable a11y unittests on Windows (flutter/engine#31387)
This enables accessibility unittests on Windows as part of our CI testing.

It also corrects two unit tests which were fixed by
https://github.com/flutter/engine/pull/29773, which fixed
https://github.com/flutter/flutter/issues/78460.

Finally it disables an AXFragmentRoot test that times out. We don't use
AXFragmentRoot in Flutter as it's only used with UI Automation APIs,
which Flutter does not use (we use MSAA).

Issue: https://github.com/flutter/flutter/issues/98225
2022-02-12 12:51:01 -08:00
Zachary Anderson
fd6043f0de Adds impeller_unittests to run_tests.py (flutter/engine#31280) 2022-02-07 18:05:56 -08:00
Emmanuel Garcia
6d8f65e672 Parallelize Android unit tests (flutter/engine#30728) 2022-02-04 16:15:09 -08:00
Daco Harkes
3f08ba3ad1 Migrate run_tests.py to dart pub get (flutter/engine#31181) 2022-02-01 23:12:27 -08:00
eggfly
dae2e15222 Add more info for --type in run_tests.py and add android into all type (flutter/engine#30458) 2021-12-28 09:29:10 -08:00
Jenn Magder
cb6cd0a3e8 Update IosUnitTests to use iPhone 11 simulator (flutter/engine#30090) 2021-12-03 10:49:02 -08:00
Clement Skau
9d35daaffd [test] Fixes testing/run_tests.py py3 support. (flutter/engine#29611) 2021-11-10 09:02:45 +01:00
Chris Bracken
5fea3a3568 Re-enable embedder tests on Windows (flutter/engine#29624)
Issue: https://github.com/flutter/flutter/issues/36294
2021-11-09 13:41:59 -08:00
Chris Yang
b7e0926db9 ios test script checks for ios_test_flutter artifacts (flutter/engine#29554) 2021-11-05 14:43:01 -07:00
Dan Field
293ef51fc6 Reland Android systrace (flutter/engine#29080)
* Reland "Use the systrace recorder if systracing is enabled at startup, and enable systracing in release mode on Android (#28903)" (#29071)"

This reverts commit a7660964b41f64991369341364a43c93317a4a51.

* More logcat

* more logs

* Remove wait

* Avoid plugin registrar exception

* DEFAULT instead of LAUNCHER

* use am instead of monkey

* Update android_systrace_test.py
2021-10-08 15:55:50 -07:00
Zachary Anderson
a7660964b4 Revert "Use the systrace recorder if systracing is enabled at startup, and enable systracing in release mode on Android (#28903)" (flutter/engine#29071)
This reverts commit 79063b3c6105c3cf8be757ed6d31dd9a055060d9.
2021-10-07 22:08:10 -07:00
Dan Field
79063b3c61 Use the systrace recorder if systracing is enabled at startup, and enable systracing in release mode on Android (flutter/engine#28903) 2021-10-07 15:59:46 -07:00
gaaclarke
bde0f38b61 made it so you can specify which adb to use for android tests (flutter/engine#28975) 2021-09-30 16:37:24 -07:00
gaaclarke
fb483ee0d6 made android unit tests not require the host engine variant to exist (flutter/engine#28925) 2021-09-29 10:07:33 -07:00
gaaclarke
452b0bd2f9 added unit tests for the android embedder that run on android devices (flutter/engine#28784) 2021-09-28 14:02:18 -07:00
Zachary Anderson
75c1fbccc7 Don't use Dart's application_snapshot() rule (flutter/engine#28361) 2021-09-16 13:37:01 -07:00
Jason Simmons
a00125e2e4 Run the Android Robolectric tests using Gradle (flutter/engine#28084) 2021-08-25 09:11:02 -07:00
Brandon DeRosier
bb11686888 Symbolize ASan traces when using run_tests.py (flutter/engine#28274)
* Configure ASan to symbolize on linux

* Supply ASAN_SYMBOLIZER_PATH when running tests, fix problem with line stripping in run_tests
2021-08-23 16:43:01 -07:00
Matej Knopp
b48f5143ac Enable repeat for desktop embedder tests (flutter/engine#28253) 2021-08-23 09:07:02 -07:00
Brandon DeRosier
a5adf663ce Make run_tests.py suppressions flag fail with a clear error on unsupported platforms (flutter/engine#28235) 2021-08-20 14:48:30 -07:00
Anthony
50adf078fd [Re-land] Add SPIR-V FragmentShader API to painting.dart (flutter/engine#28208)
[Re-land] Add SPIR-V FragmentShader API to painting.dart

- Add a SPIR-V FragmentShader interface in painting.dart
- Create end to end pixel tests for ops supported by the SPIR-V to SkSL transpiler
- The end to end tests also test the c++ fragment shader implementation

Co-authored-by: Christopher Crawford <chriscraws@gmail.com>
2021-08-20 11:24:14 -04:00
Zachary Anderson
e3f282c563 Revert "Add SPIR-V FragmentShader API to painting.dart (#26996)" (flutter/engine#28202)
This reverts commit 1b518619357cc1666a9fca183c9766d1ece16d0f.
2021-08-19 12:38:10 -07:00
Emmanuel Garcia
1a9e4c4ff3 Bump Android version and add more info to create_sdk_cipd_package.sh (flutter/engine#27413) 2021-08-18 18:22:02 -07:00
Anthony
1b51861935 Add SPIR-V FragmentShader API to painting.dart (flutter/engine#26996)
Add SPIR-V FragmentShader API to painting.dart
2021-08-18 12:58:25 -04:00
Brandon DeRosier
792f013ddb Use the suppressions script to source runtime suppressions in run_tests.py (flutter/engine#28140) 2021-08-17 14:34:24 -07:00
Brandon DeRosier
0d81592d40 Add asan flag to run_tests.py (flutter/engine#28082) 2021-08-13 14:26:19 -07:00
Emmanuel Garcia
604089b0fd Provide Open JDK 11 (flutter/engine#27942) 2021-08-11 12:34:11 -07:00
Jason Simmons
5126dfe55e Python 3 compatibility fix for running Java tests using run_tests.py (flutter/engine#27970)
(Note that LUCI is currently still running this script using Python 2)
2021-08-11 11:00:57 -07:00
Jenn Magder
b5409c0989 Allow iOS unit tests to run on Xcode 13 (flutter/engine#27850) 2021-08-02 14:25:02 -07:00
Chris Bracken
8803824c64 Migrate all Python hashbangs to Python 3 (flutter/engine#27838)
Migrates all `#!/usr/bin/env python` hashbang lines to use python3.

Also updates the licence tool to treat python3 scripts on par with
python 2 scripts.

Issue: https://github.com/flutter/flutter/issues/83043
2021-07-31 11:09:12 -07:00
Jason Simmons
497e812a04 Add a run_tests flag that captures core dumps from engine unit tests and runs a GDB script (flutter/engine#27742) 2021-07-29 23:09:04 -07:00
eggfly
a869375cd7 Re-enable fml_unittests (flutter/engine#27664) 2021-07-26 09:38:01 -07:00
George Wright
868320cb91 Update test scripts for coverage (flutter/engine#27659) 2021-07-23 13:13:34 -07:00
gaaclarke
61d6663a04 Added a test filter for objc tests (flutter/engine#27566) 2021-07-19 19:51:01 -07:00
Zachary Anderson
ac95dbd5bc Build testing/dart snapshots with GN instead of in run_tests.py (flutter/engine#27292) 2021-07-09 14:27:48 -07:00
Zachary Anderson
778fcfff51 Fix host_release tests for prebuilt Dart SDK (flutter/engine#27284) 2021-07-09 11:58:57 -07:00
Dan Field
8ab4d95ea5 Partial reland for VM tests (flutter/engine#27069) 2021-06-30 10:54:50 -07:00
Dan Field
81388c9511 Revert "--sound-null-safety instead of enable-experiment where possible (#26999)" (flutter/engine#27059)
This reverts commit a34de4830b50728b589903abfe69a7d809967b73.
2021-06-29 21:36:07 -07:00
Dan Field
a34de4830b --sound-null-safety instead of enable-experiment where possible (flutter/engine#26999) 2021-06-29 15:36:03 -07:00
Jason Simmons
663678b9de Use unstripped executables when running tests on Linux (flutter/engine#26921) 2021-06-29 07:31:02 -07:00
Zachary Anderson
39f533c8b8 Make ci/lint.dart more idiomatic and move to tools/clang_tidy (flutter/engine#26722) 2021-06-22 20:36:01 -07:00
Zachary Anderson
23cb015a33 Add pre-push git hook (flutter/engine#26699) 2021-06-20 16:12:53 -07:00
godofredoc
fe04881df4 Remove gn. ninja commands from test runner. (flutter/engine#26822)
* Remove gn. ninja commands from test runner.

* Fix formatting issues.

* Remove trailing space.

* Initialize command variable.
2021-06-18 17:18:11 -07:00
godofredoc
f7ececee99 Revert "Remove autoninja calls from the analyze script. (#26752)" (flutter/engine#26812)
This reverts commit 0f363535ba38fb4faed1a17bd9ab8636be258ef4.
2021-06-17 14:56:15 -07:00
godofredoc
0f363535ba Remove autoninja calls from the analyze script. (flutter/engine#26752)
* Remove autoninja calls from the analyze script.

Calling autoninja from this script is preventing the roll of new depot
tools that requires autoninja to run from inside a goma context.

Bug: https://github.com/flutter/flutter/issues/84618

* Also remove gn commands.

* Comment the gn/ninja commands to build java tests.

* Remove the ninja command.

* Remove steps to build host_debug from tests.

* Assert folder exists.

* Remove outdated code.

* Fix path joining instructions.
2021-06-17 14:26:37 -07:00
Zachary Anderson
cd45fc09ea Make litetest throw on test failure instead of exit() (flutter/engine#26462) 2021-05-27 18:03:50 -07:00