Commit Graph

92 Commits

Author SHA1 Message Date
Ryan VanderMeulen
db9cc2a062 Merge inbound to m-c. a=merge 2014-08-09 11:19:46 -04:00
Sylvestre Ledru
ac9d156829 Bug 1050715 - Update the description of the various tests targed proposed by './mach help' r=jmaher
--HG--
extra : rebase_source : 29019a02711ffce5c148787517051855259b6446
2014-08-09 15:37:29 +02:00
Gijs Kruitbosch
dd90c545b0 Bug 1051066 - fix mochitest-chrome for single test runs, r=ted
--HG--
extra : rebase_source : 85ddaf183d33014d86b5659db10871b9ae2abc94
2014-08-09 09:26:53 +01:00
Ryan VanderMeulen
d4a25b4a60 Merge fx-team to m-c. a=merge 2014-08-07 17:24:52 -04:00
Steven Lee
aa3d6c0c8a Bug 1046515 - Add support for the "repeat" and "run-until-failure" mach commands on B2G. r=ahal 2014-08-04 23:29:00 -04:00
Ahmed Kachkach
3971b1c36d Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
e1ddcc3365 Bug 1042979 - Clean up unused imports, variables, and dead code in mochitest. r=ahal 2014-07-24 06:23:00 +02:00
Jonathan Griffin
e4cbe95487 Bug 1042270 - Add is_mulet condition to mach, r=ahal 2014-07-22 14:41:09 -07:00
Ahmed Kachkach
99c4a4f0c4 Bug 1041944 - Printing mochitest failures at the end of the execution (with mach). r=ahal 2014-07-22 11:56:00 +02:00
Gijs Kruitbosch
29b05ace2b Bug 1014062 - expose harness parameters via SimpleTest, always use the harness, pass keep-open for single test runs with mach, r=ted,f=bz
--HG--
extra : rebase_source : 494615dbe437053ea65079a2c5016782a7bee0a2
2014-05-22 20:09:21 +01:00
Andrew Halberstadt
c2096b65e1 Bug 1037858 - B2G mochitest mach command should fail early if running with PRODUCTION=1 or VARIANT=user, r=jgriffin, DONTBUILD, a=NPOTB 2014-07-17 13:38:20 -04:00
Giovanni Sferro
fdecf44d6f Bug 1032530 - mach mochitest takes --setpref argument. r=gps 2014-07-13 10:04:00 +02:00
Ting-Yu Lin
00d2bb924f Bug 982560 - Fix mach fails to find tests in subdirectory. r=gps
Make the test paths relative to topsrcdir before passing them to
TestResolver. Also do not passing cwd to TestResolver since it will
filter out tests that do not live under the directory where the mach
command is executed.

Verification steps:
Execute a mach test command from any subdirectory. For example:
$ cd testing/tps/
$ ../../mach xpcshell-test ../../services/fxaccounts/tests/xpcshell/
$ ../../mach test ../../services/fxaccounts/tests/xpcshell/
2014-07-01 23:21:00 +02:00
Vaibhav Agrawal
8dd0e39442 Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Andrew Halberstadt
e30a35bbc9 Bug 1028746 - Running mach mochitest-remote from gecko srcdir raises AttributeError instead of being helpful, r=gps, DONTBUILD, a=NPOTB 2014-06-24 13:47:19 -04:00
Wes Kocher
b8d6b378bf Merge m-c to fx-team 2014-06-19 18:33:19 -07:00
Gregory Szorc
88fb1d29b0 Bug 920193 - mach mochitest can now receive test objects; r=AutomatedTester
Similar to the previous patch, we now teach `mach mochitest` how to
execute test objects directly.

--HG--
extra : rebase_source : b69b5b74bcf6c81cff5deb28a1156ab2fcc691f7
2014-06-18 11:19:45 -07:00
Gregory Szorc
c15e536e73 Bug 938712 - Add --flavor to mach mochitest; r=AutomatedTester
`mach mochitest` now accepts a --flavor argument to limit execution to
tests of a certain flavor. Executing `mach mochitest --flavor=X` should
be equivalent to executing `mach mochitest-X`.

This paves the road to deprecating the various `mach mochitest-X`
commands.

--HG--
extra : rebase_source : 0f8370425f54a4ec86e7f668bcbff69362e017f7
2014-06-17 15:49:41 -07:00
Gregory Szorc
b3a110713e Bug 938712 - Implement mach mochitest; r=AutomatedTester
The `mach mochitest` command is now implemented. Given test path
arguments, it will identify mochitests of any flavor and run the
appropriate mochitest suite.

If tests from multiple suites are present, it will invoke each suite
separately. Although, the output in this mode isn't very friendly.

There are a number of enhancements that could be made to this command,
including the abilities to filter by flavor and sub-suite. These will
come in another patch.

--HG--
extra : rebase_source : 9be6000e6bb508ef0c980eda9f9ebe03a4c0f02a
2014-06-17 15:42:08 -07:00
Andrew Halberstadt
d638652838 Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Joel Maher
15b2b6128b Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Carsten "Tomcat" Book
b24097f49a Backed out changeset 86d0bd2a0233 (bug 992911) for android 2.3 bustage 2014-06-02 13:36:51 +02:00
Joel Maher
5ba56a3264 Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-02 06:54:23 -04:00
Andrew Halberstadt
f310c7b7a3 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Boris Zbarsky
de703c8590 Bug 990289. Make running a single mochitest run it in a way where the subtest results can be accessed. r=ted 2014-05-08 22:20:54 -04:00
Ted Mielczarek
159f8c076d bug 815002 - allow using loopback devices in WebRTC mochitests on Linux when available. r=jsmith,jmaher 2014-05-01 07:18:00 -04:00
Gijs Kruitbosch
47a7b46794 Bug 1004410 - allow running mochitests against an arbitrary binary, r=jmaher
--HG--
extra : rebase_source : ba7e34aaffe2dd845b8717a34dc27c7f59983534
2014-05-01 11:05:36 +01:00
Vicamo Yang
120e5aad58 Bug 996443: carry emulator arch automatically for mach commands. r=ahal 2014-05-01 00:57:39 +08:00
Nathan Froyd
f359659e38 Bug 999407 - add --setenv option for mochitests run through mach; r=jmaher
DONTBUILD because NPOTB
2014-04-22 09:09:47 -04:00
Manish Goregaokar
2e994e98d3 Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Ms2ger
dc2f3e243f Backed out changeset c63d8f19a893 for failures in Android mochitests. 2014-04-12 12:00:37 +02:00
Manish Goregaokar
7c01a6661a Bug 991348 - Support taking screenshots on all test failures in mochitests; r=jmaher 2014-04-12 11:08:34 +02:00
Michael Ratcliffe
e7dad953b0 Bug 983948 - Add mach mochitest-devtools r=jmaher 2014-03-25 16:52:53 +00:00
Vicamo Yang
bca7e5f97b Bug 975442: recognize as emulator if device name begins with 'emulator'. r=jgriffin 2014-04-09 10:14:07 +08:00
Nathan Froyd
ab21e84091 Bug 969437 - part 1 - introduce a --quiet option for mochitests; r=jmaher 2014-03-07 11:42:07 -05:00
Gregory Szorc
df9137da98 Bug 987414 - Pass multiple test arguments to mach testing commands; r=ahal
Previously, mach xpcshell-test and mochitest-* were limited to a single
test "path" argument. This patch enables multiple arguments to be passed
in.

TestResolver in the build system has gained the ability to process
multiple paths in a single invocation. The mach commands have been
modified to utilize this new feature.

Only mach code paths that pass manifestdestiny.TestManifest instances
into the test runner can accept multiple arguments. This is because
there is no other way to pass a custom set of tests into the test
runner. If multiple test arguments are used but not supported, a warning
is emitted.

--HG--
extra : rebase_source : 1ce1328a969f654e7b43a7a0bdd15ed86f5ceb21
2014-03-24 16:19:57 -07:00
Gregory Szorc
4d0939f8dc Bug 987398 - Part 1: Run mochitests from manifests with mach; r=ahal
The mochitest mach commands now consult the all-tests.json file for
resolving the test argument/path. The mochitest runner has been modified
to accept a manifestdestiny.TestManifest instance instead of a path to a
manifest file. The mach commands construct an in-memory TestManifest and
pass it to the mochitest runner.

While I was here, I cleaned up some old JSON serializing code.

--HG--
extra : rebase_source : 886b13d4cb35992c132bc3051925424609a5fdf8
2014-03-24 14:35:06 -07:00
Jonathan Griffin
2c813577a2 Bug 979650 - Always build with Marionette for Firefox, b2g desktop, r=ted 2014-03-11 13:22:34 -07:00
Carsten "Tomcat" Book
25e80771a2 Merge mozilla-central to b2g-inbound 2014-03-19 16:30:49 +01:00
Andrew Halberstadt
c5299fccd1 Bug 983262 - Remove obsolete b2g mochitest json manifests, r=jmaher 2014-03-19 11:23:29 -04:00
Bill McCloskey
a6e3c52e36 Bug 938019 - Run mochitests from manifests (r=ted,gps) 2014-03-18 08:03:51 -07:00
Nils Ohlmeier [:drno]
6e58ac959d Bug 962919 - Filter a given test directory by the B2G manifest. r=ahal 2014-02-10 15:58:46 -05:00
Ehsan Akhgari
8e5a0410a9 Bug 957729 - Disable the slow script signal handler by default when running mochitests under a debugger through mach; r=gps 2014-02-07 23:25:45 -05:00
Nathan Froyd
37687a2e3a Bug 960612 - update |mach mochitest*| for DMD's new shared library location in dist/bin/; r=jmaher 2014-01-16 12:23:32 -05:00
Andrew Halberstadt
c76d6a5d16 Bug 958395 - mochitest-plain mach command should add kwargs to options, r=jmaher, DONTBUILD, a=NPOTB 2014-01-10 10:45:52 -05:00
Andrew Halberstadt
a7ebe7291d Bug 957768 - Add an option to hide mochitest subtest results, r=jmaher 2014-01-09 15:41:54 -05:00
Kamil Muszyński
682f3e48b0 Bug 932948 - Running mach mochitest-a11y with installed extension. r=ted
--HG--
extra : rebase_source : 48b5025f8df30a697ddc5dd65235583bdc6f1f55
2013-12-17 10:56:29 -05:00
Andrew Halberstadt
ebefd4135d Bug 946722 - Fix typo causing b2g mochitest mach command to use wrong manifest, r=ato, DONTBUILD, a=NPOTB 2013-12-05 10:48:46 -05:00
Jed Davis
1b4ca49a7e Bug 943141 - Set up breakpad symbol path for ./mach mochitest-remote. r=ahal 2013-11-26 17:25:25 -05:00
Jed Davis
cca3a20269 Bug 936278 - Pass through mach mochitest-remote options correctly. r=jgriffin 2013-11-25 09:12:50 -05:00