Commit Graph

484 Commits

Author SHA1 Message Date
Mike Connor
dbf5df186f Bug 804745 - Unified notification for application data reporting; r=gavin 2013-01-11 19:05:35 -08:00
Andrew Halberstadt
3a19a47088 Bug 811779 - Enable larger set of reftests on B2G emulators, r=jgriffin 2013-01-03 15:35:01 -05:00
Andrew Halberstadt
0dc82f61d7 Bug 812012 - (Part 1) Add busybox arg to b2g reftest/mochitest harnesses, r=jgriffin, DONTBUILD a=NPOTB,test-only 2013-01-07 10:29:43 -05:00
Andrew Halberstadt
fe942819ce Bug 826021 - Ensure all skipped tests show up in reftest logs, r=jmaher 2013-01-03 16:33:23 -05:00
Theo Chevalier
6b249e6652 Bug 825464 - Skip any revision of TELEMETRY_DISPLAY_REV in tests & WebApp (long term fix). r=mak 2013-01-02 16:31:10 +01:00
Geoff Brown
fa7435e42c Bug 810347 - Provide option for setting remote test root; r=jmaher 2012-12-20 09:11:11 -07:00
Ehsan Akhgari
fe95d440aa Merge mozilla-central into mozilla-inbound 2012-12-10 20:39:51 -05:00
Gregory Szorc
9a15be5d03 Bug 820060 - Fix mach crashtest; r=Ms2ger
DONTBUILD (NPOTB)
2012-12-10 11:23:35 -08:00
Theo Chevalier
05d9dee167 Bug 737596 - Enable Telemetry by default on Nightly and Aurora channels (mobile). r=bnicholson 2012-12-10 23:25:50 +01:00
Ehsan Akhgari
709d864bdd Merge mozilla-central into mozilla-inbound 2012-12-06 13:13:33 -05:00
Gregory Szorc
2fd8350809 Bug 809729 - Ability to run reftests through debugger with mach; r=Ms2ger
DONTBUILD (NPOTB)
2012-12-06 10:03:25 -08:00
Joel Maher
55ab587e7a Bug 818156 - Improve test chunking. r=gbrown 2012-12-06 08:43:23 -05:00
Jonathan Griffin
4c8faceb12 Bug 815807 - Part 3: Load marionette early in the B2G startup process if relevant pref is set, otherwise load it late, r=ahal 2012-11-29 19:46:39 -08:00
Jonathan Griffin
2e70a34fa0 Backout 9252522aab90, r=bustage 2012-11-30 12:54:00 -08:00
Jonathan Griffin
7c732aaf6d Bug 815807 - Part 3: Load marionette early in the B2G startup process if relevant pref is set, otherwise load it late, r=ahal 2012-11-29 19:46:39 -08:00
Cameron McCormack
c2341aa903 Bug 788967 - Add a default-preferences statement for reftest manifests. r=dbaron 2012-11-28 10:06:33 +11:00
Jonathan Kew
c8e1044469 bug 815617 - speed up reftest-analyzer by avoiding use of a large dilation radius. r=bz 2012-11-28 09:04:13 +00:00
Cameron McCormack
e0285165b3 Backout 5218cec180c8. 2012-11-28 10:39:47 +11:00
Cameron McCormack
843f7bfbbe Bug 788967 - Add a default-preferences statement for reftest manifests. r=dbaron 2012-11-28 10:06:33 +11:00
Cameron McCormack
c1f6c8d4ae Bug 809312 - Add ability to run a subset of reftests from a manifest. r=dbaron,gps 2012-11-28 09:29:03 +11:00
Ed Morley
26e06eb5d9 Bug 808410 - remotereftest.py shouldn't ignore the runTests() exit code; r=jmaher 2012-11-20 15:24:27 +00:00
Andrew Halberstadt
2722ce2bbf Bug 812514 - Make b2g emulator unittests save logcat for easier debugging, r=jgriffin 2012-11-19 15:52:40 -05:00
Jonathan Griffin
ef1bcf8fe3 Bug 812395 - Make emulator fail gracefully during errors for install_gecko, r=ahal 2012-11-19 09:32:57 -08:00
Ehsan Akhgari
2a3f220d58 Backed out changeset d129d66a6491 (bug 812281) because apparently it broke Android reftest/crashtest/jsreftest 2012-11-15 14:35:41 -08:00
Ehsan Akhgari
3464482ef9 Bug 812281 - Shut up the media volume when running tests; r=cpearce 2012-11-15 12:15:12 -08:00
William Lachance
14b993064f Bug 811388 - Update mozdevice to 0.15, update consumers;r=ahal 2012-11-14 09:49:04 -08:00
William Lachance
4a1fcf3f56 Bug 805116 - Print more of the logcat in mobile tests;r=gbrown 2012-11-12 13:57:13 -08:00
Joel Maher
fb45a60d2d Bug 737961 - add reftest manifest conditions for height width. r=dbaron 2012-11-12 07:56:34 -05:00
Gregory Szorc
203a9e64f9 Bug 808336 - Part 1: Refactor mach command handler management; r=jhammel
Previously we were tighly coupled with MozbuildObject. This was not in
the spirit of mach being a generic tool. Now, instead of passing multiple
arguments to __init__ of the class providing the mach command we either
pass 0 or 1. The number of arguments is detected when processing the
@CommandProvider decorator. The optional argument is a named tuple
containing mach run-time state.

Capturing of mach command provider information is now captured in a
class (as opposed to an anoymous tuple). We also capture these in a rich
data structure which is passed as part of the run-time data to the
command provider class. This allows mach commands to inspect the mach
environment.

Mach decorators have been moved to mach.decorators. mach.base is
reserved for generic mach data/container classes.

Existing mach command classes derived from MozbuildObject have been
replaced with either object or mozbuild.base.MachCommandBase. This
latter class translates the mach context instance passed to __init__
into the constructor arguments for MozbuildObject.__init__.

Support for registering function handlers with mach has been removed.
All handlers must be inside classes.

--HG--
rename : python/mach/mach/base.py => python/mach/mach/decorators.py
2012-11-06 16:57:41 -08:00
Ed Morley
1c5718e096 Bug 808417 - Make runTests() exception reporting consistent across test harnesses; r=jmaher 2012-11-05 13:03:55 +00:00
Ed Morley
43bd031bcd Bug 808417 - remotereftest.py should print the actual exception if one occurred runTests(); r=jmaher 2012-11-05 13:03:54 +00:00
Kyle Huey
45adfbf2c8 Bug 798491: Add an option to stick all chrome JSMs/JS components in the same compartment. r=mrbkap,philikon
--HG--
extra : rebase_source : 98337b6a8c07d05e8c961a452dd05a7d75c3c60b
2012-10-31 09:13:28 -07:00
Vicamo Yang
e6e6deb486 Backout 67cb43bb8865: Breaks B2G Marionette 2012-10-31 16:35:11 +08:00
Kyle Huey
7457de64ad Bug 798491: Add an option to stick all chrome JSMs/JS components in the same compartment. r=mrbkap,philikon 2012-10-30 12:28:11 -07:00
Ed Morley
a7bb0ec116 Backout a145ded68994, e0cf397089ec & 1545e91c658e (bug 798491) for bustage on a CLOSED TREE 2012-10-30 17:02:31 +00:00
Kyle Huey
dd0cfd935a Bug 798491: Add an option to stick all chrome JSMs/JS components in the same compartment. r=mrbkap,philikon 2012-10-30 08:26:12 -07:00
Phil Ringnalda
7f209888ee Bug 806253 - Reftest needs to set prefs to disable blocklist updates, to avoid having them reported as leaks when they are still running at shutdown
--HG--
extra : rebase_source : 0a8103ec19056a71a150e5fe794807518f0aaf0e
2012-10-29 15:10:07 -07:00
Jonathan Griffin
6162950fd5 Bug 805428 - Install reftest extension on B2G as app bundle, r=ahal, DONTBUILD(NPOTB) 2012-10-25 09:55:42 -07:00
William Lachance
168bbc8508 Bug 801652 - Remove redundant devicemanager import;r=jmaher 2012-10-24 13:43:29 -04:00
William Lachance
cacf84f9f9 Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Phil Ringnalda
b6982dcbd7 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
Daniel Holbert
f658ea2fd4 backout 5545892376cc (Bug 737961) for Windows reftest orange 2012-10-16 16:05:52 -07:00
Joel Maher
b92d825c2f Bug 737961 - add reftest manifest conditions for height width. r=dbaron 2012-10-16 16:12:25 -04:00
Phil Ringnalda
cb42b07aa0 Back out fb167937d25b (bug 799332) because I fail at copy-paste 2012-10-15 21:02:56 -07:00
Phil Ringnalda
38210a4217 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
William Lachance
64e676bbc5 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
Jeff Hammel
358ea0a98e Bug 800110 - Mirror mozbase -> m-c for bug 800097 @ da60c88b8c ;r=ahal,r=wlach 2012-10-12 10:24:35 -07:00
Gregory Szorc
2c1dced77a Bug 799291 - Part 3: Move mozbuild.testing into testing/; r=jhammel
--HG--
rename : python/mozbuild/mozbuild/testing/test.py => testing/moztesting/util.py
2012-10-10 11:08:09 -07:00
Gregory Szorc
28c7dd206c Bug 799291 - Part 1: Move mach commands for test running into test runners; r=jhammel
The code interacting with the test runners now resides in closer
proximity to the code it is invoking. We also purge testing
functionality from mozbuild, which is where it never really belonged.

--HG--
rename : python/mozbuild/mozbuild/testing/reftest.py => layout/tools/reftest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/mochitest.py => testing/mochitest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/xpcshell.py => testing/xpcshell/mach_commands.py
2012-10-10 11:08:09 -07:00
Andrew Halberstadt
3ea52e5559 Bug 795099 - Add --gecko-path argument to runreftestb2g.py, r=jgriffin; DONTBUILD because NPOTB 2012-10-05 11:12:05 -04:00
Andrew Halberstadt
3c47c68070 Bug 797177 - Fix missed calls to checkCmd within B2G automation, r=mikeh; DONTBUILD because NPOTB 2012-10-05 16:06:02 -04:00
William Lachance
382c927895 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joe Drew
86b407c027 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Joel Maher
bc03cb2a44 Bug 792029 - Make SpecialPowers available in crashtests. r=ted 2012-10-01 08:50:10 -04:00
Ms2ger
372fb21863 Bug 795862 - Back out bug 486918 for build bustage in unreviewed code. 2012-10-01 14:16:03 +02:00
Joe Drew
3a386776a9 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Ed Morley
6250aafdf0 Backout 92530b29ac24, 42e659956dc6 & 38277196c099 (bug 486918), d3b69fe15ac3 & b2dba2108722 (bug 786444), e7381ac9e30a (bug 786449) on suspicion of causing Android reftest failures on a CLOSED TREE 2012-09-28 23:00:28 +01:00
Joe Drew
7c3734fece Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar
--HG--
extra : rebase_source : 386bee19522e3cb8bca16ec40e3c092a52ae18d2
2012-09-27 14:12:56 -04:00
Matt Woodrow
51851e8ae8 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
e79b288e75 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
Ed Morley
5a3b322459 Revert mozilla-inbound to e4dd1fa6d222 for crashes and test failures on a CLOSED TREE 2012-09-27 16:34:46 +01:00
Matt Woodrow
74825f516b Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
6bcc0bc124 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
L. David Baron
e1e7eeb89e Make reftest harness print max difference and number of differing pixels on the TEST-UNEXPECTED-FAIL line so that it ends up in bugs. (Bug 789602) r=ted 2012-09-14 14:12:34 -07:00
L. David Baron
e3caf6df43 Bug 789771 - Add an OSX variable to the reftest condition sandbox to make it easier to test Mac OS X versions, r=roc
--HG--
extra : rebase_source : 417fcaf6baa267680d93187c459532a22da8ef21
2012-09-08 23:37:04 -07:00
William Lachance
980573bf62 Bug 723107 - Re-add mozdevice to testing/mozbase, remove duplicate files in build/mobile;r=jmaher 2012-09-07 16:00:31 -04:00
Jeff Gilbert
081dc9ddc7 Bug 782860 - Mark failing WebGL reftests as failing - r=bjacob 2012-09-06 18:46:43 -07:00
Philipp von Weitershausen
f47e2a9937 Bug 776825 - Separate message managers into senders and broadcasters. r=smaug
--HG--
rename : content/base/public/nsIFrameMessageManager.idl => content/base/public/nsIMessageManager.idl
2012-08-27 11:13:02 -03:00
Cameron McCormack
0c12bad353 Bug 705184 - Count unexpected reftest crash dump files as test failures. r=dbaron 2011-12-05 14:06:42 +11:00
Andrew Halberstadt
d61f0e8d67 Bug 784810 - Disable browser.tabs.remote for b2g reftests, r=jgriffin 2012-08-22 17:24:57 -04:00
Andrew Halberstadt
7ba1f1b6f4 Bug 778072 - Add pref for reftests to use iframe mozbrowser. r=cjones 2012-08-17 11:45:39 -04:00
Andrew Halberstadt
5565d0b314 Bug 778725 - Fix program error managing snapshot errors in b2g reftests, r=jgriffin 2012-08-15 17:36:52 -04:00
Andrew Halberstadt
fb70ccbd37 Bug 782655 - Enable remote xul for B2G reftests, r=jgriffin 2012-08-15 15:26:31 -04:00
Kyle Huey
f454c29dd5 Bug 685516: Disable a bunch of failing tests on Android XUL. r=jrmuizel 2012-08-13 11:22:11 -07:00
Andrew Halberstadt
b4d43b25cb Bug 770490 - Infrastructure to run reftests on B2G, r=jgriffin 2012-08-10 14:25:20 -04:00
Mike Hommey
c1b35e7b2a Bug 774032 bonus - Use @DEPTH@ and @relativesrcdir@ in Makefile.in. r=ted 2012-08-04 20:26:44 +02:00
Nicholas Cameron
16a54f4e0d Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 18:30:10 +12:00
Nicholas Cameron
666c8e4e67 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 18:30:10 +12:00
Nicholas Cameron
45704eb121 Back out bug 779001, bug 746883, bug 778595, bug 776803, bug 7118849 2012-07-31 18:17:23 +12:00
Nicholas Cameron
8fce55f094 Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 13:46:04 +12:00
Nicholas Cameron
3570f3ac38 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 13:45:59 +12:00
Christian Holler
a42c8cb1e9 Bug 777412 - Support the --setenv option in reftests 2012-07-30 13:47:27 +02:00
Ed Morley
7664052de1 Backout 6718d4c7b6c1 (bug 775174) for Android XUL R3 failures in animateMotion-rotate-*.svg on a CLOSED TREE 2012-07-28 11:31:26 +01:00
Matt Woodrow
934f1b657c Bug 729784 - Fix documentation for fuzzy() and fuzzy-if(), and give image difference error messages in the same order as the parameters to them. r=dbaron 2012-07-28 13:47:46 +12:00
Matt Woodrow
ab1de09c3e Bug 775174 - Add invalidation timeline to reftest analyzer. r=dbaron 2012-07-28 13:46:42 +12:00
William Lachance
d50dc7ece8 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Jonas Sicking
690071fc50 Bug 774585: Rename getCodebasePrincipal to getSimpleCodebasePrincipal since the behavior has semantically changed. r=mounir 2012-07-21 00:29:40 -07:00
Mounir Lamouri
8b371aed8a Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Ed Morley
bb507d18ac Backout ea6db8f420c0 (bug 770831), b51c79ee0883 (bug 774957), 020f6ed5958b (bug 758258), 11d8e19e1fca (bug 758258), 707fc51bfe2e (bug 775354), 489d944a6fe6 (bug 327244), be7df3c9d50f (bug 327244) for m-oth orange 2012-07-19 08:29:48 +01:00
Mounir Lamouri
30741d2c3a Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Phil Ringnalda
cc4eb5e604 Bug 752752 - Set prefs in the reftest harness to prevent updating and prefetching data about addons, to avoid leaking, r=Unfocused,dbaron 2012-05-25 21:29:35 -07:00
Ehsan Akhgari
729030ee5b Backout changeset e04abde1b323 (bug 539356) because of performance and correctness regressions 2012-07-03 20:21:03 -04:00
Ehsan Akhgari
7b2a3505b7 Backout changeset ba7021170544 (bug 539356) because of performance and correctness regressions 2012-07-03 20:12:45 -04:00
Matt Woodrow
78b4c453c4 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-06-30 15:06:13 +12:00
Matt Woodrow
4b10a2b53c Bug 539356 - Part 10 - Test changes required for DLBI. r=roc 2012-06-30 15:06:11 +12:00
Nicholas Cameron
a1eeaeb74a Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar 2012-04-16 07:49:56 +12:00
Joel Maher
a306bf1a8b Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Matt Brubeck
72ef8c96fc Back out bug 761890, bug 746896, and bug 759036 because of reftest failures
--HG--
extra : rebase_source : b5bdad8a69eab8e9ba35d21637c0bbcb18bce703
2012-06-11 22:50:31 -07:00
Nicholas Cameron
1a0c850f13 Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar
--HG--
extra : rebase_source : 8df12107009253df9ae996a9cbf1f78fc594f41f
2012-04-16 07:49:56 +12:00
Ed Morley
7d13aab294 Backout 61fd66629c4f, 7c8121f8d3af & 2a2e9cf8fd41 (bug 539356), e31a5e6545d3 (bug 761884), 85fa80bd9792, a284ccb25b83, 2865904db9fc, 34e07b09c426, e9b3d41e0360, cef00ebcd6c8, f943b729ac14 & 783f298401b6 (bug 539356), 330a086f1570 (bug 741682), d80219c8842c (bug 739671), e8c96b4fd4da, 313af486e68d, 0adc41ff56dc, 0cd288a38085, f1d43208825c, 4859876972f3, eec8ef3ebe48, f7f29fcd1845, 6079b229d306, f23c3a7e7ce0, 9824458a41e2 & 6748b5496059 (bug 539356) for mochitest-4 orange & talos regressions on multiple platforms 2012-06-11 10:08:32 +01:00