Commit Graph

398 Commits

Author SHA1 Message Date
Phil Ringnalda
7f209888ee Bug 806253 - Reftest needs to set prefs to disable blocklist updates, to avoid having them reported as leaks when they are still running at shutdown
--HG--
extra : rebase_source : 0a8103ec19056a71a150e5fe794807518f0aaf0e
2012-10-29 15:10:07 -07:00
Jonathan Griffin
6162950fd5 Bug 805428 - Install reftest extension on B2G as app bundle, r=ahal, DONTBUILD(NPOTB) 2012-10-25 09:55:42 -07:00
William Lachance
168bbc8508 Bug 801652 - Remove redundant devicemanager import;r=jmaher 2012-10-24 13:43:29 -04:00
William Lachance
cacf84f9f9 Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Phil Ringnalda
b6982dcbd7 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
Daniel Holbert
f658ea2fd4 backout 5545892376cc (Bug 737961) for Windows reftest orange 2012-10-16 16:05:52 -07:00
Joel Maher
b92d825c2f Bug 737961 - add reftest manifest conditions for height width. r=dbaron 2012-10-16 16:12:25 -04:00
Phil Ringnalda
cb42b07aa0 Back out fb167937d25b (bug 799332) because I fail at copy-paste 2012-10-15 21:02:56 -07:00
Phil Ringnalda
38210a4217 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
William Lachance
64e676bbc5 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
Jeff Hammel
358ea0a98e Bug 800110 - Mirror mozbase -> m-c for bug 800097 @ da60c88b8c ;r=ahal,r=wlach 2012-10-12 10:24:35 -07:00
Gregory Szorc
2c1dced77a Bug 799291 - Part 3: Move mozbuild.testing into testing/; r=jhammel
--HG--
rename : python/mozbuild/mozbuild/testing/test.py => testing/moztesting/util.py
2012-10-10 11:08:09 -07:00
Gregory Szorc
28c7dd206c Bug 799291 - Part 1: Move mach commands for test running into test runners; r=jhammel
The code interacting with the test runners now resides in closer
proximity to the code it is invoking. We also purge testing
functionality from mozbuild, which is where it never really belonged.

--HG--
rename : python/mozbuild/mozbuild/testing/reftest.py => layout/tools/reftest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/mochitest.py => testing/mochitest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/xpcshell.py => testing/xpcshell/mach_commands.py
2012-10-10 11:08:09 -07:00
Andrew Halberstadt
3ea52e5559 Bug 795099 - Add --gecko-path argument to runreftestb2g.py, r=jgriffin; DONTBUILD because NPOTB 2012-10-05 11:12:05 -04:00
Andrew Halberstadt
3c47c68070 Bug 797177 - Fix missed calls to checkCmd within B2G automation, r=mikeh; DONTBUILD because NPOTB 2012-10-05 16:06:02 -04:00
William Lachance
382c927895 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joe Drew
86b407c027 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Joel Maher
bc03cb2a44 Bug 792029 - Make SpecialPowers available in crashtests. r=ted 2012-10-01 08:50:10 -04:00
Ms2ger
372fb21863 Bug 795862 - Back out bug 486918 for build bustage in unreviewed code. 2012-10-01 14:16:03 +02:00
Joe Drew
3a386776a9 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Ed Morley
6250aafdf0 Backout 92530b29ac24, 42e659956dc6 & 38277196c099 (bug 486918), d3b69fe15ac3 & b2dba2108722 (bug 786444), e7381ac9e30a (bug 786449) on suspicion of causing Android reftest failures on a CLOSED TREE 2012-09-28 23:00:28 +01:00
Joe Drew
7c3734fece Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar
--HG--
extra : rebase_source : 386bee19522e3cb8bca16ec40e3c092a52ae18d2
2012-09-27 14:12:56 -04:00
Matt Woodrow
51851e8ae8 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
e79b288e75 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
Ed Morley
5a3b322459 Revert mozilla-inbound to e4dd1fa6d222 for crashes and test failures on a CLOSED TREE 2012-09-27 16:34:46 +01:00
Matt Woodrow
74825f516b Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
6bcc0bc124 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
L. David Baron
e1e7eeb89e Make reftest harness print max difference and number of differing pixels on the TEST-UNEXPECTED-FAIL line so that it ends up in bugs. (Bug 789602) r=ted 2012-09-14 14:12:34 -07:00
L. David Baron
e3caf6df43 Bug 789771 - Add an OSX variable to the reftest condition sandbox to make it easier to test Mac OS X versions, r=roc
--HG--
extra : rebase_source : 417fcaf6baa267680d93187c459532a22da8ef21
2012-09-08 23:37:04 -07:00
William Lachance
980573bf62 Bug 723107 - Re-add mozdevice to testing/mozbase, remove duplicate files in build/mobile;r=jmaher 2012-09-07 16:00:31 -04:00
Jeff Gilbert
081dc9ddc7 Bug 782860 - Mark failing WebGL reftests as failing - r=bjacob 2012-09-06 18:46:43 -07:00
Philipp von Weitershausen
f47e2a9937 Bug 776825 - Separate message managers into senders and broadcasters. r=smaug
--HG--
rename : content/base/public/nsIFrameMessageManager.idl => content/base/public/nsIMessageManager.idl
2012-08-27 11:13:02 -03:00
Cameron McCormack
0c12bad353 Bug 705184 - Count unexpected reftest crash dump files as test failures. r=dbaron 2011-12-05 14:06:42 +11:00
Andrew Halberstadt
d61f0e8d67 Bug 784810 - Disable browser.tabs.remote for b2g reftests, r=jgriffin 2012-08-22 17:24:57 -04:00
Andrew Halberstadt
7ba1f1b6f4 Bug 778072 - Add pref for reftests to use iframe mozbrowser. r=cjones 2012-08-17 11:45:39 -04:00
Andrew Halberstadt
5565d0b314 Bug 778725 - Fix program error managing snapshot errors in b2g reftests, r=jgriffin 2012-08-15 17:36:52 -04:00
Andrew Halberstadt
fb70ccbd37 Bug 782655 - Enable remote xul for B2G reftests, r=jgriffin 2012-08-15 15:26:31 -04:00
Kyle Huey
f454c29dd5 Bug 685516: Disable a bunch of failing tests on Android XUL. r=jrmuizel 2012-08-13 11:22:11 -07:00
Andrew Halberstadt
b4d43b25cb Bug 770490 - Infrastructure to run reftests on B2G, r=jgriffin 2012-08-10 14:25:20 -04:00
Mike Hommey
c1b35e7b2a Bug 774032 bonus - Use @DEPTH@ and @relativesrcdir@ in Makefile.in. r=ted 2012-08-04 20:26:44 +02:00
Nicholas Cameron
16a54f4e0d Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 18:30:10 +12:00
Nicholas Cameron
666c8e4e67 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 18:30:10 +12:00
Nicholas Cameron
45704eb121 Back out bug 779001, bug 746883, bug 778595, bug 776803, bug 7118849 2012-07-31 18:17:23 +12:00
Nicholas Cameron
8fce55f094 Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 13:46:04 +12:00
Nicholas Cameron
3570f3ac38 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 13:45:59 +12:00
Christian Holler
a42c8cb1e9 Bug 777412 - Support the --setenv option in reftests 2012-07-30 13:47:27 +02:00
Ed Morley
7664052de1 Backout 6718d4c7b6c1 (bug 775174) for Android XUL R3 failures in animateMotion-rotate-*.svg on a CLOSED TREE 2012-07-28 11:31:26 +01:00
Matt Woodrow
934f1b657c Bug 729784 - Fix documentation for fuzzy() and fuzzy-if(), and give image difference error messages in the same order as the parameters to them. r=dbaron 2012-07-28 13:47:46 +12:00
Matt Woodrow
ab1de09c3e Bug 775174 - Add invalidation timeline to reftest analyzer. r=dbaron 2012-07-28 13:46:42 +12:00
William Lachance
d50dc7ece8 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00