Commit Graph

502 Commits

Author SHA1 Message Date
Jonathan Griffin
6162950fd5 Bug 805428 - Install reftest extension on B2G as app bundle, r=ahal, DONTBUILD(NPOTB) 2012-10-25 09:55:42 -07:00
William Lachance
168bbc8508 Bug 801652 - Remove redundant devicemanager import;r=jmaher 2012-10-24 13:43:29 -04:00
William Lachance
cacf84f9f9 Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Phil Ringnalda
b6982dcbd7 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
Daniel Holbert
f658ea2fd4 backout 5545892376cc (Bug 737961) for Windows reftest orange 2012-10-16 16:05:52 -07:00
Joel Maher
b92d825c2f Bug 737961 - add reftest manifest conditions for height width. r=dbaron 2012-10-16 16:12:25 -04:00
Phil Ringnalda
cb42b07aa0 Back out fb167937d25b (bug 799332) because I fail at copy-paste 2012-10-15 21:02:56 -07:00
Phil Ringnalda
38210a4217 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
David Zbarsky
ec66c8d312 Bug 799407: Enable FAIL_ON_WARNINGS in more of layout/ r=roc 2012-10-15 01:42:40 -04:00
William Lachance
64e676bbc5 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
David Zbarsky
53345541db Backout 784bb7c5ea9c (Bug 799407) for bustage 2012-10-15 02:14:34 -04:00
David Zbarsky
16b60cf311 Bug 799407: Enable FAIL_ON_WARNINGS in more of layout/ r=roc 2012-10-15 01:42:40 -04:00
Jeff Hammel
358ea0a98e Bug 800110 - Mirror mozbase -> m-c for bug 800097 @ da60c88b8c ;r=ahal,r=wlach 2012-10-12 10:24:35 -07:00
Gregory Szorc
2c1dced77a Bug 799291 - Part 3: Move mozbuild.testing into testing/; r=jhammel
--HG--
rename : python/mozbuild/mozbuild/testing/test.py => testing/moztesting/util.py
2012-10-10 11:08:09 -07:00
Gregory Szorc
28c7dd206c Bug 799291 - Part 1: Move mach commands for test running into test runners; r=jhammel
The code interacting with the test runners now resides in closer
proximity to the code it is invoking. We also purge testing
functionality from mozbuild, which is where it never really belonged.

--HG--
rename : python/mozbuild/mozbuild/testing/reftest.py => layout/tools/reftest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/mochitest.py => testing/mochitest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/xpcshell.py => testing/xpcshell/mach_commands.py
2012-10-10 11:08:09 -07:00
Andrew Halberstadt
3ea52e5559 Bug 795099 - Add --gecko-path argument to runreftestb2g.py, r=jgriffin; DONTBUILD because NPOTB 2012-10-05 11:12:05 -04:00
Andrew Halberstadt
3c47c68070 Bug 797177 - Fix missed calls to checkCmd within B2G automation, r=mikeh; DONTBUILD because NPOTB 2012-10-05 16:06:02 -04:00
William Lachance
382c927895 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joe Drew
86b407c027 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Joel Maher
bc03cb2a44 Bug 792029 - Make SpecialPowers available in crashtests. r=ted 2012-10-01 08:50:10 -04:00
Ms2ger
372fb21863 Bug 795862 - Back out bug 486918 for build bustage in unreviewed code. 2012-10-01 14:16:03 +02:00
Joe Drew
3a386776a9 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Ed Morley
6250aafdf0 Backout 92530b29ac24, 42e659956dc6 & 38277196c099 (bug 486918), d3b69fe15ac3 & b2dba2108722 (bug 786444), e7381ac9e30a (bug 786449) on suspicion of causing Android reftest failures on a CLOSED TREE 2012-09-28 23:00:28 +01:00
Joe Drew
7c3734fece Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar
--HG--
extra : rebase_source : 386bee19522e3cb8bca16ec40e3c092a52ae18d2
2012-09-27 14:12:56 -04:00
Matt Woodrow
51851e8ae8 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
e79b288e75 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
Ed Morley
5a3b322459 Revert mozilla-inbound to e4dd1fa6d222 for crashes and test failures on a CLOSED TREE 2012-09-27 16:34:46 +01:00
Matt Woodrow
74825f516b Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
6bcc0bc124 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
L. David Baron
e1e7eeb89e Make reftest harness print max difference and number of differing pixels on the TEST-UNEXPECTED-FAIL line so that it ends up in bugs. (Bug 789602) r=ted 2012-09-14 14:12:34 -07:00
L. David Baron
e3caf6df43 Bug 789771 - Add an OSX variable to the reftest condition sandbox to make it easier to test Mac OS X versions, r=roc
--HG--
extra : rebase_source : 417fcaf6baa267680d93187c459532a22da8ef21
2012-09-08 23:37:04 -07:00
William Lachance
980573bf62 Bug 723107 - Re-add mozdevice to testing/mozbase, remove duplicate files in build/mobile;r=jmaher 2012-09-07 16:00:31 -04:00
Jeff Gilbert
081dc9ddc7 Bug 782860 - Mark failing WebGL reftests as failing - r=bjacob 2012-09-06 18:46:43 -07:00
Philipp von Weitershausen
f47e2a9937 Bug 776825 - Separate message managers into senders and broadcasters. r=smaug
--HG--
rename : content/base/public/nsIFrameMessageManager.idl => content/base/public/nsIMessageManager.idl
2012-08-27 11:13:02 -03:00
Cameron McCormack
0c12bad353 Bug 705184 - Count unexpected reftest crash dump files as test failures. r=dbaron 2011-12-05 14:06:42 +11:00
Andrew Halberstadt
d61f0e8d67 Bug 784810 - Disable browser.tabs.remote for b2g reftests, r=jgriffin 2012-08-22 17:24:57 -04:00
Ehsan Akhgari
8c296bbcd4 Bug 579517 - Part 1: Automated conversion of NSPR numeric types to stdint types in Gecko; r=bsmedberg
This patch was generated by a script.  Here's the source of the script for
future reference:

function convert() {
echo "Converting $1 to $2..."
find . ! -wholename "*nsprpub*" \
       ! -wholename "*security/nss*" \
       ! -wholename "*/.hg*" \
       ! -wholename "obj-ff-dbg*" \
       ! -name nsXPCOMCID.h \
       ! -name prtypes.h \
         -type f \
      \( -iname "*.cpp" \
         -o -iname "*.h" \
         -o -iname "*.c" \
         -o -iname "*.cc" \
         -o -iname "*.idl" \
         -o -iname "*.ipdl" \
         -o -iname "*.ipdlh" \
         -o -iname "*.mm" \) | \
    xargs -n 1 sed -i -e "s/\b$1\b/$2/g"
}

convert PRInt8 int8_t
convert PRUint8 uint8_t
convert PRInt16 int16_t
convert PRUint16 uint16_t
convert PRInt32 int32_t
convert PRUint32 uint32_t
convert PRInt64 int64_t
convert PRUint64 uint64_t

convert PRIntn int
convert PRUintn unsigned

convert PRSize size_t

convert PROffset32 int32_t
convert PROffset64 int64_t

convert PRPtrdiff ptrdiff_t

convert PRFloat64 double
2012-08-22 11:56:38 -04:00
Andrew Halberstadt
7ba1f1b6f4 Bug 778072 - Add pref for reftests to use iframe mozbrowser. r=cjones 2012-08-17 11:45:39 -04:00
Andrew Halberstadt
5565d0b314 Bug 778725 - Fix program error managing snapshot errors in b2g reftests, r=jgriffin 2012-08-15 17:36:52 -04:00
Andrew Halberstadt
fb70ccbd37 Bug 782655 - Enable remote xul for B2G reftests, r=jgriffin 2012-08-15 15:26:31 -04:00
Ed Morley
57fe127515 Merge mozilla-central to mozilla-inbound 2012-08-15 19:00:48 +01:00
Kyle Huey
f454c29dd5 Bug 685516: Disable a bunch of failing tests on Android XUL. r=jrmuizel 2012-08-13 11:22:11 -07:00
Andrew Halberstadt
b4d43b25cb Bug 770490 - Infrastructure to run reftests on B2G, r=jgriffin 2012-08-10 14:25:20 -04:00
Aryeh Gregor
4c54d98fcb Bug 782252 - Change named constants to correct types; r=ehsan 2012-08-07 18:11:35 +03:00
Mike Hommey
c1b35e7b2a Bug 774032 bonus - Use @DEPTH@ and @relativesrcdir@ in Makefile.in. r=ted 2012-08-04 20:26:44 +02:00
Nicholas Cameron
16a54f4e0d Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 18:30:10 +12:00
Nicholas Cameron
666c8e4e67 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 18:30:10 +12:00
Nicholas Cameron
45704eb121 Back out bug 779001, bug 746883, bug 778595, bug 776803, bug 7118849 2012-07-31 18:17:23 +12:00
Nicholas Cameron
8fce55f094 Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 13:46:04 +12:00
Nicholas Cameron
3570f3ac38 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 13:45:59 +12:00
Ehsan Akhgari
c80897316e Merge the nullptr conversion from mozilla-central into mozilla-inbound 2012-07-30 10:28:15 -04:00
Aryeh Gregor
57c0ad57fb Bug 777292 part 2 - Change all nsnull to nullptr 2012-07-30 17:20:58 +03:00
Christian Holler
a42c8cb1e9 Bug 777412 - Support the --setenv option in reftests 2012-07-30 13:47:27 +02:00
Ed Morley
7664052de1 Backout 6718d4c7b6c1 (bug 775174) for Android XUL R3 failures in animateMotion-rotate-*.svg on a CLOSED TREE 2012-07-28 11:31:26 +01:00
Matt Woodrow
934f1b657c Bug 729784 - Fix documentation for fuzzy() and fuzzy-if(), and give image difference error messages in the same order as the parameters to them. r=dbaron 2012-07-28 13:47:46 +12:00
Matt Woodrow
ab1de09c3e Bug 775174 - Add invalidation timeline to reftest analyzer. r=dbaron 2012-07-28 13:46:42 +12:00
William Lachance
d50dc7ece8 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Jonas Sicking
690071fc50 Bug 774585: Rename getCodebasePrincipal to getSimpleCodebasePrincipal since the behavior has semantically changed. r=mounir 2012-07-21 00:29:40 -07:00
Mounir Lamouri
8b371aed8a Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Ed Morley
bb507d18ac Backout ea6db8f420c0 (bug 770831), b51c79ee0883 (bug 774957), 020f6ed5958b (bug 758258), 11d8e19e1fca (bug 758258), 707fc51bfe2e (bug 775354), 489d944a6fe6 (bug 327244), be7df3c9d50f (bug 327244) for m-oth orange 2012-07-19 08:29:48 +01:00
Mounir Lamouri
30741d2c3a Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Phil Ringnalda
cc4eb5e604 Bug 752752 - Set prefs in the reftest harness to prevent updating and prefetching data about addons, to avoid leaking, r=Unfocused,dbaron 2012-05-25 21:29:35 -07:00
Ehsan Akhgari
729030ee5b Backout changeset e04abde1b323 (bug 539356) because of performance and correctness regressions 2012-07-03 20:21:03 -04:00
Ehsan Akhgari
7b2a3505b7 Backout changeset ba7021170544 (bug 539356) because of performance and correctness regressions 2012-07-03 20:12:45 -04:00
David Zbarsky
cd3c58ee76 Bug 763350 - Clean up some includes in content/ and dom/ r=smaug 2012-07-01 16:45:59 -07:00
Matt Woodrow
78b4c453c4 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-06-30 15:06:13 +12:00
Matt Woodrow
4b10a2b53c Bug 539356 - Part 10 - Test changes required for DLBI. r=roc 2012-06-30 15:06:11 +12:00
Nicholas Cameron
a1eeaeb74a Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar 2012-04-16 07:49:56 +12:00
Joel Maher
a306bf1a8b Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Matt Brubeck
72ef8c96fc Back out bug 761890, bug 746896, and bug 759036 because of reftest failures
--HG--
extra : rebase_source : b5bdad8a69eab8e9ba35d21637c0bbcb18bce703
2012-06-11 22:50:31 -07:00
Nicholas Cameron
1a0c850f13 Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar
--HG--
extra : rebase_source : 8df12107009253df9ae996a9cbf1f78fc594f41f
2012-04-16 07:49:56 +12:00
Ed Morley
7d13aab294 Backout 61fd66629c4f, 7c8121f8d3af & 2a2e9cf8fd41 (bug 539356), e31a5e6545d3 (bug 761884), 85fa80bd9792, a284ccb25b83, 2865904db9fc, 34e07b09c426, e9b3d41e0360, cef00ebcd6c8, f943b729ac14 & 783f298401b6 (bug 539356), 330a086f1570 (bug 741682), d80219c8842c (bug 739671), e8c96b4fd4da, 313af486e68d, 0adc41ff56dc, 0cd288a38085, f1d43208825c, 4859876972f3, eec8ef3ebe48, f7f29fcd1845, 6079b229d306, f23c3a7e7ce0, 9824458a41e2 & 6748b5496059 (bug 539356) for mochitest-4 orange & talos regressions on multiple platforms 2012-06-11 10:08:32 +01:00
Matt Woodrow
bedca2df54 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-06-11 16:45:39 +12:00
Matt Woodrow
aee92f1d56 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc 2012-06-11 16:45:38 +12:00
Geoff Lankow
1214b72681 Bug 749930 - Replace uses of nsILocalFile with nsIFile (compiled code only); r=bsmedberg 2012-06-06 14:08:30 +12:00
Kartikaya Gupta
645a920629 Bug 759421 - Handle image load errors in the reftest analyzer more gracefully. r=heycam 2012-05-30 09:59:42 -04:00
Ehsan Akhgari
dbfa86a72a Bug 757755 - Make sure that the reftest suite never attempts to download and stage an update; r=dbaron 2012-05-23 18:32:41 -04:00
Gregory Szorc
4dd2434c2d Bug 757397 - Make test package generation quieter; r=ted
This may reduce the size of the buildbot build logs by up to half!

--HG--
extra : rebase_source : 87b3f2f40654d69ecd91e19520e2341fc8aac9a6
2012-05-23 16:51:21 +02:00
Gervase Markham
87620f5676 Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Kyle Huey
569fa9dcee Bug 745681: Prepare the reftest harness for Bug 695480. r=dbaron a=test-only 2012-04-23 13:36:50 -07:00
Armen Zambrano Gasparnian
f23611ae3a Bug 735451. raise exception when DeviceManager fails to initialize. r=jmaher 2012-04-11 14:51:18 -04:00
L. David Baron
bad77e55db Add support to the reftest harness for preferences that apply to only one of the test or reference. (Bug 743105) r=jfkthame 2012-04-10 10:56:59 -07:00
Joel Maher
883f765d75 Bug 736112 - add try/except blocks around all harnesses devicemanager initialization so we always return an error code. r=wlach 2012-03-22 10:45:30 -04:00
William Lachance
44bd779b0f Bug 736246 - DeviceManagerADB should throw an exception if we know it's not going to work. r=jmaher 2012-03-16 18:36:28 -04:00
Ms2ger
a95c45d58d No bug - Declare uri variable in StartTests() in reftest.js to fix a strict JS warning; r=themaid 2012-03-11 09:48:25 +01:00
Kyle Huey
805de2f0c9 Bug 732481: Remove the EM restart from the reftest harness. r=dbaron 2012-03-02 18:31:50 -08:00
Jeff Hammel
4821907344 Bug 727705 - remove two copies of pageloader from m-c. r=jmaher 2012-02-22 09:24:29 -05:00
Geoff Lankow
1dcb345821 Bug 718255 - Merge nsIPrefBranch2 with nsIPrefBranch - Part F, remove uses of nsIPrefBranch2 in testing/ and layout/tools/reftest/ ; r=bsmedberg 2012-01-17 15:01:25 +13:00
Jonathan Watt
9c4a0e24b5 Bug 722322 - Have the "1" and "2" keys switch between images in reftest-analyzer.xhtml. r=ehsan. 2012-01-31 13:18:09 +00:00
Mark Banner
ab3e9162f9 Bug 716238 - ThunderbirdTry: "495794-1.html | load failed: timed out waiting for reftest-wait to be removed" - Ensure media.autoplay.enabled is always true. r=dbaron 2012-01-24 10:07:45 +00:00
Matt Woodrow
ca8a40c7e4 Bug 718329 - Make fuzzy reftests take max tolerance values. r=roc 2012-01-23 20:56:12 +13:00
Joel Maher
f702a8e87a Bug 719140 - native android reftests fail due to missing window.innerWidth/innerHeight. r=mfinkle 2012-01-18 13:44:49 -05:00
Jeff Muizelaar
05f2c4fdbc Bug 692879. Adjust reftests so that we pass with azure-quartz. r=mwoodrow 2011-11-25 16:38:14 -08:00
Jeff Muizelaar
85f9f45459 Bug 580786. Add support for fuzzy reftest matching. r=dbaron
This will let us convert a bunch of random-if() to fuzzy-if()
2011-12-19 09:02:53 -05:00
Jeff Muizelaar
de46426f75 Bug 580786. Require gWindowUtils. r=dbaron
We should have DOMWindowUtils everywhere and
this cleans up the code.
2011-12-19 09:02:47 -05:00
Matt Brubeck
717184f6d9 Back out efd165428f08 to 4a79fefefa28 (bug 580786, bug 716639, bug 692879, bug 717921) because of reftest error 2012-01-17 10:08:38 -08:00
Jeff Muizelaar
f13af2bd23 Bug 692879. Adjust reftests so that we pass with azure-quartz. r=mwoodrow
--HG--
extra : rebase_source : 0c98aac4ccd18a4c391446d70721e00cc39d4266
2011-11-25 16:38:14 -08:00
Jeff Muizelaar
775a0d0e9e Bug 580786. Add support for fuzzy reftest matching. r=dbaron
This will let us convert a bunch of random-if() to fuzzy-if()

--HG--
extra : rebase_source : 270b24bd17fa4dc3e019ee51c637ac65499e9a50
2011-12-19 09:02:53 -05:00
Jeff Muizelaar
21863c284b Bug 580786. Require gWindowUtils. r=dbaron
We should have DOMWindowUtils everywhere and
this cleans up the code.

--HG--
extra : rebase_source : 62382779b6a5050b4b5f301c896e68a0ccabd026
2011-12-19 09:02:47 -05:00
Ms2ger
5bd0fc389c Backout bug 580786 / bug 716639 / bug 692879 / bug 717921 / bug 692879 (2dc5909e63b0:ced751d32df6); a=philor 2012-01-17 10:48:19 +01:00