Commit Graph

496 Commits

Author SHA1 Message Date
Phil Ringnalda
06baaa818a Back out fb167937d25b (bug 799332) because I fail at copy-paste 2012-10-15 21:02:56 -07:00
Phil Ringnalda
a0ada57ef1 Bug 799332 - Set a high urlclassifier.updateinterval to match the one in automation.py.in so that we're unlikely to leak background safebrowsing updates by doing them at the wrong time, r=dbaron 2012-10-08 21:04:39 -07:00
David Zbarsky
52e0277cdc Bug 799407: Enable FAIL_ON_WARNINGS in more of layout/ r=roc 2012-10-15 01:42:40 -04:00
William Lachance
3d699579d7 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
David Zbarsky
47da3f3432 Backout 784bb7c5ea9c (Bug 799407) for bustage 2012-10-15 02:14:34 -04:00
David Zbarsky
92d607b47a Bug 799407: Enable FAIL_ON_WARNINGS in more of layout/ r=roc 2012-10-15 01:42:40 -04:00
Jeff Hammel
884b0385b0 Bug 800110 - Mirror mozbase -> m-c for bug 800097 @ da60c88b8c ;r=ahal,r=wlach 2012-10-12 10:24:35 -07:00
Gregory Szorc
2bb5606ff3 Bug 799291 - Part 3: Move mozbuild.testing into testing/; r=jhammel
--HG--
rename : python/mozbuild/mozbuild/testing/test.py => testing/moztesting/util.py
2012-10-10 11:08:09 -07:00
Gregory Szorc
97cce3a53e Bug 799291 - Part 1: Move mach commands for test running into test runners; r=jhammel
The code interacting with the test runners now resides in closer
proximity to the code it is invoking. We also purge testing
functionality from mozbuild, which is where it never really belonged.

--HG--
rename : python/mozbuild/mozbuild/testing/reftest.py => layout/tools/reftest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/mochitest.py => testing/mochitest/mach_commands.py
rename : python/mozbuild/mozbuild/testing/xpcshell.py => testing/xpcshell/mach_commands.py
2012-10-10 11:08:09 -07:00
Andrew Halberstadt
c4f991bfaf Bug 795099 - Add --gecko-path argument to runreftestb2g.py, r=jgriffin; DONTBUILD because NPOTB 2012-10-05 11:12:05 -04:00
Andrew Halberstadt
bb8b4e4177 Bug 797177 - Fix missed calls to checkCmd within B2G automation, r=mikeh; DONTBUILD because NPOTB 2012-10-05 16:06:02 -04:00
William Lachance
54d781abf7 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joe Drew
85c156d2ef Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Joel Maher
cfdbdd9667 Bug 792029 - Make SpecialPowers available in crashtests. r=ted 2012-10-01 08:50:10 -04:00
Ms2ger
a72f8370a2 Bug 795862 - Back out bug 486918 for build bustage in unreviewed code. 2012-10-01 14:16:03 +02:00
Joe Drew
4b9e01692f Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar 2012-09-27 14:12:56 -04:00
Ed Morley
722b933229 Backout 92530b29ac24, 42e659956dc6 & 38277196c099 (bug 486918), d3b69fe15ac3 & b2dba2108722 (bug 786444), e7381ac9e30a (bug 786449) on suspicion of causing Android reftest failures on a CLOSED TREE 2012-09-28 23:00:28 +01:00
Joe Drew
db8e984995 Bug 486918 - Create and obey a high-quality downscaling pref, and turn it off on OS X and mobile. r=jlebar
--HG--
extra : rebase_source : 386bee19522e3cb8bca16ec40e3c092a52ae18d2
2012-09-27 14:12:56 -04:00
Matt Woodrow
6f1f6c2930 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
58d3d65ab2 Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
Ed Morley
c863356300 Revert mozilla-inbound to e4dd1fa6d222 for crashes and test failures on a CLOSED TREE 2012-09-27 16:34:46 +01:00
Matt Woodrow
fa1bb9fa65 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-08-29 17:48:43 +12:00
Matt Woodrow
0b20201fde Bug 539356 - Part 10 - Test changes required for DLBI. r=roc
* * *
[mq]: test-fixes
2012-08-29 17:48:13 +12:00
L. David Baron
83a028dd10 Make reftest harness print max difference and number of differing pixels on the TEST-UNEXPECTED-FAIL line so that it ends up in bugs. (Bug 789602) r=ted 2012-09-14 14:12:34 -07:00
L. David Baron
4fcc5c63de Bug 789771 - Add an OSX variable to the reftest condition sandbox to make it easier to test Mac OS X versions, r=roc
--HG--
extra : rebase_source : 417fcaf6baa267680d93187c459532a22da8ef21
2012-09-08 23:37:04 -07:00
William Lachance
6a7b472377 Bug 723107 - Re-add mozdevice to testing/mozbase, remove duplicate files in build/mobile;r=jmaher 2012-09-07 16:00:31 -04:00
Jeff Gilbert
0397411c16 Bug 782860 - Mark failing WebGL reftests as failing - r=bjacob 2012-09-06 18:46:43 -07:00
Philipp von Weitershausen
5801c8b2ab Bug 776825 - Separate message managers into senders and broadcasters. r=smaug
--HG--
rename : content/base/public/nsIFrameMessageManager.idl => content/base/public/nsIMessageManager.idl
2012-08-27 11:13:02 -03:00
Cameron McCormack
838d438629 Bug 705184 - Count unexpected reftest crash dump files as test failures. r=dbaron 2011-12-05 14:06:42 +11:00
Andrew Halberstadt
b36ba7fadb Bug 784810 - Disable browser.tabs.remote for b2g reftests, r=jgriffin 2012-08-22 17:24:57 -04:00
Ehsan Akhgari
0fd9123eac Bug 579517 - Part 1: Automated conversion of NSPR numeric types to stdint types in Gecko; r=bsmedberg
This patch was generated by a script.  Here's the source of the script for
future reference:

function convert() {
echo "Converting $1 to $2..."
find . ! -wholename "*nsprpub*" \
       ! -wholename "*security/nss*" \
       ! -wholename "*/.hg*" \
       ! -wholename "obj-ff-dbg*" \
       ! -name nsXPCOMCID.h \
       ! -name prtypes.h \
         -type f \
      \( -iname "*.cpp" \
         -o -iname "*.h" \
         -o -iname "*.c" \
         -o -iname "*.cc" \
         -o -iname "*.idl" \
         -o -iname "*.ipdl" \
         -o -iname "*.ipdlh" \
         -o -iname "*.mm" \) | \
    xargs -n 1 sed -i -e "s/\b$1\b/$2/g"
}

convert PRInt8 int8_t
convert PRUint8 uint8_t
convert PRInt16 int16_t
convert PRUint16 uint16_t
convert PRInt32 int32_t
convert PRUint32 uint32_t
convert PRInt64 int64_t
convert PRUint64 uint64_t

convert PRIntn int
convert PRUintn unsigned

convert PRSize size_t

convert PROffset32 int32_t
convert PROffset64 int64_t

convert PRPtrdiff ptrdiff_t

convert PRFloat64 double
2012-08-22 11:56:38 -04:00
Andrew Halberstadt
a8758eb38d Bug 778072 - Add pref for reftests to use iframe mozbrowser. r=cjones 2012-08-17 11:45:39 -04:00
Andrew Halberstadt
b54c314054 Bug 778725 - Fix program error managing snapshot errors in b2g reftests, r=jgriffin 2012-08-15 17:36:52 -04:00
Andrew Halberstadt
d6f030c237 Bug 782655 - Enable remote xul for B2G reftests, r=jgriffin 2012-08-15 15:26:31 -04:00
Ed Morley
9cdd0db8cb Merge mozilla-central to mozilla-inbound 2012-08-15 19:00:48 +01:00
Kyle Huey
f8ba220f4b Bug 685516: Disable a bunch of failing tests on Android XUL. r=jrmuizel 2012-08-13 11:22:11 -07:00
Andrew Halberstadt
8eadf46d4b Bug 770490 - Infrastructure to run reftests on B2G, r=jgriffin 2012-08-10 14:25:20 -04:00
Aryeh Gregor
1091dc5149 Bug 782252 - Change named constants to correct types; r=ehsan 2012-08-07 18:11:35 +03:00
Mike Hommey
6173fa297f Bug 774032 bonus - Use @DEPTH@ and @relativesrcdir@ in Makefile.in. r=ted 2012-08-04 20:26:44 +02:00
Nicholas Cameron
ece36988b4 Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 18:30:10 +12:00
Nicholas Cameron
9f4ddcf0fb Bug 776802; Give better info about Azure. r=Bas 2012-07-31 18:30:10 +12:00
Nicholas Cameron
db90500fee Back out bug 779001, bug 746883, bug 778595, bug 776803, bug 7118849 2012-07-31 18:17:23 +12:00
Nicholas Cameron
19913d66a9 Bug 778595; reftest fuzz based on cavnas/content backend mismatch. r=roc 2012-07-31 13:46:04 +12:00
Nicholas Cameron
12480ec1e9 Bug 776802; Give better info about Azure. r=Bas 2012-07-31 13:45:59 +12:00
Ehsan Akhgari
b40b21d633 Merge the nullptr conversion from mozilla-central into mozilla-inbound 2012-07-30 10:28:15 -04:00
Aryeh Gregor
e806eeab4f Bug 777292 part 2 - Change all nsnull to nullptr 2012-07-30 17:20:58 +03:00
Christian Holler
c039124fd1 Bug 777412 - Support the --setenv option in reftests 2012-07-30 13:47:27 +02:00
Ed Morley
231f919786 Backout 6718d4c7b6c1 (bug 775174) for Android XUL R3 failures in animateMotion-rotate-*.svg on a CLOSED TREE 2012-07-28 11:31:26 +01:00
Matt Woodrow
d97548ced3 Bug 729784 - Fix documentation for fuzzy() and fuzzy-if(), and give image difference error messages in the same order as the parameters to them. r=dbaron 2012-07-28 13:47:46 +12:00
Matt Woodrow
a2cc304146 Bug 775174 - Add invalidation timeline to reftest analyzer. r=dbaron 2012-07-28 13:46:42 +12:00
William Lachance
5703f08863 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Jonas Sicking
68ce0e34aa Bug 774585: Rename getCodebasePrincipal to getSimpleCodebasePrincipal since the behavior has semantically changed. r=mounir 2012-07-21 00:29:40 -07:00
Mounir Lamouri
96545b3886 Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Ed Morley
80af77da9d Backout ea6db8f420c0 (bug 770831), b51c79ee0883 (bug 774957), 020f6ed5958b (bug 758258), 11d8e19e1fca (bug 758258), 707fc51bfe2e (bug 775354), 489d944a6fe6 (bug 327244), be7df3c9d50f (bug 327244) for m-oth orange 2012-07-19 08:29:48 +01:00
Mounir Lamouri
8a2133a405 Bug 327244 (2/2) - Remove nsIScriptSecurityManager::CheckLoadURI(). r=sicking,jlebar 2012-07-18 15:27:02 -07:00
Phil Ringnalda
73caf826a2 Bug 752752 - Set prefs in the reftest harness to prevent updating and prefetching data about addons, to avoid leaking, r=Unfocused,dbaron 2012-05-25 21:29:35 -07:00
Ehsan Akhgari
df2fb388c2 Backout changeset e04abde1b323 (bug 539356) because of performance and correctness regressions 2012-07-03 20:21:03 -04:00
Ehsan Akhgari
55cdeecc72 Backout changeset ba7021170544 (bug 539356) because of performance and correctness regressions 2012-07-03 20:12:45 -04:00
David Zbarsky
ae718ee1c0 Bug 763350 - Clean up some includes in content/ and dom/ r=smaug 2012-07-01 16:45:59 -07:00
Matt Woodrow
0664c2e210 Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-06-30 15:06:13 +12:00
Matt Woodrow
c96dc0e2ed Bug 539356 - Part 10 - Test changes required for DLBI. r=roc 2012-06-30 15:06:11 +12:00
Nicholas Cameron
28174a115b Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar 2012-04-16 07:49:56 +12:00
Joel Maher
8d12e67e5b Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Matt Brubeck
8aad0a2626 Back out bug 761890, bug 746896, and bug 759036 because of reftest failures
--HG--
extra : rebase_source : b5bdad8a69eab8e9ba35d21637c0bbcb18bce703
2012-06-11 22:50:31 -07:00
Nicholas Cameron
a0b45381db Bug 761890 (was 746883); change tests to work with Azure/Skia (mostly fuzz). r=gw280,jmuizelaar
--HG--
extra : rebase_source : 8df12107009253df9ae996a9cbf1f78fc594f41f
2012-04-16 07:49:56 +12:00
Ed Morley
a73fc227f9 Backout 61fd66629c4f, 7c8121f8d3af & 2a2e9cf8fd41 (bug 539356), e31a5e6545d3 (bug 761884), 85fa80bd9792, a284ccb25b83, 2865904db9fc, 34e07b09c426, e9b3d41e0360, cef00ebcd6c8, f943b729ac14 & 783f298401b6 (bug 539356), 330a086f1570 (bug 741682), d80219c8842c (bug 739671), e8c96b4fd4da, 313af486e68d, 0adc41ff56dc, 0cd288a38085, f1d43208825c, 4859876972f3, eec8ef3ebe48, f7f29fcd1845, 6079b229d306, f23c3a7e7ce0, 9824458a41e2 & 6748b5496059 (bug 539356) for mochitest-4 orange & talos regressions on multiple platforms 2012-06-11 10:08:32 +01:00
Matt Woodrow
ddc048ce6a Bug 539356 - Part 22 - Force a background color when running android reftests. r=roc 2012-06-11 16:45:39 +12:00
Matt Woodrow
d8b05307aa Bug 539356 - Part 10 - Test changes required for DLBI. r=roc 2012-06-11 16:45:38 +12:00
Geoff Lankow
00f3a215c9 Bug 749930 - Replace uses of nsILocalFile with nsIFile (compiled code only); r=bsmedberg 2012-06-06 14:08:30 +12:00
Kartikaya Gupta
d9f987bb7f Bug 759421 - Handle image load errors in the reftest analyzer more gracefully. r=heycam 2012-05-30 09:59:42 -04:00
Ehsan Akhgari
6bf9c2ea8a Bug 757755 - Make sure that the reftest suite never attempts to download and stage an update; r=dbaron 2012-05-23 18:32:41 -04:00
Gregory Szorc
3831df8bd3 Bug 757397 - Make test package generation quieter; r=ted
This may reduce the size of the buildbot build logs by up to half!

--HG--
extra : rebase_source : 87b3f2f40654d69ecd91e19520e2341fc8aac9a6
2012-05-23 16:51:21 +02:00
Gervase Markham
ca171eec44 Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Kyle Huey
fc156faf07 Bug 745681: Prepare the reftest harness for Bug 695480. r=dbaron a=test-only 2012-04-23 13:36:50 -07:00
Armen Zambrano Gasparnian
640ca7ce08 Bug 735451. raise exception when DeviceManager fails to initialize. r=jmaher 2012-04-11 14:51:18 -04:00
L. David Baron
edeb71a2b4 Add support to the reftest harness for preferences that apply to only one of the test or reference. (Bug 743105) r=jfkthame 2012-04-10 10:56:59 -07:00
Joel Maher
a470bd0c67 Bug 736112 - add try/except blocks around all harnesses devicemanager initialization so we always return an error code. r=wlach 2012-03-22 10:45:30 -04:00
William Lachance
2aaf5fef98 Bug 736246 - DeviceManagerADB should throw an exception if we know it's not going to work. r=jmaher 2012-03-16 18:36:28 -04:00
Ms2ger
477d52d719 No bug - Declare uri variable in StartTests() in reftest.js to fix a strict JS warning; r=themaid 2012-03-11 09:48:25 +01:00
Kyle Huey
e1c10e9464 Bug 732481: Remove the EM restart from the reftest harness. r=dbaron 2012-03-02 18:31:50 -08:00
Jeff Hammel
3806f8dd6c Bug 727705 - remove two copies of pageloader from m-c. r=jmaher 2012-02-22 09:24:29 -05:00
Geoff Lankow
61a628c863 Bug 718255 - Merge nsIPrefBranch2 with nsIPrefBranch - Part F, remove uses of nsIPrefBranch2 in testing/ and layout/tools/reftest/ ; r=bsmedberg 2012-01-17 15:01:25 +13:00
Jonathan Watt
e4df3973a0 Bug 722322 - Have the "1" and "2" keys switch between images in reftest-analyzer.xhtml. r=ehsan. 2012-01-31 13:18:09 +00:00
Mark Banner
639178d57a Bug 716238 - ThunderbirdTry: "495794-1.html | load failed: timed out waiting for reftest-wait to be removed" - Ensure media.autoplay.enabled is always true. r=dbaron 2012-01-24 10:07:45 +00:00
Matt Woodrow
c869eebf05 Bug 718329 - Make fuzzy reftests take max tolerance values. r=roc 2012-01-23 20:56:12 +13:00
Joel Maher
9d0a3bf624 Bug 719140 - native android reftests fail due to missing window.innerWidth/innerHeight. r=mfinkle 2012-01-18 13:44:49 -05:00
Jeff Muizelaar
c3eafa7bb4 Bug 692879. Adjust reftests so that we pass with azure-quartz. r=mwoodrow 2011-11-25 16:38:14 -08:00
Jeff Muizelaar
810ffed8d0 Bug 580786. Add support for fuzzy reftest matching. r=dbaron
This will let us convert a bunch of random-if() to fuzzy-if()
2011-12-19 09:02:53 -05:00
Jeff Muizelaar
28cda7b681 Bug 580786. Require gWindowUtils. r=dbaron
We should have DOMWindowUtils everywhere and
this cleans up the code.
2011-12-19 09:02:47 -05:00
Matt Brubeck
0dc4c17288 Back out efd165428f08 to 4a79fefefa28 (bug 580786, bug 716639, bug 692879, bug 717921) because of reftest error 2012-01-17 10:08:38 -08:00
Jeff Muizelaar
df4a0a80f2 Bug 692879. Adjust reftests so that we pass with azure-quartz. r=mwoodrow
--HG--
extra : rebase_source : 0c98aac4ccd18a4c391446d70721e00cc39d4266
2011-11-25 16:38:14 -08:00
Jeff Muizelaar
ef364081df Bug 580786. Add support for fuzzy reftest matching. r=dbaron
This will let us convert a bunch of random-if() to fuzzy-if()

--HG--
extra : rebase_source : 270b24bd17fa4dc3e019ee51c637ac65499e9a50
2011-12-19 09:02:53 -05:00
Jeff Muizelaar
0ae8761f9d Bug 580786. Require gWindowUtils. r=dbaron
We should have DOMWindowUtils everywhere and
this cleans up the code.

--HG--
extra : rebase_source : 62382779b6a5050b4b5f301c896e68a0ccabd026
2011-12-19 09:02:47 -05:00
Ms2ger
ce301744c0 Backout bug 580786 / bug 716639 / bug 692879 / bug 717921 / bug 692879 (2dc5909e63b0:ced751d32df6); a=philor 2012-01-17 10:48:19 +01:00
Jeff Muizelaar
a8aba1ac9f Bug 692879. Adjust reftests so that we pass with azure-quartz. r=mwoodrow 2011-11-25 16:38:14 -08:00
Jeff Muizelaar
e799e75ed2 Bug 580786. Add support for fuzzy reftest matching. r=dbaron
This will let us convert a bunch of random-if() to fuzzy-if()
2011-12-19 09:02:53 -05:00
Jeff Muizelaar
f72e0fde2a Bug 580786. Require gWindowUtils. r=dbaron
We should have DOMWindowUtils everywhere and
this cleans up the code.
2011-12-19 09:02:47 -05:00
Markus Stange
76504f5eaa Bug 598482 part 20 - Rename Update to Invalidate; view updates are now always asynchronous. r=roc 2011-12-23 22:52:25 -05:00
Markus Stange
cb70f28632 Bug 598482 part 7 - Remove NS_VMREFRESH_* flags. NS_VMREFRESH_NO_SYNC is now the unchangable default. r=roc 2011-12-23 22:52:22 -05:00
Josh Matthews
f6175f00b5 Bug 717512 - Use focusedWindow instead of activeWindow when requesting focus for needs-focus tests. r=ehsan 2012-01-12 14:49:52 -05:00