Commit Graph

76 Commits

Author SHA1 Message Date
Joel Maher
f75f2eac35 Bug 843105 - allow robocop tests to be run in chunks. r=ted 2013-02-21 09:03:02 -05:00
Jonathan Griffin
5953760fa3 Bug 826135 - Fix --utility-path error on Fennec, r=gbrown 2013-01-25 11:35:15 -08:00
Jonathan Griffin
583aa2da18 Bug 826135 - Throw if --utility-path points to ARM version of xpcshell, r=ahal 2013-01-03 17:37:26 -08:00
Geoff Brown
434d3a9919 Bug 822823 - Dump logcat on any robocop failure; r=jmaher 2013-01-10 02:24:58 -07:00
Joel Maher
ba821b29a2 Bug 826769 - make mochitest-robotium may fail with: OSError: [Errno 2] No such file or directory: '/tmp/xxx/tests.jar'. r=gbrown 2013-01-04 13:42:32 -05:00
Joel Maher
80517d8d67 Bug 826308 - Robocop tests log output should contain begin/end block markers for the full test run. r=bc 2013-01-04 13:42:22 -05:00
Joel Maher
044f2bca27 Bug 736105 - robocop does a lot of redundant copying of profile and sleeps, we can cut runtime almost in half. r=gbrown 2012-12-28 07:18:22 -05:00
Geoff Brown
a881cc33fe Bug 810347 - Provide option for setting remote test root; r=jmaher 2012-12-20 09:11:11 -07:00
Geoff Brown
fae430bbe9 Bug 819093 - Use strings for env values in remote mochitest; r=jmaher DONTBUILD 2012-12-07 09:04:01 -07:00
Ed Morley
c1020239e9 Bug 816532 - Print logcat for failed robocop tests; r=gbrown 2012-12-04 15:54:37 +00:00
Joel Maher
7931aa2846 Bug 811444 - panda boards magically reboot in the middle of the test. r=ted 2012-11-28 10:23:11 -05:00
Ed Morley
bf7072426a Bug 814011 - Robocop should output the runTests() return code for that batch of tests, if non-zero; r=gbrown 2012-11-21 18:57:11 +00:00
Ed Morley
dc8a9941a8 Bug 814013 - Always print the final robocop pass/fail summary, even if we received a non-zero return value; r=gbrown 2012-11-21 18:53:48 +00:00
Ed Morley
f925758d29 Bug 808410 - Ensure non-zero return values for robocop tests aren't overwritten by later success; r=gbrown 2012-11-20 15:24:28 +00:00
William Lachance
f81e82b933 Bug 805116 - Print more of the logcat in mobile tests;r=gbrown 2012-11-12 13:57:13 -08:00
Ed Morley
157e0ef0a7 Bug 808417 - Make runTests() exception reporting consistent across test harnesses; r=jmaher 2012-11-05 13:03:55 +00:00
William Lachance
e5adaff9ff Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Joel Maher
7217f498ae Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-16 13:25:23 -04:00
Joel Maher
55205d9eef Backout e814e12508af (bug 799107), 45863b00372b (bug 801633), 2012-10-15 13:33:37 -04:00
Joel Maher
c321e288af Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 11:13:44 -04:00
William Lachance
3d699579d7 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
Joel Maher
b8e9d0187b Backout f271acb304c2 (bug 799107), 2012-10-15 09:08:41 -04:00
Joel Maher
2229b63364 Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 07:10:49 -04:00
Brian Nicholson
ea3698b8de Bug 769145 - Part 6: Update test cases for layout changes. r=mfinkle 2012-10-05 17:27:12 -07:00
William Lachance
54d781abf7 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joel Maher
d37007e0cd Bug 797112 - we have a call to dm.checkCmd and that api doesn't exist anymore. r=wlach 2012-10-03 11:07:31 -04:00
Bob Clary
9f3fa1ad30 Bug 789086 - use unique temporary filename for robotium.config file in mochitest/runtestsremote.py, r=jmaher. 2012-09-28 12:25:46 -07:00
Kartikaya Gupta
e240f0d40d Bug 767449 - Allow robotium tests to put files in places other than /mnt/sdcard. r=jmaher 2012-09-12 07:56:31 -04:00
William Lachance
5703f08863 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Joel Maher
8d12e67e5b Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Brian Nicholson
355e9fdee1 Bug 586885 - Add raw host to robotium.config. r=jmaher 2012-06-05 14:07:14 -07:00
Gervase Markham
ca171eec44 Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Joel Maher
0af5cc572e Bug 736920 - mochitest-robocop log parser shouldn't repeat the whole test log, particularly not with spurious blank lines. r=gbrown 2012-03-22 10:45:20 -04:00
William Lachance
2aaf5fef98 Bug 736246 - DeviceManagerADB should throw an exception if we know it's not going to work. r=jmaher 2012-03-16 18:36:28 -04:00
Joel Maher
ea3e6037cf Bug 717018 - merge robotium logs into a single logfile. r=gbrown,jhammel 2012-02-09 08:49:00 -05:00
Joel Maher
3c8ca91d37 Bug 717057 - allow robotium testPan to run in talos. r=kats,gbrown 2012-02-02 10:09:26 -05:00
Kartikaya Gupta
16bb852dae Bug 722367 - Update path to robocop.apk and fennec_ids.txt in mochitest-robotium target. r=jmaher 2012-01-30 13:14:47 -05:00
Ms2ger
924b63075d Merge m-c to m-i. 2012-01-25 11:06:40 +01:00
Ms2ger
ef174bdccd Bug 718271 - Use TEST-UNEXPECTED-FAIL instead of TEST-UNEXPECTED-ERROR; r=jmaher 2012-01-25 08:50:04 +01:00
Joel Maher
b14919c589 Bug 716732 - Robocop: fennec_ids.txt not always generated. r=kats 2012-01-11 08:50:10 -05:00
Joel Maher
5d75016d73 Bug 710445 - Add support for packaging tests in a specific directory. r=gbrown 2012-01-07 18:41:08 -05:00
Joel Maher
bf6761d74e Bug 715309 - robocop needs to have a more uniform log format. r=gbrown 2012-01-07 18:41:08 -05:00
Ed Morley
71e7d54a52 Backout 8ec01f6f316f (bug 705175), a1dc0efef542 (bug 716077), b5686f25b258 (bug 710445), 32f8d3be2ad1 (bug 715309) for mochitest/reftest failures on Android & Windows 2012-01-07 14:57:58 +00:00
Joel Maher
7e0987f21b Bug 710445 - Add support for packaging tests in a specific directory. r=gbrown 2012-01-07 08:25:05 -05:00
Joel Maher
003af6373f Bug 715309 - robocop needs to have a more uniform log format. r=gbrown 2012-01-07 08:25:05 -05:00
Geoff Brown
21f809c119 Bug 715408 - Delete any existing remote profile before running mochitest-remote; r=jmaher 2012-01-06 08:37:54 -05:00
Geoff Brown
9c22c4a962 Bug 717684 - Robocop: better diagnostics when TEST_PATH incorrect; r=jmaher 2012-01-24 09:46:34 -05:00
Joel Maher
a15d982fcf Bug 701076 - [hoooking up make] Robotium integration into birch tree. r=blassey,bear 2011-12-31 10:03:36 -05:00
Phil Ringnalda
a5baca4aac Back out 04ef7f564450 (bug 701076) and 632f07583bd8 (bug 711591) for mochitest-oth bustage 2011-12-30 14:19:30 -08:00
Joel Maher
e67402658e Bug 701076 - [hookup to make] Robotium integration into birch tree. r=blassey,bear 2011-12-30 15:57:34 -05:00