Commit Graph

91 Commits

Author SHA1 Message Date
Adrian Tamas
3d2d301d51 Bug 833832 - Robocop: Add test for Import from Android feature. r=jmaher 2013-03-18 11:15:17 +02:00
Nick Alexander
cd7f2a1a11 Bug 863445 - Part 2: Specify Robocop APK on runtestsremote.py command line. r=jmaher
This deprecates --robocop in favour of --robocop-ini, and
--robocopPath in favour of --robocop-apk.
2013-05-20 11:39:50 -07:00
Geoff Brown
6c5741a764 Bug 872244 - Dump ANR stack traces after Android tests; r=jmaher 2013-05-16 14:32:52 -06:00
Ed Morley
6dcc2dc064 Backed out changeset 611c81436abe (bug 863445) 2013-05-13 12:31:13 +01:00
Nick Alexander
4636418f89 Bug 863445 - Part 2: Specify Robocop APK on runtestsremote.py command line. r=jmaher
This deprecates --robocop in favour of --robocop-ini, and
--robocopPath in favour of --robocop-apk.
2013-05-11 16:53:48 -07:00
Nick Alexander
403b679bb3 Backed out e7739a472f09, 3fd142236a0f, and 382ec69cdfb1 (Bug 863445) for Android rc1 and rc2 failures on a CLOSED TREE. r=me
--HG--
rename : mobile/android/base/fennec-ids-generator.py => build/mobile/robocop/parse_ids.py
2013-05-10 21:38:52 -07:00
Nick Alexander
575b7d8846 Bug 863445 - Part 2: Specify Robocop APK on runtestsremote.py command line. r=jmaher
This deprecates --robocop in favour of --robocop-ini, and
--robocopPath in favour of --robocop-apk.
2013-05-10 18:39:00 -07:00
Geoff Brown
dfa723b35a Bug 865944 - Use top activity instead of process to check launch success; r=jmaher 2013-05-03 11:37:59 -06:00
Geoff Brown
def2932c46 Bug 833765 - Increase default sut timeout to 320 s during rc tests; r=jmaher DONTBUILD 2013-04-08 12:34:45 -06:00
Geoff Brown
cda57e13d7 Bug 855146 - Enable SpecialPowers in robocop tests; r=jmaher 2013-04-03 21:11:26 -06:00
Geoff Brown
a95712a6e7 Bug 854549 - Dump robocop screenshot to logs and cleanup; r=jmaher 2013-03-26 11:31:23 -06:00
Chris Lord
b44f857469 Bug 846772 - Disable dynamic toolbar on robocop tests. r=kats,jmaher
Pretty much all of the robocop tests that involve input assumed a static UI.
Making them compatible with the dynamic toolbar would require a considerable
rethink, so turn it off by default. We can introduce robocop tests specifically
for the dynamic toolbar later.
2013-03-12 18:32:26 +00:00
Ryan VanderMeulen
40b591683c Backed out 5 changesets (bug 846772) for Android reftest-3 orange on a CLOSED TREE. 2013-03-12 17:37:16 -04:00
Chris Lord
e4e8a01757 Bug 846772 - Disable dynamic toolbar on robocop tests. r=kats,jmaher
Pretty much all of the robocop tests that involve input assumed a static UI.
Making them compatible with the dynamic toolbar would require a considerable
rethink, so turn it off by default. We can introduce robocop tests specifically
for the dynamic toolbar later.
2013-03-12 18:32:26 +00:00
Geoff Brown
f048b04d97 Bug 784242 - set browser.viewport.scaleRatio during robocop tests; r=kats 2013-03-07 14:05:24 -07:00
Joel Maher
f75f2eac35 Bug 843105 - allow robocop tests to be run in chunks. r=ted 2013-02-21 09:03:02 -05:00
Jonathan Griffin
5953760fa3 Bug 826135 - Fix --utility-path error on Fennec, r=gbrown 2013-01-25 11:35:15 -08:00
Jonathan Griffin
583aa2da18 Bug 826135 - Throw if --utility-path points to ARM version of xpcshell, r=ahal 2013-01-03 17:37:26 -08:00
Geoff Brown
434d3a9919 Bug 822823 - Dump logcat on any robocop failure; r=jmaher 2013-01-10 02:24:58 -07:00
Joel Maher
ba821b29a2 Bug 826769 - make mochitest-robotium may fail with: OSError: [Errno 2] No such file or directory: '/tmp/xxx/tests.jar'. r=gbrown 2013-01-04 13:42:32 -05:00
Joel Maher
80517d8d67 Bug 826308 - Robocop tests log output should contain begin/end block markers for the full test run. r=bc 2013-01-04 13:42:22 -05:00
Joel Maher
044f2bca27 Bug 736105 - robocop does a lot of redundant copying of profile and sleeps, we can cut runtime almost in half. r=gbrown 2012-12-28 07:18:22 -05:00
Geoff Brown
a881cc33fe Bug 810347 - Provide option for setting remote test root; r=jmaher 2012-12-20 09:11:11 -07:00
Geoff Brown
fae430bbe9 Bug 819093 - Use strings for env values in remote mochitest; r=jmaher DONTBUILD 2012-12-07 09:04:01 -07:00
Ed Morley
c1020239e9 Bug 816532 - Print logcat for failed robocop tests; r=gbrown 2012-12-04 15:54:37 +00:00
Joel Maher
7931aa2846 Bug 811444 - panda boards magically reboot in the middle of the test. r=ted 2012-11-28 10:23:11 -05:00
Ed Morley
bf7072426a Bug 814011 - Robocop should output the runTests() return code for that batch of tests, if non-zero; r=gbrown 2012-11-21 18:57:11 +00:00
Ed Morley
dc8a9941a8 Bug 814013 - Always print the final robocop pass/fail summary, even if we received a non-zero return value; r=gbrown 2012-11-21 18:53:48 +00:00
Ed Morley
f925758d29 Bug 808410 - Ensure non-zero return values for robocop tests aren't overwritten by later success; r=gbrown 2012-11-20 15:24:28 +00:00
William Lachance
f81e82b933 Bug 805116 - Print more of the logcat in mobile tests;r=gbrown 2012-11-12 13:57:13 -08:00
Ed Morley
157e0ef0a7 Bug 808417 - Make runTests() exception reporting consistent across test harnesses; r=jmaher 2012-11-05 13:03:55 +00:00
William Lachance
e5adaff9ff Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Joel Maher
7217f498ae Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-16 13:25:23 -04:00
Joel Maher
55205d9eef Backout e814e12508af (bug 799107), 45863b00372b (bug 801633), 2012-10-15 13:33:37 -04:00
Joel Maher
c321e288af Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 11:13:44 -04:00
William Lachance
3d699579d7 Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
Joel Maher
b8e9d0187b Backout f271acb304c2 (bug 799107), 2012-10-15 09:08:41 -04:00
Joel Maher
2229b63364 Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 07:10:49 -04:00
Brian Nicholson
ea3698b8de Bug 769145 - Part 6: Update test cases for layout changes. r=mfinkle 2012-10-05 17:27:12 -07:00
William Lachance
54d781abf7 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joel Maher
d37007e0cd Bug 797112 - we have a call to dm.checkCmd and that api doesn't exist anymore. r=wlach 2012-10-03 11:07:31 -04:00
Bob Clary
9f3fa1ad30 Bug 789086 - use unique temporary filename for robotium.config file in mochitest/runtestsremote.py, r=jmaher. 2012-09-28 12:25:46 -07:00
Kartikaya Gupta
e240f0d40d Bug 767449 - Allow robotium tests to put files in places other than /mnt/sdcard. r=jmaher 2012-09-12 07:56:31 -04:00
William Lachance
5703f08863 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Joel Maher
8d12e67e5b Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Brian Nicholson
355e9fdee1 Bug 586885 - Add raw host to robotium.config. r=jmaher 2012-06-05 14:07:14 -07:00
Gervase Markham
ca171eec44 Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Joel Maher
0af5cc572e Bug 736920 - mochitest-robocop log parser shouldn't repeat the whole test log, particularly not with spurious blank lines. r=gbrown 2012-03-22 10:45:20 -04:00
William Lachance
2aaf5fef98 Bug 736246 - DeviceManagerADB should throw an exception if we know it's not going to work. r=jmaher 2012-03-16 18:36:28 -04:00
Joel Maher
ea3e6037cf Bug 717018 - merge robotium logs into a single logfile. r=gbrown,jhammel 2012-02-09 08:49:00 -05:00