Commit Graph

131 Commits

Author SHA1 Message Date
Nathan Froyd
de3ea923d8 Bug 943734 - escape URL arguments in mochitests for the benefit of LLDB; r=jmaher 2013-12-03 13:01:30 -05:00
Ed Morley
c24642b1cf Bug 943474 - Don't print the overall summary for shutdown leak detector failures; r=ttaubert 2013-11-27 13:52:02 +00:00
Nathan Froyd
fe92755429 Bug 938289 - part 1 - add automation support for adding DMD environment variables; r=jmaher 2013-11-13 14:47:41 -05:00
Ryan VanderMeulen
4e7cc6f723 Merge m-c to fx-team. 2013-11-21 11:39:17 -05:00
Tim Taubert
43e6f8fbea Bug 932898 - Bring back the shutdown leak detector r=ted
From 246109686e62e3231ccba74a84adaa0774f2a1af Mon Sep 17 00:00:00 2001
2013-11-20 21:53:08 +01:00
Ryan VanderMeulen
a71b7b3297 Backed out changeset 53627e59f761 (bug 932898) for mochitest-mc timeouts. 2013-11-20 14:30:30 -05:00
Tim Taubert
baf875e928 Bug 932898 - Bring back the shutdown leak detector r=ted 2013-11-01 11:25:17 +01:00
Ted Mielczarek
4b8bd6bfb0 bug 914925 - fix --debugger for mochitest on OS X. r=jmaher 2013-09-16 14:44:25 -04:00
Nathan Froyd
b6b894f6cb Bug 940928 - delete redundant entry for cgdb in the debuggers list; r=jmaher 2013-11-20 06:07:53 -05:00
Christian Holler
84870e16ee Bug 934641 - Switch ASan tests to using the low-memory config instead of the mid-memory config, to work around intermittent OOM failures, r=philor 2013-11-14 01:44:41 +01:00
Christian Holler
ab472eb86c Bug 932159 - ASan: Reduce quarantine_size for mochitests to avoid OOM. rs=ted
--HG--
extra : rebase_source : 42cc093284cc38df0763e0b093371f1bc5f8ed86
2013-10-29 18:56:18 +01:00
Christian Holler
724c6c91d2 Bug 929024 - Fix ASan symbolizing for mochitests. r=ted
--HG--
extra : rebase_source : f6b4ee3a5d84ba1987f2a35abe9b28c1d45efb2e
2013-10-21 20:11:07 +02:00
Jeff Hammel
27c0972b9f Bug 921676 - mochitest screenshots fallout from bug 746243;r=ted 2013-10-05 15:28:34 -07:00
Jeff Hammel
18cf2dd6e8 Bug 746243 - port Mochitest to Mozbase;r=ted 2013-09-23 07:47:48 -07:00
Garrett Robinson
94ae55944b Bug 875126 - Make cgdb an option for mach --debugger. r=ted 2013-06-12 16:17:11 -04:00
Nathan Froyd
b5b1e03424 Bug 875332 - add cgdb to the known debuggers list; r=jmaher 2013-05-23 10:56:18 -04:00
Nathan Froyd
a7e95eedb6 Bug 873493 - add lldb to the list of known debuggers; r=jmaher 2013-05-17 11:22:00 -04:00
Joel Maher
a849266f5f Bug 827446 - update mochitest, reftest, xpcshell to use mozcrash. r=jhammel 2013-03-21 09:19:34 -04:00
Ed Morley
e978d29cf3 Bug 850681 - Part 11: Move processString to the message part of log lines & remove unhelpful process IDs; r=ted
Our standard logging format is:
TEST-{INFO,UNEXPECTED-FAIL} | testName | message

For leak logs from processes other than the main process (eg plugin processes),
currently processSingleLeakFile outputs:
TEST-{INFO,UNEXPECTED-FAIL} | foo process 123 | testName | message

This patch turns these into:
TEST-{INFO,UNEXPECTED-FAIL} | testName | foo process: message

Note: The process ID is contained in the raw leak log (which gets printed to the
log anyway), so we don't need to repeat it in the main summary log lines. In
addition, the variable process ID often breaks TBPL bug suggestions, so should
be avoided where possible.
2013-03-18 17:18:08 +00:00
Ed Morley
734e31bc68 Bug 850681 - Part 10: Tweak comments; r=ted 2013-03-18 17:18:08 +00:00
Ed Morley
80cc2c540c Bug 850681 - Part 9: Return early if possible during leak summary generation; r=ted
Now that we close the log file before summary generation (rather than at the
end of processSingleLeakFile()), we can return early in some cases during
leak summary generation.
2013-03-18 17:18:07 +00:00
Ed Morley
5712f4cef3 Bug 850681 - Part 8: Only parse the leak log once; r=ted
The existing code parses the leak log twice - first time to output the
raw log lines & and the second to output the analysis of them.

As much fun as it is to loop all the things (\o/), let's not.
2013-03-18 17:18:07 +00:00
Ed Morley
923f59d03d Bug 850681 - Part 7: Use the cleaner |with open() as foo| pattern & and don't close/reopen the log unnecessarily; r=ted 2013-03-18 17:18:06 +00:00
Ed Morley
09a9fa4aec Bug 850681 - Part 6: Clean up log parsing conditionals & move the leak threshold reminder to the calling function; r=ted
The same threshold is used for all leak logs processed from the test run, so
unnecessary to repeat for each.
2013-03-18 17:18:06 +00:00
Ed Morley
fff4f9ec3d Bug 850681 - Part 5: Clean up logging; r=ted 2013-03-18 17:18:05 +00:00
Ed Morley
ed94e8b2c2 Bug 850681 - Part 4: Add a partial list of leaked objects to the leak summary, to allow TBPL to make bug suggestions; r=ted
Current summary line:
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | leaked 216 bytes during test execution

With patch parts 1-4:
TEST-UNEXPECTED-FAIL | leakcheck | 180 bytes leaked (Mutex, ReentrantMonitor, nsRunnable, nsTArray_base, nsThread)

...or with ellipses if more than 5 objects:
TEST-UNEXPECTED-FAIL | leakcheck | 3184 bytes leaked (BackstagePass, CondVar, Mutex, ReentrantMonitor, SharedScriptableHelperForJSIID, ...)
2013-03-18 17:18:05 +00:00
Ed Morley
490b7cff8c Bug 850681 - Part 3: Output all of the leaked object lines as TEST-INFO rather than a combination of TEST-INFO and TEST-UNEXPECTED-FAIL; r=ted
Since the main leak summary will soon include an overview of the leaked objects,
we no longer need/want a subset of the individual leak lines showing up in
TBPL's annotated summary (TBPL's parser matches on 'TEST-UNEXPECTED-FAIL').
2013-03-18 17:18:04 +00:00
Ed Morley
f93c9bb039 Bug 850681 - Part 2: Wait until the full leak log has been processed before outputting the leak total; r=ted
Will allow the addition of an overview of the leaked objects, in part 4.
2013-03-18 17:18:04 +00:00
Ed Morley
0278697df2 Bug 850681 - Part 1: Use the test name 'leakcheck' rather than 'automationutils.processLeakLog()'; r=ted
Reduces the chance of line wrapping in the TBPL annotated summary, and makes
my eyes bleed less every time I see leak failures.
2013-03-18 17:18:03 +00:00
Ryan VanderMeulen
faac840dc7 Backed out changeset 1c19d2a03d90 (bug 827446) for packaging bustage on a CLOSED TREE. 2013-03-13 09:22:00 -04:00
Joel Maher
5256123c16 Bug 827446 - update mochitest, reftest, xpcshell to use mozcrash. r=jhammel 2013-03-13 07:38:00 -04:00
Ed Morley
e0d39230fc Bug 813577 - Use try/finally in checkForCrashes() to ensure minidump temp directories do not linger; r=gps 2013-02-08 16:32:07 +00:00
Ed Morley
e00f8d635f Bug 782633 - Followup to fix exception; r=me 2013-01-12 18:36:54 +00:00
Ed Morley
a10319d661 Bug 782633 - Make the "missing output line for total leaks!" failure mode a warning rather than TEST-UNEXPECTED-FAIL; r=ted 2013-01-11 22:20:21 +00:00
Ed Morley
618d19c490 Bug 817349 - Ensure topFrame is always defined; r=ted 2012-12-03 14:30:35 +00:00
Ed Morley
5d31b56d86 Bug 813650 - Part 2: checkForCrashes() should output the top frame of a crash in a TBPL-parsable format; r=ted 2012-12-01 17:02:29 +00:00
Ed Morley
178b788fed Bug 813650 - Part 1: Don't print minidump stackwalk output incrementally, so we can implement part 2 without changing log order; r=ted 2012-12-01 16:58:40 +00:00
Ed Morley
cfdb5270d1 Bug 808410 - checkForCrashes should return true for cases where we hit an exception during minidump stackwalk; r=jmaher 2012-11-20 15:24:28 +00:00
Jesse Ruderman
fe94b3e6fd Bug 789275 - Better error message when trying to process a crash report without symbols. r=wlach. DONTBUILD 2012-09-15 11:33:02 -07:00
Tim Taubert
ba79bd8b4b Bug 728294 - Part 1 - Remove old debug log parser; r=ted 2012-08-03 12:36:59 +02:00
Ed Morley
b234075bef Bug 778433 - Raise ShutdownLeakLogger's MAX_LEAK_COUNT to something less annoying, until bug 728294 lands; r=me DONTBUILD on a CLOSED TREE 2012-07-28 16:22:47 +01:00
Tim Taubert
a99e197f24 Bug 728426 - Opening and then closing bookmarks sidebar keeps the bookmarksPanel.xul and/or history-panel.xul document alive; r=dao 2012-07-21 19:37:56 +02:00
Dão Gottwald
944476b0ab Bug 767896 - disable browser_pageInfo.js
--HG--
extra : rebase_source : 315e8b6c151c6c2c23fd2b3275addc7178dd36c2
2012-07-15 17:04:07 +02:00
Ed Morley
031cf9d430 Bug 772388 - Make ShutdownLeakLogger output the list of leaking tests in a format that TBPL can individually star; r=ttaubert 2012-07-10 13:19:48 +01:00
Gervase Markham
ca171eec44 Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Dão Gottwald
5f38e25ec2 Bug 734172 - Stop blaming tests that replace the first tab for leaking. r=ttaubert 2012-05-17 16:41:08 +02:00
Tim Taubert
658ca72f8a Bug 753815 - Intermittent INFO | runtests.py | Received unexpected exception while running application; r=ted 2012-05-14 17:02:26 +02:00
Dão Gottwald
5cf39d2bfa Bug 658738 - reduce MAX_LEAK_COUNT to match the status quo 2012-05-11 12:18:50 +02:00
Dão Gottwald
90c264a25a Bug 752467 - disable leaky tests. r=zpao 2012-05-10 20:09:25 +02:00
Phil Ringnalda
7f9cae1506 Merge m-c to m-i 2012-05-04 19:49:34 -07:00
Tim Taubert
7a5fb0d3d7 Bug 740242 - runtests.py | Received unexpected exception while running application 'NoneType' object has no attribute 'group'; r=ted 2012-05-04 16:21:24 +02:00
Dão Gottwald
04e88ebd8a Bug 749361 - reduce MAX_LEAK_COUNT to match the status quo. r=ttaubert 2012-04-27 03:45:49 +02:00
Dão Gottwald
9f4754b67b Bug 751334 - Redundant TabView.init call in restoreWindow leaks the browser window when the window closes before delayedStartup was called. r=ttaubert 2012-05-04 18:17:25 +02:00
Dão Gottwald
69e1e7dd64 Bug 734554 - Increase MAX_LEAK_COUNT in order to reduce the random orange volume 2012-03-13 13:51:56 +01:00
Dão Gottwald
24c15964f4 No bug - reduce MAX_LEAK_COUNT to match the status quo 2012-03-09 11:39:11 +01:00
Dão Gottwald
f5f9c22090 No bug - reduce MAX_LEAK_COUNT to match the status quo 2012-03-07 11:59:58 +01:00
Tim Taubert
2906a4045d Bug 730773 - Track shutdown leaks when DOMWindows *or* DocShells leaked (not and); r=ctalbert 2012-03-02 12:20:20 +01:00
Tim Taubert
39e83d0057 Bug 683953 - Part 1 - Parse log output and collect statistics about leaked DOMWindows and DocShells; r=ted 2012-02-25 12:48:05 +01:00
Jesse Ruderman
685437b892 Bug 703768 - Don't confuse Windows paths with URLs. r=ted 2011-11-29 14:13:08 -08:00
William Lachance
a3bbb32ede Bug 679759 - Drop MINIDUMP_STACKWALK_CGI support, let harness download symbols as needed; r=ted 2011-11-15 04:33:21 +00:00
Cameron McCormack
5f0489f00f Bug 642175 - Part 2: Allow mochitests to clean up plugin and IPC process crash dumps. r=ted 2011-06-21 12:11:50 +12:00
Jesse Ruderman
f4c7d46370 Bug 606389 - when minidump_stack fails, show its error messages and/or exit code. r=ted, a=npotb 2010-11-06 13:30:32 -07:00
Ted Mielczarek
a2bce37bbd bug 598507 - wrap test harness process execution with 'arch -arch i386' on OS X 10.5. r=catlee, a=blocking
--HG--
extra : rebase_source : 7212fa8332fe6853f6dedd6bd23dc937f4b9ec86
2010-09-23 12:19:31 -04:00
Ted Mielczarek
1c9c3c7171 bug 569965 - automationutils.processLeakLog() should learn not to TEST-UNEXPECTED-FAIL every single object line when there are lots. r=philor
--HG--
extra : rebase_source : 4ce122222020d522f742b7e77bfacafe8f7f90bc
2010-06-10 08:27:47 -04:00
Ted Mielczarek
09691f1ca3 bug 563745 - Make automationutils.py's minidump processing able to send minidumps to minidump-stackwalk-cgi. r=catlee
--HG--
extra : rebase_source : ebbf745e5e77c55437cb05071f49d421d08956c6
2010-05-06 08:06:09 -04:00
Joel Maher
e2fbedec3f Bug 493748 Refactor xpcshell test harness to enable it to work for remote devices r=ted (comment 14) p=jmaher Landing on a CLOSED TREE 2010-03-12 14:57:29 -08:00
Ted Mielczarek
fffbd88cf3 bug 540627 - provide an environment variable to save minidumps from test runs. r=bsmedberg
--HG--
extra : rebase_source : d53ac17a06eb938e1fcd9a59e409b3467c04fed9
2010-02-03 14:15:17 -05:00
Jesse Ruderman
dc44a1f223 Bug 540518 - when searching for debugger, ignore directory names. r=jgriffin 2010-01-21 12:02:51 -08:00
Benjamin Smedberg
576026672e Bug 539290 - Test harness should look for minidumps from child (plugin) processes but not turn the tree orange automatically, r=ted
--HG--
extra : rebase_source : abc65388958859668b63342c046985e1e4083012
2010-01-12 16:53:10 -05:00
Jonathan Griffin
fb84e3c42c Bug 533482. Let plugin crashtest notify testrunner that no leak log is expected when the plugin process is deliberately crashed. r=bsmedberg 2009-12-09 10:51:38 -08:00
Jonathan Griffin
ffd9106373 Bug 519570. Log leaks for child processes in separate files, and handle them in automation.py. r=bsmedberg 2009-11-10 11:16:12 -08:00
Ted Mielczarek
85b235ad3d bug 522829 - add an extra print statement to checkForCrashes to try to figure out what's going wrong 2009-10-20 13:27:02 -04:00
Jonathan Griffin
9d1984bf9a Bug 521457. Add debugger options to runreftest.py and runxpcshelltests.py. r=ted
--HG--
extra : rebase_source : 420b33b1d44aae7361c25d8bcc15032c303aa80d
2009-10-19 16:12:09 -07:00
Ted Mielczarek
358f330e27 bug 519194 - No symbols in stack trace on tests of optimized builds (landing without review, consider it a bustage fix) 2009-10-02 14:46:49 -04:00
Serge Gautherie
b361f3d1e5 Bug 469523 - xpcshell-tests: enable leak log in tinderbox (log); (Hv1) Use automationutils.dumpLeakLog(), fix/update automationutils.processLeakLog() log messages
r=ted.mielczarek
2009-09-16 17:50:03 +02:00
Serge Gautherie
750b11805e Bug 469523 - xpcshell-tests: enable leak log in tinderbox (log); (Fv1) Move code to automationutils.py from automation.py.in
r=ted.mielczarek
2009-09-06 03:08:49 +02:00
Serge Gautherie
93b0c2ea9b Backed out changeset: f6bf83b50648 2009-08-26 22:36:55 +02:00
Serge Gautherie
ac322e6f58 Bug 469523 - xpcshell-tests: enable leak log in tinderbox (log); (Fv1) Move code to automationutils.py from automation.py.in
r=ted.mielczarek
2009-08-26 18:36:40 +02:00
Shawn Wilsher
f92ecf4991 Reverting accidental changes to build/automationutils.py from changeset 06433d3dafd9. 2009-07-22 12:24:54 -07:00
Shawn Wilsher
ee6ea4269d Bug 504422 - Be smarter with our strings for AUTOCOMPLETE_MATCH SQL function.
Avoid copying are argument strings.  String copying was showing up as 1% of the
time spent in our function, when we should almost never need to copy.
r=dwitte
r=dietrich
2009-07-22 11:47:29 -07:00
Ted Mielczarek
4f4b086565 bug 483062 - figure out how to get crash stacks from xpcshell tests. r=bsmedberg
--HG--
extra : rebase_source : 70355805b7f71c016eaa7aaea1d1916a23316b8a
2009-05-11 15:54:39 -04:00