Commit Graph

147 Commits

Author SHA1 Message Date
Andrew Grant
bf5ae63b7f Restoring changes from 9530618 with -
- Don't fall through to an exception if an Exists() clause fails
- Don't use an inline function for recursion (older .net versions?)
- Remove project reference in Gauntlet that was being added by new Platform/* wildcard

#fyi luke.thatcher, marc.audy
#jira UE-81525
#rb na

[CL 9537797 by Andrew Grant in Main branch]
2019-10-10 11:44:17 -04:00
Andrew Grant
54c420f6ac Undo //UE4/Main/Engine/Source/Programs/... changelist 9530618
#jira #rb na

[CL 9534305 by Andrew Grant in Main branch]
2019-10-10 10:39:08 -04:00
Andrew Grant
887dc9c1e9 Removed explicit reference to Null device which is now pulled in by the wildcard
#jira na
#rb marc.audy

[CL 9533928 by Andrew Grant in Main branch]
2019-10-10 10:18:02 -04:00
Andrew Grant
b334dd8b98 The "platforms as plugins" work exposed two awesome issues...
1) The CsProjectinfo class was not processing <Choose> nodes so ItemGroups within those nodes were not having their compile files parsed

2) The CsProjectInfo class only supported fully formed paths, not the wildcard syntax that csproj files can use.

This CL corrects both of these by adding the following -

* <Choose> nodes are now descended into and their elements are processed.
* The condition evalutor now supports the Exists statement (e.g. Exists(path))
* Wildcard include statements are expanded into a list of files. File wildcards (Foo/*.cs), path wildcards (Foo/*/*.cs), and greedy wildcards (Foo/**) are all supported.

As part of this work the Gauntlet.csproj file has been modified to use wildcards.

#review-9493793 @ben.marsh,@luke.thatcher
#jira UE-81525
#rb reviewed

[CL 9530618 by Andrew Grant in Main branch]
2019-10-10 08:54:46 -04:00
william ewen
215d5ae9e6 Making sure that CheckHeartbeat in UnrealTestNode's TickTest doesn't try to process heartbeats once the test has finished
#rb Ben.Salem, Clayton.Langford


#ROBOMERGE-SOURCE: CL 9491715 via CL 9491720
#ROBOMERGE-BOT: (v519-9489664)

[CL 9491722 by william ewen in Main branch]
2019-10-09 14:54:13 -04:00
Andrew Grant
ad03f82199 Gauntlet -
Fixed issue where EngineTest arguments were being appended without a space.

Added temp code to use a preferred domain when getting the host IP address

Specify multihome to editor instances to force selection of the preferred adaptor

#rb luke.thatcher
#jira UE-81101
#fyi marc.audy,luke.thatcher

[CL 9486975 by Andrew Grant in Main branch]
2019-10-09 10:01:23 -04:00
josh engebretson
d91c9a9563 Gauntlet: don't surface iOS crashes if they happen during request exit
#rnx


#ROBOMERGE-SOURCE: CL 9423156 via CL 9423170 via CL 9423197 via CL 9423223 via CL 9423246
#ROBOMERGE-BOT: (v480-9420520)

[CL 9423891 by josh engebretson in Main branch]
2019-10-04 17:43:41 -04:00
josh engebretson
33a301476b Gauntlet: fix issue with parallel tests copying servers/clients multiple times
#rnx
[FYI] ben.salem


#ROBOMERGE-SOURCE: CL 9317986 via CL 9318005 via CL 9318025 via CL 9318040 via CL 9318058
#ROBOMERGE-BOT: (v455-9298202)

[CL 9318092 by josh engebretson in Main branch]
2019-10-01 13:13:19 -04:00
clayton langford
530aa22ffd Added heartbeats to the gauntlet module which output log lines regularly to track test controller status. Test controllers can mark these heartbeats as active which denotes that the test is actively functioning as intended. In Csharp, Gauntlet test nodes listen for heartbeats and can optionally fail the test run if a heartbeat hasn't been detected for long enough or if heartbeats are not marked active for long enough.
#rnx
#rb Ben.Salem, Josh.Engebretson, Andrew.Grant


#ROBOMERGE-SOURCE: CL 9199397 via CL 9199627 via CL 9199680 via CL 9199747
#ROBOMERGE-BOT: (v443-9013191)

[CL 9199802 by clayton langford in Main branch]
2019-09-27 09:30:30 -04:00
josh engebretson
968fb3aef7 Gauntlet: Add some additional android verbose logging to help diagnose issues
#rnx


#ROBOMERGE-SOURCE: CL 9141023 via CL 9141062 via CL 9141075
#ROBOMERGE-BOT: (v443-9013191)

[CL 9141109 by josh engebretson in Main branch]
2019-09-26 10:54:03 -04:00
josh engebretson
8fef47e0b2 Gauntlet: support reservation model constraints on gauntlet service API
#rnx


#ROBOMERGE-SOURCE: CL 9104419 via CL 9107346 via CL 9107639
#ROBOMERGE-BOT: (v443-9013191)

[CL 9109141 by josh engebretson in Main branch]
2019-09-25 16:26:18 -04:00
josh engebretson
3b232d3890 Only display warning if callstack threads are found
#rnx


#ROBOMERGE-SOURCE: CL 9050395 via CL 9050563 via CL 9050594
#ROBOMERGE-BOT: (v443-9013191)

[CL 9052228 by josh engebretson in Main branch]
2019-09-24 15:29:58 -04:00
josh engebretson
ca113d631d Gauntlet: fixing lldb callstack parser
#rnx


#ROBOMERGE-SOURCE: CL 9047959 via CL 9048002 via CL 9048012
#ROBOMERGE-BOT: (v443-9013191)

[CL 9049930 by josh engebretson in Main branch]
2019-09-24 14:52:44 -04:00
josh engebretson
476045c9ad Gauntlet: Fix iOS bundle identifier detection with IPA's which contain multiple info.plist
#rnx


#ROBOMERGE-SOURCE: CL 9032719 via CL 9042192 via CL 9042374
#ROBOMERGE-BOT: (v443-9013191)

[CL 9042510 by josh engebretson in Main branch]
2019-09-24 13:10:15 -04:00
josh engebretson
1d17cafe25 Fix issue with mobile build builds being used regardless of -bulk being specified, log warning when fail to mark directory for cleanup
#rnx


#ROBOMERGE-SOURCE: CL 8995633 via CL 8995675 via CL 8995683
#ROBOMERGE-BOT: (v442-8990807)

[CL 8997070 by josh engebretson in Main branch]
2019-09-23 17:19:02 -04:00
josh engebretson
974b3c422b Gauntlet: Disable crashlytics in automated tests to get symbolicated tombstone callstacks on Android
#rnx
[FYI] Ben.Salem


#ROBOMERGE-SOURCE: CL 8898561 via CL 8899927 via CL 8900178
#ROBOMERGE-BOT: (v427-8887818)

[CL 8901398 by josh engebretson in Main branch]
2019-09-19 15:51:20 -04:00
josh engebretson
67417fb8cf Gauntlet: Fix issue pulling Android installs from from patch files
#rnx
[FYI] Daniel.Lamb


#ROBOMERGE-SOURCE: CL 8889905 via CL 8889908 via CL 8889910
#ROBOMERGE-BOT: (v427-8887818)

[CL 8890572 by josh engebretson in Main branch]
2019-09-19 12:44:55 -04:00
josh engebretson
143b13bf2d Fixing issue with iOS LLDB callstack parsing regex
#rnx


#ROBOMERGE-SOURCE: CL 8840858 via CL 8840881 via CL 8865331
#ROBOMERGE-BOT: (v425-8812723)

[CL 8882600 by josh engebretson in Main branch]
2019-09-19 08:31:17 -04:00
josh engebretson
c5e5ede50b Workaround for issue with Zip64 IPA files created on Ionic.Zip with mono
#rnx


#ROBOMERGE-SOURCE: CL 8838011 via CL 8840010 via CL 8864800
#ROBOMERGE-BOT: (v425-8812723)

[CL 8868098 by josh engebretson in Main branch]
2019-09-18 21:49:50 -04:00
Andrew Grant
15284697b3 Switched to curly braces for reporting and parsing test results.
#jira #rb na

[CL 8655294 by Andrew Grant in Main branch]
2019-09-12 11:04:44 -04:00
Andrew Grant
aca0abd590 Fixed issue where tests that timed out weren't written to the log.
Also improved readability of post-test report

#jira #rb na

[CL 8649425 by Andrew Grant in Main branch]
2019-09-11 23:13:25 -04:00
Andrew Grant
3b7b596cce Added some options to simplify running EngineTests locally via buildgraph
#jira #rb na

[CL 8649423 by Andrew Grant in Main branch]
2019-09-11 23:12:41 -04:00
josh engebretson
1811143a75 Updating ios-deploy to latest
#rnx


#ROBOMERGE-SOURCE: CL 8618084 via CL 8618087 via CL 8629632
#ROBOMERGE-BOT: (v409-8614070)

[CL 8631458 by josh engebretson in Main branch]
2019-09-10 21:07:50 -04:00
Ben Marsh
81cf44002e Fix Gauntlet launching projects that have a space in the path.
#rb none
#fyi Andrew.Grant
#rnx

[CL 8179776 by Ben Marsh in Dev-Build branch]
2019-08-21 13:06:09 -04:00
josh engebretson
c3c7ad017d Gauntlet: Fix issue with Android saved path (verified adb version unrelated)
#rnx
[FYI] justin.marcus, clayton.langford


#ROBOMERGE-SOURCE: CL 8119240 via CL 8119242 via CL 8123045
#ROBOMERGE-BOT: (v401-8057353)

[CL 8124771 by josh engebretson in Main branch]
2019-08-20 09:59:47 -04:00