josh engebretson
8c913d1d5a
Formalize test report generation data path
...
#rnx
[FYI] ben.salem, clayton.langford, william.ewen
#ROBOMERGE-SOURCE: CL 8117729 via CL 8120876
#ROBOMERGE-BOT: (v401-8057353)
[CL 8120936 by josh engebretson in Main branch]
2019-08-19 18:11:31 -04:00
josh engebretson
dc962ec853
Fixing boolean check on platform parse
...
#rnx
#ROBOMERGE-SOURCE: CL 7845368 via CL 7861338
#ROBOMERGE-BOT: (v389-7813075)
[CL 7861388 by josh engebretson in Main branch]
2019-08-08 01:28:54 -04:00
Ben Marsh
9ec8ba86e5
Fix UAT compile error.
...
#rb none
#rnx
[CL 7660151 by Ben Marsh in Main branch]
2019-07-30 10:37:28 -04:00
josh engebretson
a6fdbc6533
Filter supported service device platforms
...
#rnx
#ROBOMERGE-SOURCE: CL 7659532 via CL 7659857
#ROBOMERGE-BOT: (v372-7473910)
[CL 7659869 by josh engebretson in Main branch]
2019-07-30 09:52:50 -04:00
william ewen
8d83ff0cca
Gauntlet: Adding "NotBulk" flag, so we can specifically exclude bulk builds if we wish to
...
#rb Andrew.Grant
#rnx
#ROBOMERGE-SOURCE: CL 7651008 via CL 7654234
#ROBOMERGE-BOT: (v372-7473910)
[CL 7654408 by william ewen in Main branch]
2019-07-29 17:39:09 -04:00
josh engebretson
d97916126a
Gauntlet: Add support for dervice reseration pools
...
#rnx
#ROBOMERGE-SOURCE: CL 7650698 via CL 7654022
#ROBOMERGE-BOT: (v372-7473910)
[CL 7654117 by josh engebretson in Main branch]
2019-07-29 17:36:06 -04:00
josh engebretson
6ee5d6c7c0
Gauntlet: Fix issue with case senstivity on perf model constraint
...
#rnx
#ROBOMERGE-SOURCE: CL 7063472 via CL 7064954 via CL 7072806
#ROBOMERGE-BOT: (v367-6836689)
[CL 7072913 by josh engebretson in Main branch]
2019-06-18 16:48:47 -04:00
lukasz furman
9cee6e65c8
fixed gauntlet test restarting
...
#rb Ben.Salem
#ROBOMERGE-SOURCE: CL 6840467 via CL 6841040 via CL 6846192
#ROBOMERGE-BOT: (v366-6836689)
[CL 6846994 by lukasz furman in Main branch]
2019-06-05 08:42:16 -04:00
andrew grant
51749f7233
Modified Gauntlet's CopyDirectory function to allow provision of a pattern (e.g. *.so) or regular expresson to filter what files are copied.
...
Fixed issue where lazy copy wasn't working because destination info was only created in mirror mode.
Moved options for Gauntlet's CopyDirectory function to a structure. TODO - update the existing use cases and remove the older wrappers.
[CODEREVIEW] josh.engebretson
#ROBOMERGE-SOURCE: CL 6650544 via CL 6650545 via CL 6650546 via CL 6650599
#ROBOMERGE-BOT: (vundefined-6620334)
[CL 6650602 by andrew grant in Main branch]
2019-05-27 14:24:34 -04:00
Ben Marsh
0cc6e3dca6
Copying //UE4/Dev-Build to Dev-Main (//UE4/Dev-Main)
...
#rb none
#rnx
[CL 6631504 by Ben Marsh in Main branch]
2019-05-24 11:51:54 -04:00
mike beach
020913fc73
Copying [at]6613829 up to Main
...
#rb Nick.Whiting
#ROBOMERGE-SOURCE: CL 6613962 via CL 6615436
#ROBOMERGE-BOT: (v358-6608238)
[CL 6615471 by mike beach in Main branch]
2019-05-22 18:38:28 -04:00
josh engebretson
5544073e55
Gauntlet: Don't attempt to reserve devices with model from service, reduce some device pool log severity
...
#rnx
#ROBOMERGE-SOURCE: CL 6451264 via CL 6452060
[CL 6452197 by josh engebretson in Main branch]
2019-05-14 15:32:56 -04:00
josh engebretson
7107f0e7d4
Gauntlet: Adding hardware model constraints and worker job id
...
#rnx
[FYI] andrew.grant
#ROBOMERGE-SOURCE: CL 6373407 via CL 6383531
[CL 6383639 by josh engebretson in Main branch]
2019-05-08 18:44:05 -04:00
andrew grant
91c518c863
Gauntlet -
...
ITestNode now defines GetWarnings and GetErrors calls for tests to return instances that occurred during a test.
Split creation of Summary report in UnrealTestNode into Header/Body functions to allow tests to more easily customize these.
Added GetLogChannels() function to UnrealLogParser that will return all lines from multiple channels
Added AutomatonLogParser that specifically parses the output of automation (non-Gauntlet) tests.
#rb CRd
[at]josh.engebretson [at]clayton.langford [at]ben.salem
#ROBOMERGE-SOURCE: CL 6241133 via CL 6246005
[CL 6246055 by andrew grant in Main branch]
2019-05-02 00:10:12 -04:00
clayton langford
7dc1e752b6
Fixed a config format issue and improved logging to more easily find these issues in the future.
...
#rnx
#ROBOMERGE-SOURCE: CL 6141936 via CL 6141942 via CL 6142990
[CL 6176201 by clayton langford in Main branch]
2019-04-30 11:54:45 -04:00
andrew grant
1272fd110f
Gauntlet - cleaned up some logging on error cases.
...
#ROBOMERGE-SOURCE: CL 6115333 via CL 6132878
[CL 6174059 by andrew grant in Main branch]
2019-04-30 11:26:17 -04:00
andrew grant
dd9cdbc85b
Added Win32 support to Gauntlet
...
Tests with EngineTest project
[at]josh.engebretson [at]ben.salem
#rb na
#ROBOMERGE-SOURCE: CL 6095648 via CL 6096480
[CL 6096540 by andrew grant in Main branch]
2019-04-25 14:12:01 -04:00
ben salem
4257a421d1
Re-enable Gauntlet Account Pool changes now that all Load Bot accounts have been properly profiled on GameDev.
...
#ROBOMERGE-SOURCE: CL 5660582 via CL 5660583 via CL 5660584 via CL 5660585 via CL 5660625
[CL 5660655 by ben salem in Main branch]
2019-03-31 00:23:31 -04:00
ben salem
2a02e9d222
Temporarily backing out changelist 5659802 to unblock Editor tests until we can bulk stash new accounts.
...
#ROBOMERGE-SOURCE: CL 5659905 via CL 5659906 via CL 5659907 via CL 5659908 via CL 5659934
[CL 5659943 by ben salem in Main branch]
2019-03-30 00:14:58 -04:00
ben salem
df4ff80ad9
Various gauntlet functionality for getting clients to connect to propped prod servers.
...
- Changed gauntlet accountpool global object into an AccountManager system that handles an AccountPool instance to allow easier overriding
- Add -nobuildid flag to prevent buildidoverride from being added onto commandline
- Change game tests over to use new account pool
#ROBOMERGE-SOURCE: CL 5659802 via CL 5659803 via CL 5659804 via CL 5659805 via CL 5659928
[CL 5659935 by ben salem in Main branch]
2019-03-30 00:14:30 -04:00
clayton langford
2fd5d814b0
Updated blacklist config directory location.
...
#rnx
#ROBOMERGE-SOURCE: CL 5588255 via CL 5588260 via CL 5588262 via CL 5588263 via CL 5589115
[CL 5589118 by clayton langford in Main branch]
2019-03-27 10:37:54 -04:00
andrew grant
5ae4fcbe67
Added some verbose logging when copying Kairos files
...
Fixed some case checks
Made -config param optional
[FYI] daniel.lamb
#ROBOMERGE-SOURCE: CL 5459100 via CL 5459911
[CL 5460034 by andrew grant in Main branch]
2019-03-19 17:06:57 -04:00
clayton langford
8cd2513547
Added IniConfigUtil class to allow Gauntlet to read from config files like DefaultGame.ini.
...
#rnx
[FYI] Andrew.Grant
#ROBOMERGE-SOURCE: CL 5362807 via CL 5362809 via CL 5363406
[CL 5363463 by clayton langford in Main branch]
2019-03-11 17:40:09 -04:00
josh engebretson
b3c6998e4a
Adding Gauntlet workerid parameter which workers can use for configuration
...
#ROBOMERGE-SOURCE: CL 5362356 via CL 5363136
[CL 5363198 by josh engebretson in Main branch]
2019-03-11 17:09:15 -04:00
clayton langford
92e0aa6203
Fixed an issue with Hyperlinks in HtmlBuilder.
...
#rnx
#ROBOMERGE-SOURCE: CL 5362326 via CL 5362327 via CL 5363097
[CL 5363187 by clayton langford in Main branch]
2019-03-11 17:09:00 -04:00