Commit Graph

40 Commits

Author SHA1 Message Date
josh engebretson
8c913d1d5a Formalize test report generation data path
#rnx
[FYI] ben.salem, clayton.langford, william.ewen


#ROBOMERGE-SOURCE: CL 8117729 via CL 8120876
#ROBOMERGE-BOT: (v401-8057353)

[CL 8120936 by josh engebretson in Main branch]
2019-08-19 18:11:31 -04:00
josh engebretson
dc962ec853 Fixing boolean check on platform parse
#rnx


#ROBOMERGE-SOURCE: CL 7845368 via CL 7861338
#ROBOMERGE-BOT: (v389-7813075)

[CL 7861388 by josh engebretson in Main branch]
2019-08-08 01:28:54 -04:00
Ben Marsh
9ec8ba86e5 Fix UAT compile error.
#rb none
#rnx

[CL 7660151 by Ben Marsh in Main branch]
2019-07-30 10:37:28 -04:00
josh engebretson
a6fdbc6533 Filter supported service device platforms
#rnx


#ROBOMERGE-SOURCE: CL 7659532 via CL 7659857
#ROBOMERGE-BOT: (v372-7473910)

[CL 7659869 by josh engebretson in Main branch]
2019-07-30 09:52:50 -04:00
william ewen
8d83ff0cca Gauntlet: Adding "NotBulk" flag, so we can specifically exclude bulk builds if we wish to
#rb Andrew.Grant
#rnx


#ROBOMERGE-SOURCE: CL 7651008 via CL 7654234
#ROBOMERGE-BOT: (v372-7473910)

[CL 7654408 by william ewen in Main branch]
2019-07-29 17:39:09 -04:00
josh engebretson
d97916126a Gauntlet: Add support for dervice reseration pools
#rnx


#ROBOMERGE-SOURCE: CL 7650698 via CL 7654022
#ROBOMERGE-BOT: (v372-7473910)

[CL 7654117 by josh engebretson in Main branch]
2019-07-29 17:36:06 -04:00
josh engebretson
6ee5d6c7c0 Gauntlet: Fix issue with case senstivity on perf model constraint
#rnx


#ROBOMERGE-SOURCE: CL 7063472 via CL 7064954 via CL 7072806
#ROBOMERGE-BOT: (v367-6836689)

[CL 7072913 by josh engebretson in Main branch]
2019-06-18 16:48:47 -04:00
lukasz furman
9cee6e65c8 fixed gauntlet test restarting
#rb Ben.Salem


#ROBOMERGE-SOURCE: CL 6840467 via CL 6841040 via CL 6846192
#ROBOMERGE-BOT: (v366-6836689)

[CL 6846994 by lukasz furman in Main branch]
2019-06-05 08:42:16 -04:00
andrew grant
51749f7233 Modified Gauntlet's CopyDirectory function to allow provision of a pattern (e.g. *.so) or regular expresson to filter what files are copied.
Fixed issue where lazy copy wasn't working because destination info was only created in mirror mode.

Moved options for Gauntlet's CopyDirectory function to a structure. TODO - update the existing use cases and remove the older wrappers.

[CODEREVIEW] josh.engebretson


#ROBOMERGE-SOURCE: CL 6650544 via CL 6650545 via CL 6650546 via CL 6650599
#ROBOMERGE-BOT: (vundefined-6620334)

[CL 6650602 by andrew grant in Main branch]
2019-05-27 14:24:34 -04:00
Ben Marsh
0cc6e3dca6 Copying //UE4/Dev-Build to Dev-Main (//UE4/Dev-Main)
#rb none
#rnx

[CL 6631504 by Ben Marsh in Main branch]
2019-05-24 11:51:54 -04:00
mike beach
020913fc73 Copying [at]6613829 up to Main
#rb Nick.Whiting


#ROBOMERGE-SOURCE: CL 6613962 via CL 6615436
#ROBOMERGE-BOT: (v358-6608238)

[CL 6615471 by mike beach in Main branch]
2019-05-22 18:38:28 -04:00
josh engebretson
5544073e55 Gauntlet: Don't attempt to reserve devices with model from service, reduce some device pool log severity
#rnx


#ROBOMERGE-SOURCE: CL 6451264 via CL 6452060

[CL 6452197 by josh engebretson in Main branch]
2019-05-14 15:32:56 -04:00
josh engebretson
7107f0e7d4 Gauntlet: Adding hardware model constraints and worker job id
#rnx
[FYI] andrew.grant


#ROBOMERGE-SOURCE: CL 6373407 via CL 6383531

[CL 6383639 by josh engebretson in Main branch]
2019-05-08 18:44:05 -04:00
andrew grant
91c518c863 Gauntlet -
ITestNode now defines GetWarnings and GetErrors calls for tests to return instances that occurred during a test.

Split creation of Summary report in UnrealTestNode into Header/Body functions to allow tests to more easily customize these.

Added GetLogChannels() function to UnrealLogParser that will return all lines from multiple channels

Added AutomatonLogParser that specifically parses the output of automation (non-Gauntlet) tests.

#rb CRd
[at]josh.engebretson [at]clayton.langford [at]ben.salem


#ROBOMERGE-SOURCE: CL 6241133 via CL 6246005

[CL 6246055 by andrew grant in Main branch]
2019-05-02 00:10:12 -04:00
clayton langford
7dc1e752b6 Fixed a config format issue and improved logging to more easily find these issues in the future.
#rnx


#ROBOMERGE-SOURCE: CL 6141936 via CL 6141942 via CL 6142990

[CL 6176201 by clayton langford in Main branch]
2019-04-30 11:54:45 -04:00
andrew grant
1272fd110f Gauntlet - cleaned up some logging on error cases.
#ROBOMERGE-SOURCE: CL 6115333 via CL 6132878

[CL 6174059 by andrew grant in Main branch]
2019-04-30 11:26:17 -04:00
andrew grant
dd9cdbc85b Added Win32 support to Gauntlet
Tests with EngineTest project

[at]josh.engebretson [at]ben.salem
#rb na


#ROBOMERGE-SOURCE: CL 6095648 via CL 6096480

[CL 6096540 by andrew grant in Main branch]
2019-04-25 14:12:01 -04:00
ben salem
4257a421d1 Re-enable Gauntlet Account Pool changes now that all Load Bot accounts have been properly profiled on GameDev.
#ROBOMERGE-SOURCE: CL 5660582 via CL 5660583 via CL 5660584 via CL 5660585 via CL 5660625

[CL 5660655 by ben salem in Main branch]
2019-03-31 00:23:31 -04:00
ben salem
2a02e9d222 Temporarily backing out changelist 5659802 to unblock Editor tests until we can bulk stash new accounts.
#ROBOMERGE-SOURCE: CL 5659905 via CL 5659906 via CL 5659907 via CL 5659908 via CL 5659934

[CL 5659943 by ben salem in Main branch]
2019-03-30 00:14:58 -04:00
ben salem
df4ff80ad9 Various gauntlet functionality for getting clients to connect to propped prod servers.
- Changed gauntlet accountpool global object into an AccountManager system that handles an AccountPool instance to allow easier overriding
- Add -nobuildid flag to prevent buildidoverride from being added onto commandline
- Change game tests over to use new account pool



#ROBOMERGE-SOURCE: CL 5659802 via CL 5659803 via CL 5659804 via CL 5659805 via CL 5659928

[CL 5659935 by ben salem in Main branch]
2019-03-30 00:14:30 -04:00
clayton langford
2fd5d814b0 Updated blacklist config directory location.
#rnx


#ROBOMERGE-SOURCE: CL 5588255 via CL 5588260 via CL 5588262 via CL 5588263 via CL 5589115

[CL 5589118 by clayton langford in Main branch]
2019-03-27 10:37:54 -04:00
andrew grant
5ae4fcbe67 Added some verbose logging when copying Kairos files
Fixed some case checks
Made -config param optional

[FYI] daniel.lamb


#ROBOMERGE-SOURCE: CL 5459100 via CL 5459911

[CL 5460034 by andrew grant in Main branch]
2019-03-19 17:06:57 -04:00
clayton langford
8cd2513547 Added IniConfigUtil class to allow Gauntlet to read from config files like DefaultGame.ini.
#rnx
[FYI] Andrew.Grant


#ROBOMERGE-SOURCE: CL 5362807 via CL 5362809 via CL 5363406

[CL 5363463 by clayton langford in Main branch]
2019-03-11 17:40:09 -04:00
josh engebretson
b3c6998e4a Adding Gauntlet workerid parameter which workers can use for configuration
#ROBOMERGE-SOURCE: CL 5362356 via CL 5363136

[CL 5363198 by josh engebretson in Main branch]
2019-03-11 17:09:15 -04:00
clayton langford
92e0aa6203 Fixed an issue with Hyperlinks in HtmlBuilder.
#rnx


#ROBOMERGE-SOURCE: CL 5362326 via CL 5362327 via CL 5363097

[CL 5363187 by clayton langford in Main branch]
2019-03-11 17:09:00 -04:00