Commit Graph

295 Commits

Author SHA1 Message Date
jonathan adamczewski 4ece24e65a AutomationTool, BuildUtilities:
UnrealBuild -> Unreal for EngineDirectory, RootDirectory, IsEngineInstalled, UnrealBuildToolPath
Remove CommandUtils EngineDirectory, RootDirectory, IsEngineInstalled - use equvalents from UnrealBuildBase.Unreal

#jira none

[CL 16648181 by jonathan adamczewski in ue5-main branch]
2021-06-11 18:20:44 -04:00
Jerome Delattre 3088d46a02 Gauntlet - Fix report issue with Automated tests
#rnx
#jira none
#rb none

[CL 16631862 by Jerome Delattre in ue5-main branch]
2021-06-10 18:12:21 -04:00
aurel cordonnier e0ad4e25df Merge from Release-Engine-Test @ 16624776 to UE5/Main
This represents UE4/Main @ 16579691 and Dev-PerfTest @ 16579576

[CL 16625248 by aurel cordonnier in ue5-main branch]
2021-06-10 13:13:24 -04:00
ben salem 69ec95f017 Remove hard references to platforms in EpicGame TestConfig login checks.
#ROBOMERGE-SOURCE: CL 16553395 via CL 16553399 via CL 16553404
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v828-16531559)

[CL 16553417 by ben salem in ue5-main branch]
2021-06-03 17:15:02 -04:00
ben salem a78822c6df Add XSX and PS5 to epic test node login logic.
#ROBOMERGE-SOURCE: CL 16551033 via CL 16551662 via CL 16551719
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v828-16531559)

[CL 16551754 by ben salem in ue5-main branch]
2021-06-03 15:43:28 -04:00
ben salem 2bcffaa304 Change gauntlet login special logic from looking for base XboxOne to XboxOneGDK
#ROBOMERGE-OWNER: ben.salem
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-SOURCE: CL 16550961 via CL 16551462 via CL 16551478
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v828-16531559)

[CL 16551502 by ben salem in ue5-main branch]
2021-06-03 15:30:50 -04:00
Ryan Durand 16b9122f75 Make sure dependencies are copied out when buildin Gauntlet.Automation.
#rnx
#rb none
#jira none

[CL 16523339 by Ryan Durand in ue5-main branch]
2021-06-01 17:15:36 -04:00
Jerome Delattre c7dc6ed851 Gauntlet - Add support for Unit and Baseline to Telemetry data
#jira none
#rb none
#rnx

[CL 16496261 by Jerome Delattre in ue5-main branch]
2021-05-27 21:57:49 -04:00
aurel cordonnier 43fa62fcd8 Merge from Release-Engine-Test @ 16487383 to UE5/Main
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16488106 by aurel cordonnier in ue5-main branch]
2021-05-27 13:40:37 -04:00
Jerome Delattre d389d166fe Gauntlet - adding python as a log channel to listen to
#rnx
#rb trivial
#jira none

[CL 16475085 by Jerome Delattre in ue5-main branch]
2021-05-26 16:36:45 -04:00
geoff evans ce2fe10a6a IterationProfile: Track Map_Load on Telemetry
Disable loading a map at startup to a) remove the map load from EditorInit, and b) make the automation plugin's map load the first, making it precisely tracked through Telemetry

Tested with local UAT runs.

#jira none
#rb trivial
#fyi francis.hurteau

[CL 16410566 by geoff evans in ue5-main branch]
2021-05-20 17:25:16 -04:00
Jerome Delattre 9cfe0a4cf9 Gauntlet - centralize the busy log channel list
#rnx
#rb trivial
#jira none

[CL 16332475 by Jerome Delattre in ue5-main branch]
2021-05-14 14:13:46 -04:00
Jerome Delattre 346757ccdd Gauntlet - listen to additional log channels when running tests (LogStaticMesh and LogSkeletalMech) to avoid idle timeout
#jira none
#rb trivial
#rnx

[CL 16328872 by Jerome Delattre in ue5-main branch]
2021-05-14 09:12:39 -04:00
geoff evans e1d1984bd4 Add support for trace counters to stall detector and trace summarize commandlet for telemetry in Iteration Profile
StallDetector:
* Replace static and per-callsite counter variables with trace classes
* Compose a trace api appropriate counter name (Stall Detector category)

SummarizeTraceCommandlet:
* Add support for extract and decode of counter messages from utrace files with a new analyzer class
* Report counters with name and count columns in the existing csv
* Support generation of counter events and values through to telemetry csv

#jira UETOOL-3506
#rb francis.hurteau
#preflight 609c5f45e88e9100010b5466

[CL 16314462 by geoff evans in ue5-main branch]
2021-05-13 12:37:02 -04:00
aurel cordonnier 8eebe8841f Merge UE5/RET @ 16305968 to UE5/Main
This represents UE4/Main @ 16261013 and Dev-PerfTest @ 16259937

[CL 16306996 by aurel cordonnier in ue5-main branch]
2021-05-12 18:10:03 -04:00
jeff newquist b233bc001e Support executable in root directory, but prefer executable in Project\Binaries\Platform or Engine\Binaries\Platform.
#rb andrew.grant
#jira UE-114467, UE-114633

[CL 16301909 by jeff newquist in ue5-main branch]
2021-05-12 13:26:25 -04:00
Andrew Grant 0f8f7d097b Added requiredflags to the Gauntlet message when a valid build type can't be found for easier future triage
#jira #rb na
#fyi jerome.delattre

[CL 16220783 by Andrew Grant in ue5-main branch]
2021-05-06 10:50:32 -04:00
Jerome Delattre 31d2f3d302 Gauntlet telemetry - make the csv parser more resilient to non compliant formating
#rnx
#rb none
#jira none

[CL 16215623 by Jerome Delattre in ue5-main branch]
2021-05-05 19:27:53 -04:00
aurel cordonnier 50944fd712 Merge UE5/RES @ 16162155 to UE5/Main
This represents UE4/Main @ 16130047 and Dev-PerfTest @ 16126156

[CL 16163576 by aurel cordonnier in ue5-main branch]
2021-04-29 19:32:06 -04:00
michael atchison 2323b359a7 Update multihome argument to reuse arg 0
#jira UE-114013
#review-16149670

[CL 16150792 by michael atchison in ue5-main branch]
2021-04-28 19:23:46 -04:00
michael atchison 2f8efc3c87 Add multihomehttp commandline argument to smoke test command so that overridden ip is written into matchmaking session information.
#jira UE-114013
#review-16149670 @rob.cannaday

[CL 16149899 by michael atchison in ue5-main branch]
2021-04-28 18:05:43 -04:00
geoff evans d938d5bde1 IterationProfile support for performance telemetry
This change adds:
* Extraction of performance measurements from utrace to csv care of a SummarizeTraceCommandlet
* Filtering of those measurements into another csv file that is legible by the Horde telemetry system
* Split of iteration profile into two passes with differing DDC settings: cold with empty cache and warm with seeded cache
* Synchronization of async processing of assets to wait for processing to complete (as a user will do usually)
* Culling of unused pathways in IterationProfile.xml for brevity's sake

#jira UETOOL-3338
#rb TBD
#preflight 60887cea6473940001ab66d2

[CL 16148303 by geoff evans in ue5-main branch]
2021-04-28 16:22:58 -04:00
ben salem 472299ebcf Add InsufficientDevices as a specific TestResult type for Gauntlet.
#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16037939 via CL 16038037 via CL 16040838 via CL 16040843 via CL 16040847 via CL 16055143
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16115258 by ben salem in ue5-main branch]
2021-04-26 12:16:15 -04:00
jeff newquist 5ea7789d60 Rename UE4CommandLine.txt to UECommandLine.txt and deal with all the related changes
#rb TBD
#jira UE-113713

[CL 16093056 by jeff newquist in ue5-main branch]
2021-04-22 10:29:26 -04:00
Jerome Delattre 42fe3e2653 Fix ImageMagick library missing reference in Gauntlet
#jira none
#rb Ben.Salem
#rnx

[CL 16073032 by Jerome Delattre in ue5-main branch]
2021-04-21 10:16:01 -04:00