Commit Graph

4 Commits

Author SHA1 Message Date
geoff evans
cbc989d499 IterationProfile improvements
Fix baseline script for proper phases
Fix horde labels to use run nodes instead of agent tags

#jira none
#rb trivial

[CL 16927005 by geoff evans in ue5-main branch]
2021-07-22 13:21:13 -04:00
geoff evans
5fa523b9f3 IterationProfile: Add support for incremental phase
= IterationProfile.xml =

Cleanup for clarity's sake:
* Pass -> Phase
* PlatformNames -> Platforms
* PlatformName -> Platform
* ProjectNames -> Projects
* ProjectName -> Project

Rework logic to simplifiy the graph by using property-dependent property names (see pending 16866021):
* Rework Cold and Warm Phase booleans into <ForEach> of Semicolon-delimited build option: Phases
* Rework Win64 and MacOS Platform booleans into <ForEach> of Semicolon-delimited build option: Platforms

= ue5-main.json =

Split IterationProfile into two templates for speed: iteration-profile-nightly and iteration-profile-tests
* Nightly does Cold+Warm once a day
* Tests does Incremental+Warm the all day long

#jira none
#rb none
#rnx

[CL 16885744 by geoff evans in ue5-main branch]
2021-07-19 13:48:17 -04:00
geoff evans
d598fc9718 IterationProfile: Capture new performance baselines for new horde resources
The new resource pool is 3x Xeon 6128 3.4Ghz w/ 64GB (RDU-R7920-*)

These were generated with the following command line:
  Engine\Build\BatchFiles\IterationProfileBaseline.bat -set:BaselineBuildName="++UE5+Main-CL-16768700"

#jira none
#rb trivial
#fyi jerome.delattre, francis.hurteau, mark.lintott, chris.cossiah

[CL 16778903 by geoff evans in ue5-main branch]
2021-06-24 17:31:26 -04:00
geoff evans
a1556b13ae IterationProfile: Support for baseline comparison of tracked telemetry.
The baseline telemetry csv files are an artifact of a build that are stashed in revision control used to compare telemetry values against bleeding edge builds to detect regressions.

Add support to IterationProfile.xml for stashing and retrieving a specific build's telemetry data for blessing as the baseline for which builds are compared.
Add SummarizeTraceCommandlet support to ingest the blessed telemetry csv for comparison against the current build.
Add warning and error threshold columns to stats.csv, and add support for percentage and cardinal value ascending overage and descending underage.
Restructure CSV loading to pull some complexity out of the Commandlet::Main.
The baseline telemetry csvs included in this change are from @16364136.

#jira UETOOL-3433
#rb tbd
#preflight 60a46e1565d94d0001225cfe

[CL 16405602 by geoff evans in ue5-main branch]
2021-05-20 12:47:21 -04:00