Commit Graph

409 Commits

Author SHA1 Message Date
jonathan adamczewski
b57e7c0d74 BuildUAT.sh:
Use redirection syntax with fc, rather than errorlevel (per https://ss64.com/nt/fc.html) to work around inconsistent results.

#jira UE-121352
#rb patrick.finegan

#ROBOMERGE-SOURCE: CL 17156706 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)

[CL 17156711 by jonathan adamczewski in ue5-release-engine-test branch]
2021-08-12 15:06:00 -04:00
jonathan adamczewski
2b7b866f45 Move DotNETCommon/BuildUtilities to Shared/EpicGames.Build
Also moves DotNETCommon/Metadata.cs to Shared/Metadata.cs

#jira none
#rb tim.smith

#ROBOMERGE-SOURCE: CL 17116964 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)

[CL 17116977 by jonathan adamczewski in ue5-release-engine-test branch]
2021-08-10 11:09:18 -04:00
jonathan adamczewski
f270855eef AutomationTool: Compile script modules within the application
Add a layer of caching to avoid running msbuild as much as possible.

#jira UE-109181
#rb ben.marsh

#ROBOMERGE-SOURCE: CL 17102399 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17102408 by jonathan adamczewski in ue5-release-engine-test branch]
2021-08-09 10:39:35 -04:00
aurel cordonnier
dc4bf61540 Merge from Release-Engine-Staging @ 17030559 to Release-Engine-Test
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17030553

[CL 17031509 by aurel cordonnier in ue5-release-engine-test branch]
2021-08-03 11:56:47 -04:00
geoff evans
397937e76f IterationProfile: Coalesce phases to incremental, warm, and cold.
#jira none
#rb trivial
#rnx

#ROBOMERGE-SOURCE: CL 16997288 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16997304 by geoff evans in ue5-release-engine-test branch]
2021-07-29 13:01:06 -04:00
leon huang
0fe8f5a144 Fixed Turnkey not being able to find batch file to update
environment variables
#rb: Josh.Adams
#rnx

#ROBOMERGE-SOURCE: CL 16996915 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16996920 by leon huang in ue5-release-engine-test branch]
2021-07-29 12:31:42 -04:00
brandon schaefer
63120c8d9d Add support for LLDB pretty printer for Linux
#jira UE-52619
#rb none
[FYI] Will.Damon, Michael.Sartain

#ROBOMERGE-SOURCE: CL 16974335 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16974342 by brandon schaefer in ue5-release-engine-test branch]
2021-07-27 17:36:41 -04:00
michael sartain
2097967364 Convert CRLF Linux files to LF
They need to be LF on Linux like all the other bat files, and
git really doesn't like .bat files with mixed line endings since our .gitattributes file claims all .bat files are CRLF.

PR #8241

#rb Brandon.Schaefer
[FYI] Ben.Marsh
#jira none

#ROBOMERGE-SOURCE: CL 16971649 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16971656 by michael sartain in ue5-release-engine-test branch]
2021-07-27 14:58:04 -04:00
geoff evans
f6bfdc3b84 IterationProfile: Replace Reverb with AncientGame
#jira none
#rb trivial

#ROBOMERGE-SOURCE: CL 16971478 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16971504 by geoff evans in ue5-release-engine-test branch]
2021-07-27 14:46:41 -04:00
jonathan adamczewski
2e31a34b03 GenerateProjectFiles.sh
Use UnrealBuildTool dll, rather than exe

#jira none
#trivial

#ROBOMERGE-SOURCE: CL 16931763 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16931772 by jonathan adamczewski in ue5-release-engine-test branch]
2021-07-22 18:04:05 -04:00
geoff evans
8531763b7e IterationProfile improvements
Fix baseline script for proper phases
Fix horde labels to use run nodes instead of agent tags

#jira none
#rb trivial

#ROBOMERGE-SOURCE: CL 16927005 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16927045 by geoff evans in ue5-release-engine-test branch]
2021-07-22 13:22:49 -04:00
geoff evans
430653cebc IterationProfile: Add support for incremental phase
= IterationProfile.xml =

Cleanup for clarity's sake:
* Pass -> Phase
* PlatformNames -> Platforms
* PlatformName -> Platform
* ProjectNames -> Projects
* ProjectName -> Project

Rework logic to simplifiy the graph by using property-dependent property names (see pending 16866021):
* Rework Cold and Warm Phase booleans into <ForEach> of Semicolon-delimited build option: Phases
* Rework Win64 and MacOS Platform booleans into <ForEach> of Semicolon-delimited build option: Platforms

= ue5-main.json =

Split IterationProfile into two templates for speed: iteration-profile-nightly and iteration-profile-tests
* Nightly does Cold+Warm once a day
* Tests does Incremental+Warm the all day long

#jira none
#rb none
#rnx

#ROBOMERGE-SOURCE: CL 16885744 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16885756 by geoff evans in ue5-release-engine-test branch]
2021-07-19 13:48:42 -04:00
brandon schaefer
c60b80f7da Update UE5/Main to v19 toolchain
#jira UE-118949
#rb none

#ROBOMERGE-SOURCE: CL 16862196 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16862200 by brandon schaefer in ue5-release-engine-test branch]
2021-07-15 10:20:22 -04:00
geoff evans
fc9fac409e IterationProfile: Capture new performance baselines for new horde resources
The new resource pool is 3x Xeon 6128 3.4Ghz w/ 64GB (RDU-R7920-*)

These were generated with the following command line:
  Engine\Build\BatchFiles\IterationProfileBaseline.bat -set:BaselineBuildName="++UE5+Main-CL-16768700"

#jira none
#rb trivial
[FYI] jerome.delattre, francis.hurteau, mark.lintott, chris.cossiah

#ROBOMERGE-SOURCE: CL 16778903 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16778912 by geoff evans in ue5-release-engine-test branch]
2021-06-24 17:31:59 -04:00
ben marsh
26d21ea5fa Fix GitDependencies.sh creating invalid symlink.
#jira UE-118800

#ROBOMERGE-SOURCE: CL 16771531 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16771543 by ben marsh in ue5-release-engine-test branch]
2021-06-24 08:51:24 -04:00
christopher waters
341ba230ca Changing RunUBT.bat to invoke UnrealBuildTool correctly.
#jira none
#rb jonathan.adamczewski

[CL 16570767 by christopher waters in ue5-main branch]
2021-06-07 10:59:27 -04:00
aurel cordonnier
43fa62fcd8 Merge from Release-Engine-Test @ 16487383 to UE5/Main
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16488106 by aurel cordonnier in ue5-main branch]
2021-05-27 13:40:37 -04:00
geoff evans
a1556b13ae IterationProfile: Support for baseline comparison of tracked telemetry.
The baseline telemetry csv files are an artifact of a build that are stashed in revision control used to compare telemetry values against bleeding edge builds to detect regressions.

Add support to IterationProfile.xml for stashing and retrieving a specific build's telemetry data for blessing as the baseline for which builds are compared.
Add SummarizeTraceCommandlet support to ingest the blessed telemetry csv for comparison against the current build.
Add warning and error threshold columns to stats.csv, and add support for percentage and cardinal value ascending overage and descending underage.
Restructure CSV loading to pull some complexity out of the Commandlet::Main.
The baseline telemetry csvs included in this change are from @16364136.

#jira UETOOL-3433
#rb tbd
#preflight 60a46e1565d94d0001225cfe

[CL 16405602 by geoff evans in ue5-main branch]
2021-05-20 12:47:21 -04:00
geoff evans
a055d11fa5 Rename Win64 and MacOS support arguments.
Preliminary change for bless support. These arguments are general platform toggles now.

#rb none

[CL 16337281 by geoff evans in ue5-main branch]
2021-05-14 18:34:21 -04:00
geoff evans
b7adbc6730 Support for running multiple projects within the same Iteration Profile build
* This will give us wider data collection to detect regressions in the cases where a single project has a blocking issue.

AutomationTool:
* Add support for appending semicolon delimited parameters into Options (to feed <ForEach/>)

Horde:
* Put project name into labels to isolate trends graph as builds are run on different projects

#jira none
#rb tbd

[CL 16318721 by geoff evans in ue5-main branch]
2021-05-13 16:53:24 -04:00
geoff evans
d0d74aa4d0 Move IterationProfile out of Restricted
#jira none
#rb trivial

[CL 16316184 by geoff evans in ue5-main branch]
2021-05-13 14:36:41 -04:00
james singer
8f929e0a4c Change filetype for some Linux scripts to binary, but still with delta storage.
This allows WSL compiles to use the same workspace as normal Windows.  It works because it prevents the perforce client from modifying the line ending to be CRLF.

#jira none
#rb Brandon.Schaefer

[CL 16299647 by james singer in ue5-main branch]
2021-05-12 11:04:43 -04:00
jonathan adamczewski
1c0b3d7c15 SetupDotnet.sh:
Handle different major version for installed dotnet

#jira none

[CL 16057564 by jonathan adamczewski in ue5-main branch]
2021-04-19 21:03:35 -04:00
jack porter
bd6edb9d47 Fix Mac GenerateProjectFiles.sh argument quoting
#jira UE-106289
#jira UE-112801
#rb Will.Damon
#lockdown Jack.Porter
[FYI] Will.Damon
#preflight 6076842193d37d0001e897d1

#ROBOMERGE-OWNER: jack.porter
#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 16001683 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v789-15992632)
#ROBOMERGE-CONFLICT from-shelf

[CL 16001716 by jack porter in ue5-main branch]
2021-04-14 02:30:22 -04:00
brandon schaefer
80223d8f9d Make killing the children of RunUAT more robust
#jira UE-113194
[REVIEW] [at]Michael.Sartain, [at]Josh.Adams
#lockdown Cristina.Riveron

#ROBOMERGE-SOURCE: CL 15982250 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v787-15839533)

[CL 15989635 by brandon schaefer in ue5-main branch]
2021-04-13 10:28:09 -04:00