Commit Graph

398 Commits

Author SHA1 Message Date
geoff evans
5fa523b9f3 IterationProfile: Add support for incremental phase
= IterationProfile.xml =

Cleanup for clarity's sake:
* Pass -> Phase
* PlatformNames -> Platforms
* PlatformName -> Platform
* ProjectNames -> Projects
* ProjectName -> Project

Rework logic to simplifiy the graph by using property-dependent property names (see pending 16866021):
* Rework Cold and Warm Phase booleans into <ForEach> of Semicolon-delimited build option: Phases
* Rework Win64 and MacOS Platform booleans into <ForEach> of Semicolon-delimited build option: Platforms

= ue5-main.json =

Split IterationProfile into two templates for speed: iteration-profile-nightly and iteration-profile-tests
* Nightly does Cold+Warm once a day
* Tests does Incremental+Warm the all day long

#jira none
#rb none
#rnx

[CL 16885744 by geoff evans in ue5-main branch]
2021-07-19 13:48:17 -04:00
Brandon Schaefer
dda3bd9af9 Update UE5/Main to v19 toolchain
#jira UE-118949
#rb none

[CL 16862196 by Brandon Schaefer in ue5-main branch]
2021-07-15 10:20:02 -04:00
geoff evans
d598fc9718 IterationProfile: Capture new performance baselines for new horde resources
The new resource pool is 3x Xeon 6128 3.4Ghz w/ 64GB (RDU-R7920-*)

These were generated with the following command line:
  Engine\Build\BatchFiles\IterationProfileBaseline.bat -set:BaselineBuildName="++UE5+Main-CL-16768700"

#jira none
#rb trivial
#fyi jerome.delattre, francis.hurteau, mark.lintott, chris.cossiah

[CL 16778903 by geoff evans in ue5-main branch]
2021-06-24 17:31:26 -04:00
Ben Marsh
f0ef65f0cf Fix GitDependencies.sh creating invalid symlink.
#jira UE-118800

[CL 16771531 by Ben Marsh in ue5-main branch]
2021-06-24 08:50:42 -04:00
christopher waters
341ba230ca Changing RunUBT.bat to invoke UnrealBuildTool correctly.
#jira none
#rb jonathan.adamczewski

[CL 16570767 by christopher waters in ue5-main branch]
2021-06-07 10:59:27 -04:00
aurel cordonnier
43fa62fcd8 Merge from Release-Engine-Test @ 16487383 to UE5/Main
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16488106 by aurel cordonnier in ue5-main branch]
2021-05-27 13:40:37 -04:00
geoff evans
a1556b13ae IterationProfile: Support for baseline comparison of tracked telemetry.
The baseline telemetry csv files are an artifact of a build that are stashed in revision control used to compare telemetry values against bleeding edge builds to detect regressions.

Add support to IterationProfile.xml for stashing and retrieving a specific build's telemetry data for blessing as the baseline for which builds are compared.
Add SummarizeTraceCommandlet support to ingest the blessed telemetry csv for comparison against the current build.
Add warning and error threshold columns to stats.csv, and add support for percentage and cardinal value ascending overage and descending underage.
Restructure CSV loading to pull some complexity out of the Commandlet::Main.
The baseline telemetry csvs included in this change are from @16364136.

#jira UETOOL-3433
#rb tbd
#preflight 60a46e1565d94d0001225cfe

[CL 16405602 by geoff evans in ue5-main branch]
2021-05-20 12:47:21 -04:00
geoff evans
a055d11fa5 Rename Win64 and MacOS support arguments.
Preliminary change for bless support. These arguments are general platform toggles now.

#rb none

[CL 16337281 by geoff evans in ue5-main branch]
2021-05-14 18:34:21 -04:00
geoff evans
b7adbc6730 Support for running multiple projects within the same Iteration Profile build
* This will give us wider data collection to detect regressions in the cases where a single project has a blocking issue.

AutomationTool:
* Add support for appending semicolon delimited parameters into Options (to feed <ForEach/>)

Horde:
* Put project name into labels to isolate trends graph as builds are run on different projects

#jira none
#rb tbd

[CL 16318721 by geoff evans in ue5-main branch]
2021-05-13 16:53:24 -04:00
geoff evans
d0d74aa4d0 Move IterationProfile out of Restricted
#jira none
#rb trivial

[CL 16316184 by geoff evans in ue5-main branch]
2021-05-13 14:36:41 -04:00
james singer
8f929e0a4c Change filetype for some Linux scripts to binary, but still with delta storage.
This allows WSL compiles to use the same workspace as normal Windows.  It works because it prevents the perforce client from modifying the line ending to be CRLF.

#jira none
#rb Brandon.Schaefer

[CL 16299647 by james singer in ue5-main branch]
2021-05-12 11:04:43 -04:00
jonathan adamczewski
1c0b3d7c15 SetupDotnet.sh:
Handle different major version for installed dotnet

#jira none

[CL 16057564 by jonathan adamczewski in ue5-main branch]
2021-04-19 21:03:35 -04:00
jack porter
bd6edb9d47 Fix Mac GenerateProjectFiles.sh argument quoting
#jira UE-106289
#jira UE-112801
#rb Will.Damon
#lockdown Jack.Porter
[FYI] Will.Damon
#preflight 6076842193d37d0001e897d1

#ROBOMERGE-OWNER: jack.porter
#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 16001683 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v789-15992632)
#ROBOMERGE-CONFLICT from-shelf

[CL 16001716 by jack porter in ue5-main branch]
2021-04-14 02:30:22 -04:00
brandon schaefer
80223d8f9d Make killing the children of RunUAT more robust
#jira UE-113194
[REVIEW] [at]Michael.Sartain, [at]Josh.Adams
#lockdown Cristina.Riveron

#ROBOMERGE-SOURCE: CL 15982250 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v787-15839533)

[CL 15989635 by brandon schaefer in ue5-main branch]
2021-04-13 10:28:09 -04:00
jonathan adamczewski
70ed64e369 Fix "Build Tools CS Mac" on Mac
RunUAT.sh:
Setup Mono environment on Mac and Linux so that AutomationTool is able to launch xbuild for CsCompile tasks that have not been transitioned to NET Core.
(Linux change is untested)

CsCompileTask.cs:
Don't add the "/restore" argument to command line when building using xbuild as it does not appear to be supported.

InstalledEngineBuild.xml:
Remove CsCompile invocations for UAT projects as these are currently not able to be compiled by UAT: CsCompile does not know how use the bundled dotnet to build NET Core projects, and [our bundled] mono does not support NET Core projects.

This file is consumed by AutomationTool, which is compiled by RunUAT.sh. As such, it can generally be assumed that the UAT build is up to date when the built files are consumed (InstalledEngineBuild.xml has directives to tag the AutomationTool files to ensure they are included.)

#jira UE-112471

[CL 15902338 by jonathan adamczewski in ue5-main branch]
2021-04-02 12:03:38 -04:00
will damon
ed1641d05b Fixup GenerateProjectFiles
- Fixup whitespace typo in GenerateProjectFiles.sh (for top-level and Mac)

#rb trivial
#jira none
#rnx

[CL 15886052 by will damon in ue5-main branch]
2021-04-01 00:29:51 -04:00
jonathan adamczewski
28225c7741 Use installed UBT when run from an installed build
#rb Ben.Marsh
#jira UE-111568

[CL 15879394 by jonathan adamczewski in ue5-main branch]
2021-03-31 14:56:06 -04:00
will damon
174a270e0e [UBT][Mac] Fix support for uproject pathnames containing spaces.
- Also, fixup Link phase to use `env' to avoid quotation discrepancies between .NET and shell environments.

#rb josh.adams
[FYI] brandon.schaefer
#jira UE-106289
#rnx

#ROBOMERGE-OWNER: will.damon
#ROBOMERGE-AUTHOR: will.damon
#ROBOMERGE-SOURCE: CL 15836091 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v785-15821902)
#ROBOMERGE-CONFLICT from-shelf

[CL 15836217 by will damon in ue5-main branch]
2021-03-25 19:55:52 -04:00
jonathan adamczewski
007a58123e UnrealBuildTool.exe -> dotnet UnrealBuildTool.dll (2/n)
Various build scripts

[CL 15750907 by jonathan adamczewski in ue5-main branch]
2021-03-19 16:26:44 -04:00
jonathan adamczewski
a64f00151e UnrealBuildTool.exe -> dotnet UnrealBuildTool.dll (1/n)
Build.bat, Clean.bat, GenerateProjectFiles.bat

[CL 15733201 by jonathan adamczewski in ue5-main branch]
2021-03-17 21:12:07 -04:00
ben marsh
60ac8174c8 Hardening validation of command line arguments for RunUAT.bat. Removes need to escape arguments with parentheses.
#rb none
[FYI] Andrew.Grant

#ROBOMERGE-SOURCE: CL 15668827 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v779-15635321)

[CL 15670582 by ben marsh in ue5-main branch]
2021-03-10 17:58:04 -04:00
jack porter
dcb36dc03d Fix merge error breaking iOS remote build
#rb trivial
#jira UE-108593

#ROBOMERGE-SOURCE: CL 15429402 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v771-15082668)

[CL 15429407 by jack porter in ue5-main branch]
2021-02-17 01:00:07 -04:00
Marc Audy
bc88b73a29 Merge Release-Engine-Staging to Main @ CL# 15151250
Represents UE4/Main @ 15133763

[CL 15158774 by Marc Audy in ue5-main branch]
2021-01-21 16:22:06 -04:00
Joakim Lindqvist
bcb42bbe0e Removed extra call to GetDotnetPath which was caused by a incorrect merge in change 14834347
[CL 15048236 by Joakim Lindqvist in ue5-main branch]
2021-01-12 08:20:11 -04:00
Jack Porter
75f53c8388 Fix up iOS remote build after move from Mono to dotnet
- build UBT/UAT on remote Mac
- exclude unnecessary UBT platform source from rsync upload
- modifications to UBT to allow it to compile with Linux and Lumin excluded
- manually convert CRLF for Mac shell scripts after rsync upload
#review
#rb Brandon.Schaefer
#fyi Ben.Marsh

[CL 15045791 by Jack Porter in ue5-main branch]
2021-01-11 21:17:03 -04:00