Commit Graph

324 Commits

Author SHA1 Message Date
ben marsh
66f37c2bb9 BuildGraph: Take the digest of any *.version files when copying files to temp storage, so their timestamps can be updated without making any content changes.
#preflight none
#jira

#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18588704 in //UE5/Release-5.0/... via CL 18588716 via CL 18588728
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v899-18417669)

[CL 18588738 by ben marsh in ue5-main branch]
2022-01-12 15:24:13 -05:00
jonathan adamczewski
fb9901fe24 AutomationTool: Remove UE4 references
#jira UE-111740
#preflight none
#trivial

#ROBOMERGE-AUTHOR: jonathan.adamczewski
#ROBOMERGE-SOURCE: CL 18576039 in //UE5/Release-5.0/... via CL 18576055 via CL 18576072
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v899-18417669)

[CL 18576082 by jonathan adamczewski in ue5-main branch]
2022-01-11 15:16:51 -05:00
jonathan adamczewski
5765f4595e AutomationTool: Remove UE4 references
#jira UE-111740
#preflight none
#trivial

#ROBOMERGE-AUTHOR: jonathan.adamczewski
#ROBOMERGE-SOURCE: CL 18576039 in //UE5/Release-5.0/... via CL 18576055
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18576072 by jonathan adamczewski in ue5-release-engine-test branch]
2022-01-11 15:15:59 -05:00
Ben Marsh
4d9a141cb1 BuildGraph: Add a task for querying all modified files since a certain changelist. Can be used in conjuction with Horde UE_HORDE_LAST_SUCCESS_CL to isolate files to rebuild.
#preflight none

[CL 18478415 by Ben Marsh in ue5-main branch]
2021-12-16 15:03:33 -05:00
Ben Marsh
a59ef99c07 BuildGraph: New mechanism for declaring graphs using C# code (WIP).
Nodes can now be implemented by arbitary C# methods. Graph structure is specified through expression trees implemented using Bg* types, which are not substituted with values until execution time. Doing so allows determination of node and option dependencies for a particular target, allowing us to generate dynamic UI for presenting relevant settings to the user.

Includes partial implementation of Installed Build script as an example implementation.

#preflight 61bb85d46c2686e86322eec9

[CL 18477305 by Ben Marsh in ue5-main branch]
2021-12-16 13:55:22 -05:00
ryan hummer
a8c7d14e69 Fixing logging format call to include the file name
#rnx
#jira none

#ROBOMERGE-AUTHOR: ryan.hummer
#ROBOMERGE-SOURCE: CL 18444558 in //UE5/Release-5.0/... via CL 18445395 via CL 18445546
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v897-18405271)

[CL 18447840 by ryan hummer in ue5-main branch]
2021-12-13 15:14:14 -05:00
ryan hummer
c0419eb70e Fixing logging format call to include the file name
#rnx
#jira none

#ROBOMERGE-AUTHOR: ryan.hummer
#ROBOMERGE-SOURCE: CL 18444558 in //UE5/Release-5.0/... via CL 18445395
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18445546 by ryan hummer in ue5-release-engine-test branch]
2021-12-13 13:45:41 -05:00
Ben Marsh
8fd4138532 UAT: Move all BuildGraph tasks into the AutomationTool.Tasks namespace (currently inconsistently in multiple other namespaces).
[CL 18434892 by Ben Marsh in ue5-main branch]
2021-12-10 16:56:09 -05:00
Ben Marsh
6a2855f64c UAT: Add support for async build commands and BuildGraph tasks.
#preflight 61b3aa86e928cffe866fa918

[CL 18433916 by Ben Marsh in ue5-main branch]
2021-12-10 15:36:47 -05:00
josh engebretson
6ef3b1763b Add error logging for temp storage zip operations
#jira none
#rnx

#ROBOMERGE-AUTHOR: josh.engebretson
#ROBOMERGE-SOURCE: CL 18421529 in //UE5/Release-5.0/... via CL 18422973 via CL 18423279
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v897-18405271)

[CL 18424119 by josh engebretson in ue5-main branch]
2021-12-09 15:34:22 -05:00
mark lintott
894733a6fe Catch IO issues when creating or copying ZIP files
#rb josh.engebretson
#jira none

#ROBOMERGE-AUTHOR: mark.lintott
#ROBOMERGE-SOURCE: CL 18420781 in //UE5/Release-5.0/... via CL 18422611 via CL 18422889
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v897-18405271)

[CL 18424044 by mark lintott in ue5-main branch]
2021-12-09 15:32:06 -05:00
josh engebretson
ab07ba85cb Add error logging for temp storage zip operations
#jira none
#rnx

#ROBOMERGE-AUTHOR: josh.engebretson
#ROBOMERGE-SOURCE: CL 18421529 in //UE5/Release-5.0/... via CL 18422973
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18423279 by josh engebretson in ue5-release-engine-test branch]
2021-12-09 15:01:49 -05:00
mark lintott
9362edf2fe Catch IO issues when creating or copying ZIP files
#rb josh.engebretson
#jira none

#ROBOMERGE-AUTHOR: mark.lintott
#ROBOMERGE-SOURCE: CL 18420781 in //UE5/Release-5.0/... via CL 18422611
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18422889 by mark lintott in ue5-release-engine-test branch]
2021-12-09 14:52:06 -05:00
Ben Marsh
2960dad878 BuildGraph: Separate out a base class for the script parser, allowing the structure of a script to be examined without processing anything.
[CL 18302815 by Ben Marsh in ue5-main branch]
2021-11-26 20:24:26 -05:00
Joakim Lindqvist
14c7319f58 BuildGraph - Fixed issue with helm task not handling when there were no values files
[CL 18268151 by Joakim Lindqvist in ue5-main branch]
2021-11-23 05:33:34 -05:00
ryan durand
a954aa1ab3 Add an explicit error message when we run out of retries and fail to unzip temp storage.
#rnx
#rb none
#jira UE-135258

#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 18243011 in //UE5/Release-5.0/... via CL 18243061
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18243291 by ryan durand in ue5-release-engine-test branch]
2021-11-18 15:38:54 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
ben marsh
26c9e60fdf BuildGraph: Revert some changes causing problems with some existing scripts.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18238990 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v895-18170469)

[CL 18238992 by ben marsh in ue5-release-engine-test branch]
2021-11-18 11:52:34 -05:00
joakim lindqvist
9fcc0f6491 Fixes for HelmTask in BuildGraph
* No longer modify the global kubecontext but rather pass the context to use into helm
* Added option to specify which kubeconfig to use
* Fixed issue when values not being handled correctly

#ROBOMERGE-AUTHOR: joakim.lindqvist
#ROBOMERGE-SOURCE: CL 18238748 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v895-18170469)

[CL 18238770 by joakim lindqvist in ue5-release-engine-test branch]
2021-11-18 11:30:32 -05:00
joakim lindqvist
5afbfa7921 Setup CI in Horde for Horde.Storage
Also added ability to override path to dotnet for DotnetTask, to allow us to use a system install dotnet for special cases (in this case we use a newer .NET version then the rest of the engine)


#ROBOMERGE-AUTHOR: joakim.lindqvist
#ROBOMERGE-SOURCE: CL 18222416 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v895-18170469)

[CL 18222429 by joakim lindqvist in ue5-release-engine-test branch]
2021-11-17 08:38:15 -05:00
ben marsh
5e0d3dfcc5 BuildGraph: Add a dedicated type to store source file location for script messages.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18210060 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v895-18170469)

[CL 18210074 by ben marsh in ue5-release-engine-test branch]
2021-11-16 14:08:03 -05:00
ben marsh
1c53bb68bd BuildGraph: Add support for including scripts using wildcards.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18191024 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v895-18170469)

[CL 18191074 by ben marsh in ue5-release-engine-test branch]
2021-11-15 11:00:49 -05:00
ben marsh
0c15e8f31f BuildGraph: Rename BgScript to BgGraph, to distinguish the concrete preprocessed graph from the input un-preprocessed script.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18181549 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v894-18169371)

[CL 18181554 by ben marsh in ue5-release-engine-test branch]
2021-11-14 11:35:11 -05:00
ben marsh
8a0469e67f BuildGraph: Make Exists() and Read() methods asynchronous.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18132882 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v889-18060218)

[CL 18133200 by ben marsh in ue5-release-engine-test branch]
2021-11-10 13:00:48 -05:00
ben marsh
a5dfa97d70 Build fix.
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 18115882 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v889-18060218)

[CL 18124386 by ben marsh in ue5-release-engine-test branch]
2021-11-09 23:30:20 -05:00