Commit Graph

34 Commits

Author SHA1 Message Date
devin doucette
b2a07ea03e DDC: Merge from UE5/Main
#preflight 6288ff678828ea88c8af7034
#preflight 628ab5d93246d5019db76ed2
#rb none
#rnx

#ROBOMERGE-OWNER: devin.doucette
#ROBOMERGE-AUTHOR: Devin.Doucette
#ROBOMERGE-SOURCE: CL 20353148 via CL 20353832 via CL 20353839
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)

[CL 20355348 by devin doucette in ue5-main branch]
2022-05-24 16:40:25 -04:00
Zousar Shaker
51cb4b3f3b Fix bug in DDC2 remote executor which would cause a memory stomp due to using member data after this had been deleted.
#rb joe.kirchoff
#rnx
#preflight 626c5b15ce3959ce8ff00a13

[CL 19987119 by Zousar Shaker in ue5-main branch]
2022-04-29 18:03:05 -04:00
Devin Doucette
92a888c1f6 Replaced uses of _ASV with ANSITEXTVIEW
#preflight 6266acf50634d0904cdfe91c
#rb Steve.Robb
#rnx

[CL 19903251 by Devin Doucette in ue5-main branch]
2022-04-25 11:31:36 -04:00
devin doucette
c3443800ec DDC: Converted modular feature names to constant lazy names
#rb Zousar.Shaker
#rnx
#preflight 61f97050fa6554dff3d6fa76

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18812871 in //UE5/Release-5.0/... via CL 18812927 via CL 18822743
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v909-18823584)

[CL 18823987 by devin doucette in ue5-main branch]
2022-02-02 06:26:22 -05:00
devin doucette
cdedb37d66 DDC: Converted the Build API to UTF-8 where appropriate
#jira UE-133382
#rb Zousar.Shaker
#rnx
#preflight 61e798ee3f00a0a23ef78c49

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18655307 in //UE5/Release-5.0/... via CL 18655320 via CL 18655322
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v900-18638592)

[CL 18655349 by devin doucette in ue5-main branch]
2022-01-19 00:27:48 -05:00
devin doucette
35393bbb2b DDC: Split FPayload into separate FValue and FValueId types
A payload was conceptually a value with an ID. That has been formalized by removing the ID from the payload and having separate FValue and FValueId types. This separation cleans up the API in a few areas, and provides a more natural path to providing a basic key/value API.

#rb Zousar.Shaker
#rnx
#preflight 61d704c04c252480ca284d61

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18531844 in //UE5/Release-5.0/... via CL 18531856
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18531864 by devin doucette in ue5-release-engine-test branch]
2022-01-06 11:05:57 -05:00
devin doucette
0a6eb275ba StringBuilder: Deprecated AppendAnsi
#rb Zousar.Shaker
#preflight 61d4bfb3411c1403a3bfab2a

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18523803 in //UE5/Release-5.0/... via CL 18523820
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18523837 by devin doucette in ue5-release-engine-test branch]
2022-01-05 15:20:34 -05:00
joe kirchoff
37a8523f32 Remote Execute: Suppress zen api errors
#rnx
#rb trivial

#ROBOMERGE-AUTHOR: joe.kirchoff
#ROBOMERGE-SOURCE: CL 18412274 in //UE5/Release-5.0/... via CL 18412300
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18412320 by joe kirchoff in ue5-release-engine-test branch]
2021-12-08 16:24:11 -05:00
joe kirchoff
e0ee812ac6 Add MaxInputSizeForRemoteBuilds setting, to limit large requests from being made to Horde.
This will be unnecessary when jupiter is used as storage for remote execution.

#rnx
#rb trivial

#ROBOMERGE-AUTHOR: joe.kirchoff
#ROBOMERGE-SOURCE: CL 18400883 in //UE5/Release-5.0/... via CL 18400897
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v896-18170469)

[CL 18400898 by joe kirchoff in ue5-release-engine-test branch]
2021-12-07 17:22:29 -05:00
devin doucette
cea98e6ab4 DDC: Split build diagnostics into messages and logs
Messages are deterministic output recorded explicitly by the build function. Logs will be automatically captured from the output log and are not necessarily deterministic. The presence of logs in a build output automatically disables caching of the build output.

#rb Zousar.Shaker
#rnx

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18286155 in //UE5/Release-5.0/... via CL 18286173
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18286201 by devin doucette in ue5-release-engine-test branch]
2021-11-24 13:25:25 -05:00
devin doucette
5349d9dd08 Fixed a compile warning in remote execution
#jira UE-135612
#jira UE-135615
#rb none
#rnx

#ROBOMERGE-OWNER: devin.doucette
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18260577 in //UE5/Release-5.0/... via CL 18260642
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18260652 by devin doucette in ue5-release-engine-test branch]
2021-11-22 13:17:47 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
aurel cordonnier
fc542f6cfd Merge from Release-Engine-Staging @ 18081189 to Release-Engine-Test
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971

[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
2021-11-07 23:43:01 -05:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
devin doucette
dc4658fa91 DDC: Updated IBuildWorkerExecutor to allow filtering of payloads
#rb Zousar.Shaker
#rnx

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17876434 in //UE5/Release-5.0/... via CL 17876436
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v883-17842818)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17876451 by devin doucette in ue5-release-engine-test branch]
2021-10-20 14:50:22 -04:00
joe kirchoff
e6aa80ce4e RemoteExecute: Add missing results to completed list as failed when remote execution fails due to a server error or if cancelled due to timeout, so they can be logged.
#rb none
#rnx

#ROBOMERGE-AUTHOR: joe.kirchoff
#ROBOMERGE-SOURCE: CL 17665929 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v875-17642767)

[CL 17666131 by joe kirchoff in ue5-release-engine-test branch]
2021-09-29 15:32:18 -04:00
joe kirchoff
4c91983437 RemoteExecution: Add task result outcome and details
#rb none
#rnx
[FYI] Ben.Marsh
[FYI] Zousar.Shaker

#ROBOMERGE-AUTHOR: joe.kirchoff
#ROBOMERGE-SOURCE: CL 17572802 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)

[CL 17572836 by joe kirchoff in ue5-release-engine-test branch]
2021-09-20 13:49:08 -04:00
joe kirchoff
cfc4cef45c Update Remote Compute to use new compact binary api
#preflight 61411c7cb5a4fa0001184cbe
#rb Zousar.Shaker
#rnx

#ROBOMERGE-AUTHOR: joe.kirchoff
#ROBOMERGE-SOURCE: CL 17552582 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17552604 by joe kirchoff in ue5-release-engine-test branch]
2021-09-17 11:18:28 -04:00
devin doucette
9c01e2fc04 DDC: Moved FPayloadId into a dedicated header
#rb Zousar.Shaker
#rnx

#ROBOMERGE-SOURCE: CL 17426140 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17426194 by devin doucette in ue5-release-engine-test branch]
2021-09-03 16:30:53 -04:00
zousar shaker
7675d57a88 Ensure that the status of the FindMissingBlobs/BatchUploadBlobs/BatchReadBlobs operations is explicitly checked before allowing progress to the subsequent remote execution steps.
#rb carl.bystrom

#ROBOMERGE-SOURCE: CL 17193545 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)

[CL 17193571 by zousar shaker in ue5-release-engine-test branch]
2021-08-17 10:41:59 -04:00
joe kirchoff
c7ee815d0a RemoteExecution: Change array usage to use uint8 instead of char to match the data types used by other engine FileIO
Use FCriticalSection\FScopeLock instead of mutex for CompletionQueue

#rb Zousar.Shaker
#rnx

#ROBOMERGE-SOURCE: CL 17160416 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)

[CL 17160421 by joe kirchoff in ue5-release-engine-test branch]
2021-08-12 18:50:51 -04:00
zousar shaker
33765305da Use correct validation method when consuming DDC2 remote executed build output.
#rb none

#ROBOMERGE-SOURCE: CL 17108404 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v854-17104634)

[CL 17108429 by zousar shaker in ue5-release-engine-test branch]
2021-08-09 17:58:48 -04:00
zousar shaker
60801d51de Change the DDC remote execution timeout to use the action timeout instead of the grpc timeout with the expectation that the action timeout will actually be enforced by the executing agent in the case of a hung process.
#rb carl.bystrom

#ROBOMERGE-SOURCE: CL 17105436 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v854-17104634)

[CL 17105458 by zousar shaker in ue5-release-engine-test branch]
2021-08-09 13:58:36 -04:00
zousar shaker
6870a0f425 Configuration adjustments and logging improvements to DDC2 remote executor.
#rb none
#rnx

#ROBOMERGE-SOURCE: CL 17089692 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17089708 by zousar shaker in ue5-release-engine-test branch]
2021-08-06 18:42:02 -04:00
devin doucette
c67fcf1702 DDC: Split DerivedDataRequest.h and rename DerivedDataBuildPolicy.h
#rb none
#rnx

#ROBOMERGE-SOURCE: CL 17086960 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17086977 by devin doucette in ue5-release-engine-test branch]
2021-08-06 15:50:00 -04:00