Commit Graph

198 Commits

Author SHA1 Message Date
brandon schaefer
f7c64dda5d Add support to maintain zip perm for Linux
#jira UE-125243
[at]Ben.Marsh, [at]Jonathan.Adamczewski
#rb Ben.Marsh

#ROBOMERGE-AUTHOR: brandon.schaefer
#ROBOMERGE-SOURCE: CL 17473858 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17473871 by brandon schaefer in ue5-release-engine-test branch]
2021-09-09 13:02:44 -04:00
ben marsh
d5ab234471 Horde: Add support for serializing ReadOnlyMemory<> and byte arrays to reflection-based CB serializer.
#ROBOMERGE-SOURCE: CL 17432013 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v867-17431908)

[CL 17432023 by ben marsh in ue5-release-engine-test branch]
2021-09-04 10:31:24 -04:00
jonathan adamczewski
78b5314924 AutomationTool UpdateVersionFiles:
Do not modify MetaData.cs

#jira none

#ROBOMERGE-SOURCE: CL 17426368 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17426388 by jonathan adamczewski in ue5-release-engine-test branch]
2021-09-03 16:47:34 -04:00
ben marsh
7188d085a2 Horde: Allow requesting objects in JSON format using a ".json" suffix on the URL. Compact binary objects will automatically be transcoded.
#ROBOMERGE-SOURCE: CL 17409520 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17409536 by ben marsh in ue5-release-engine-test branch]
2021-09-02 17:48:15 -04:00
ben marsh
b2faed8730 Horde: Fixup compute API to use CbObjectAttachment/CbBinaryAttachment types where appropriate.
[FYI] Joe.Kirchoff

#ROBOMERGE-SOURCE: CL 17409049 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17409083 by ben marsh in ue5-release-engine-test branch]
2021-09-02 16:59:36 -04:00
ben marsh
40c48c839d Horde: Add compact binary request/response support to objects controller.
#ROBOMERGE-SOURCE: CL 17405657 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17405660 by ben marsh in ue5-release-engine-test branch]
2021-09-02 13:44:45 -04:00
ben marsh
049e63c048 Fix buffer corruption when enumerating Perforce records.
#ROBOMERGE-SOURCE: CL 17394417 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17394425 by ben marsh in ue5-release-engine-test branch]
2021-09-01 19:25:39 -04:00
ben marsh
136191be1b Cap the maximum output from P4 error messages.
#ROBOMERGE-SOURCE: CL 17393747 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17393755 by ben marsh in ue5-release-engine-test branch]
2021-09-01 18:33:09 -04:00
jonathan adamczewski
b0ed7c6393 EpicGames.Core ManagedProcess:
On systems with multiple process groups, distribute launched processes explicitly between groups to improve overall utiliization.

#jira none

#ROBOMERGE-SOURCE: CL 17392872 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17392888 by jonathan adamczewski in ue5-release-engine-test branch]
2021-09-01 17:22:24 -04:00
ben marsh
2f3c95f95c Fix Perforce hexdump output not being capped.
#ROBOMERGE-SOURCE: CL 17392463 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17392498 by ben marsh in ue5-release-engine-test branch]
2021-09-01 16:57:26 -04:00
ben marsh
f21707fced Horde: Add support for querying all objects underneath a given root (eg. /api/v1/objects/NS/HASH/tree). Objects are returned as a stream of compact binary object attachment fields (followed by an actual object) and binary attachment fields.
Optional request body specifies a list of objects that the client already has, and the server does not need to recurse through.

[FYI] Joe.Kirchoff

#ROBOMERGE-SOURCE: CL 17391157 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17391171 by ben marsh in ue5-release-engine-test branch]
2021-09-01 15:23:35 -04:00
ben marsh
477cafbfe5 Horde: Add CbObjectAttachment and CbBinaryAttachment classes to reference typed data by class. We need to distinguish between the two types rather than relying solely on a hash value.
[FYI] Joe.Kirchoff

#ROBOMERGE-SOURCE: CL 17391146 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17391154 by ben marsh in ue5-release-engine-test branch]
2021-09-01 15:22:53 -04:00
ryan hummer
e4f4d227f7 Fixing Perforce Fetching user info failing.
user command must have a space after the -o before the user name, restore the space and quoting the user name

#jira none

#ROBOMERGE-SOURCE: CL 17389981 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17389988 by ryan hummer in ue5-release-engine-test branch]
2021-09-01 13:57:49 -04:00
ben marsh
708857c620 EpicGames.Perforce: Fix infinite loop in CommandAsync().
#ROBOMERGE-SOURCE: CL 17386458 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17386464 by ben marsh in ue5-release-engine-test branch]
2021-09-01 10:32:20 -04:00
ben marsh
32fb18f53f EpicGames.Perforce Fix argument for -x when using child process. Delegate to the connection implementation to write arguments to a response file.
#ROBOMERGE-SOURCE: CL 17386176 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17386190 by ben marsh in ue5-release-engine-test branch]
2021-09-01 10:07:26 -04:00
ben marsh
6803a5297f EpicGames.Perforce: Completely fill read buffer before returning to the caller. Linux returns 64k chunks of data and requires multiple calls to fill the buffer. In situations where we want to parse very large records (such as large p4 describe results), this results in attempting to parse the buffer many times more than necessary in order to succeed.
#ROBOMERGE-SOURCE: CL 17385591 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17385602 by ben marsh in ue5-release-engine-test branch]
2021-09-01 09:06:01 -04:00
ben marsh
41af0b987d Partially revert CL 17374535. Closing stdout/stderr before joining with background threads means that we lose whatever is still in the pipe. Causing exceptions on GitSync service due to corrupt output.
[FYI] Joe.Kirchoff

#ROBOMERGE-SOURCE: CL 17385481 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17385484 by ben marsh in ue5-release-engine-test branch]
2021-09-01 08:54:19 -04:00
ben marsh
10108b8fa9 More debug output for corrupt Perforce response data.
#ROBOMERGE-SOURCE: CL 17381660 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17381663 by ben marsh in ue5-release-engine-test branch]
2021-08-31 22:36:28 -04:00
ben marsh
60def4f3eb Additional data for malformed Perforce response data.
#ROBOMERGE-SOURCE: CL 17380942 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17380955 by ben marsh in ue5-release-engine-test branch]
2021-08-31 21:32:12 -04:00
ben marsh
4cc8da9a5a Double the size of the P4 response buffer until a limit, then increase it by 32MB chunks. Also improve error reporting for corrupt buffers.
#ROBOMERGE-SOURCE: CL 17380649 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17380675 by ben marsh in ue5-release-engine-test branch]
2021-08-31 20:49:50 -04:00
jonathan adamczewski
e420cb12f0 UnrealBuildTool:
Make ConfigValueTracker immutable.
Propagate some nullability in and around TargetRules.

#jira none
#rb none

#ROBOMERGE-SOURCE: CL 17377821 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17377828 by jonathan adamczewski in ue5-release-engine-test branch]
2021-08-31 17:09:35 -04:00
ben marsh
e0e1133fb1 GitSync: Fix stack overflow when disposing of child process objects.
#ROBOMERGE-SOURCE: CL 17377613 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17377646 by ben marsh in ue5-release-engine-test branch]
2021-08-31 17:00:38 -04:00
joe kirchoff
0cc85bac7d ManagedProcess: Flush stdout & err on process exit when merging output streams (Mac & Linux)
#rb none
#rnx
#preflight 612e6d3479d62b00019882e5

#ROBOMERGE-SOURCE: CL 17374535 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17374551 by joe kirchoff in ue5-release-engine-test branch]
2021-08-31 14:52:29 -04:00
ben marsh
a6998dd1f2 Horde: Add a more specific error when preflight files are not in the current stream.
#ROBOMERGE-SOURCE: CL 17374270 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17374286 by ben marsh in ue5-release-engine-test branch]
2021-08-31 14:45:22 -04:00
ben marsh
8f756514b9 Horde: Fix DateTime CB serialization tests.
#ROBOMERGE-SOURCE: CL 17368297 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17368320 by ben marsh in ue5-release-engine-test branch]
2021-08-31 10:58:06 -04:00