Commit Graph

1228 Commits

Author SHA1 Message Date
joe kirchoff
bbf594f464 UnrealBuildTool: Fix bad merge in Log.cs
#rnx
#rb trivial

[CL 25398723 by joe kirchoff in ue5-main branch]
2023-05-09 20:42:16 -04:00
joe kirchoff
e1fc2e2872 Epicgames.Core: Move log backup to separate function
#rnx
#rb trivial

[CL 25398719 by joe kirchoff in ue5-main branch]
2023-05-09 20:42:01 -04:00
Ben Marsh
bd9fd78c8c Horde: Reduce the number of small bundles created when archiving a mixture of small and large files.
#preflight none

[CL 25366210 by Ben Marsh in ue5-main branch]
2023-05-06 14:33:38 -04:00
Ben Marsh
3611c9814c Horde: Make bundle commands in Horde command line tool file-system centric.
Also fix generation of Blob ids/locators with empty prefixes.

#preflight none

[CL 25365991 by Ben Marsh in ue5-main branch]
2023-05-06 12:20:21 -04:00
tim smith
c067a1e220 Minor refactor of the sparse data structure collection method.
#rb self
#preflight 6453a95e0722d4f6a2449dba

[CL 25335286 by tim smith in ue5-main branch]
2023-05-04 10:55:29 -04:00
andrew thayer
3d13c955c3 Updated UHT for sparse class data accessors to use EGetSparseClassDataMethod::ArchetypeIfNull.
[REVIEW] [at]jamie.dale

[CL 25305115 by andrew thayer in ue5-main branch]
2023-05-02 14:15:10 -04:00
Ben Marsh
68e04336be Horde: Fix chunked tail data not correctly being delimited with newline characters when sent through the tailing endpoint.
#preflight none

[CL 25304979 by Ben Marsh in ue5-main branch]
2023-05-02 14:10:18 -04:00
Ben Marsh
8f4b3c529d Horde: Force a compute lease timeout if no data is received for 15m.
#preflight none

[CL 25283819 by Ben Marsh in ue5-main branch]
2023-05-01 10:35:54 -04:00
Ben Marsh
92362fbef0 Horde: Fix exception due to incorrect cast.
#preflight none

[CL 25280258 by Ben Marsh in ue5-main branch]
2023-04-30 20:50:54 -04:00
Ben Marsh
5c06f15dba Fix warning about public type without documentation.
#preflight none

[CL 25260322 by Ben Marsh in ue5-main branch]
2023-04-29 08:25:20 -04:00
Ben Marsh
06da47f8a3 EpicGames.Core: Add support for more expression types into the csproj parser to fix build error.
#preflight none

[CL 25249933 by Ben Marsh in ue5-main branch]
2023-04-28 21:50:11 -04:00
jamie dale
ff5299a534 Removed non-const overloads of the sparse data accessors
These always returned the same types and had the same implementation as the const overload

#jira
#preflight 644c24d1864f15ebf50883ab
[FYI] Tim.Smith
#rnx

[CL 25242982 by jamie dale in ue5-main branch]
2023-04-28 17:50:25 -04:00
jamie dale
36d9596dd1 Expose accessors for any sparse data super structs
This allows a class to change from using FBaseSparseData to FDerivedSparseData without having to fix-up all the existing accessors for GetBaseSparseData()

#jira
#preflight 644c1699877716c87826527a
#rb Tim.Smith

[CL 25241758 by jamie dale in ue5-main branch]
2023-04-28 17:17:48 -04:00
ben marsh
a52bf5cb99 Merging Horde and OIDC changes from //UE5/Main.
#jira
#preflight 644ab715864f15ebf53aa75c

[CL 25238023 by ben marsh in ue5-main branch]
2023-04-28 15:34:23 -04:00
tim smith
a8a60285d7 Removed the code analysis on build option in C# UHT project.
#rb trivial
#preflight 64491791864f15ebf5440ffe

[CL 25197824 by tim smith in ue5-main branch]
2023-04-26 10:27:41 -04:00
Ben Marsh
b21916588b EpicGames.Perforce: Add undo integration actions into the IntegrationAction enum, so UGS doesn't choke if the Perforce server returns them.
#preflight none

[CL 25170939 by Ben Marsh in ue5-main branch]
2023-04-24 16:46:40 -04:00
Ben Marsh
c3ecb18fe8 Horde: Update timestamps for files retrieved from the cache. Tools like UHT rely on timestamps to be able to detect modified files, and moving files does not update them by default.
#preflight none

[CL 25169684 by Ben Marsh in ue5-main branch]
2023-04-24 15:41:31 -04:00
Ben Marsh
da8149d19b Horde: Various compute API improvements.
* All standard buffers now implement IComputeBuffer directly, and do not need to have ToSharedInstance() called to create a ref-counted version.
* Workers can now construct a socket directly, allowing multiple buffers to be attached.
* Control messages are sent whenever a receive buffer is attached, allowing the remote to wait for it to be available.

#preflight none

[CL 25169238 by Ben Marsh in ue5-main branch]
2023-04-24 15:21:04 -04:00
Ben Marsh
adcdf64794 Horde: Support communicating with child processes via custom channel ids, making it possible to run multiple processes on forked message loops.
#preflight none

[CL 25136094 by Ben Marsh in ue5-main branch]
2023-04-20 16:15:10 -04:00
Ben Marsh
8c65a920e9 Horde: Add support for forking the remote message loop during remote execution.
#preflight none

[CL 25134220 by Ben Marsh in ue5-main branch]
2023-04-20 15:15:34 -04:00
ionut matasaru
3d7c0e8440 UBT: Removed deprecated TargetInfo::bUseMallocProfiler toggle in Source/Programs.
#jira UE-141779
#rb Joe.Kirchoff
#rb Johan.Berg
#preflight 64380aea7a00790bfd116430

[CL 25101875 by ionut matasaru in ue5-main branch]
2023-04-19 04:15:59 -04:00
Ben Marsh
26a950f3dc Horde: Fix warning in BundleTests.
#preflight none

[CL 25087763 by Ben Marsh in ue5-main branch]
2023-04-18 11:49:47 -04:00
Ben Marsh
d32e8436c1 BuildGraph: Store artifact keys in the tag manifest rather than in the exported graph definition, since they may include non-constant values from build arguments.
#preflight none

[CL 25057984 by Ben Marsh in ue5-main branch]
2023-04-14 21:42:00 -04:00
Ben Marsh
86ccb45313 BuildGraph: Add support for explicitly labeling artifacts from a build using the <Artifact> element.
- Each artifact is named, and by default any files added to a tag with the name of the artifact will be treated as belonging to it.
- Artifacts can have include an optional set of keys that can be queried against on Horde.
- The host system (eg. Horde) is deemed responsible for archiving artifacts for later retrieval.

#preflight none

[CL 25048052 by Ben Marsh in ue5-main branch]
2023-04-14 15:43:33 -04:00
Tim Smith
6448ec41cd Optimizations to Horde storage when dealing with larger data.
1) Ability to specify buffer size with FileNodeWriter methods CreateAsync and AppendAsync.
2) Ability to copy a FileNode tree directly into a stream without creating the nodes themselves.
3) When reading data, avoid creating byte[]s for the cache if the cache is not enabled.
4) Reduced default read size from 15MB to 1MB when caching isn't enabled
5) New ReadNodeAsync method that invokes a callback with the data instead of creating the node instance.
6) TreeWriter uses the current packet's full memory buffer size to detect the need to resize indead of the max packat size.
7) New bundle test for the streaming of FileNodes directly to a stream.

#rb ben.marsh
#preflight 64394d6d8901e5ef9811680f

[CL 25039272 by Tim Smith in ue5-main branch]
2023-04-14 09:15:03 -04:00