Commit Graph

14820 Commits

Author SHA1 Message Date
chris babcock
bad7ca2b35 Fast Android packaging when only libUnreal.so changes if -BypassGradlePackaging option passed to UBT
#android
[REVIEW] [at]Jack.Porter
#rb Jack.Porter

#preflight


#ROBOMERGE-OWNER: chris.babcock
#ROBOMERGE-AUTHOR: chris.babcock
#ROBOMERGE-SOURCE: CL 20907411 via CL 20907449 via CL 20907542 via CL 20907574
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20908385 by chris babcock in ue5-main branch]
2022-06-30 21:26:53 -04:00
Joe Kirchoff
cf0d0099c3 UnrealBuildTool: UnsafeTypeCastWarning for clang platforms
#rb none
#rnx
#preflight 62be341a8d5e678759e62f9f

[CL 20907767 by Joe Kirchoff in ue5-main branch]
2022-06-30 20:05:07 -04:00
ryan hummer
f91cb75ed7 Add retrying to potential network share failure points in temp storage.
#rnx
#jira UE-156108, UE-158088
#rb ryan.hummer
#preflight 62bdeccded35ee71a70ee5a5

#ushell-cherrypick of 20574535 by Ryan.Durand

#ROBOMERGE-AUTHOR: ryan.hummer
#ROBOMERGE-SOURCE: CL 20901486 in //UE5/Release-5.0/... via CL 20902831
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20905677 by ryan hummer in ue5-main branch]
2022-06-30 18:10:24 -04:00
Florin Pascu
09cb19fcfd Backout 20871665 to fix Mac cook
#rb none
#jira none
#preflight 62be0c68d94b57687c3ff309

[CL 20904999 by Florin Pascu in ue5-main branch]
2022-06-30 17:41:55 -04:00
Joe Kirchoff
07609ca984 UnrealBuildTool: Reconcile file type specific clang arguments
#rnx
#rb none
#preflight 62bdecf73f0d6beee29aee57

[CL 20901126 by Joe Kirchoff in ue5-main branch]
2022-06-30 15:00:14 -04:00
Joakim Lindqvist
0e9ddb59d2 Horde Storage - Removed MaxReplicationsPerRun setting as this was added for tweaking the apm logging and this isnt used anymore and might be causing issues with the replication
#preflight none

[CL 20897134 by Joakim Lindqvist in ue5-main branch]
2022-06-30 12:19:21 -04:00
Joakim Lindqvist
cfeb704f99 Horde Storage - Added more information on when each replicated event actually was from in the APM tracking for debugging purposes.
#preflight none

[CL 20894663 by Joakim Lindqvist in ue5-main branch]
2022-06-30 10:00:29 -04:00
Ben Marsh
0f7177dcbf Horde: Fix tests.
#preflight none

[CL 20893709 by Ben Marsh in ue5-main branch]
2022-06-30 09:25:56 -04:00
steve robb
dbe6f4a18d Allow formatting strings to be binary-compatible char types, not only exact types.
#jira UE-132142
#rb devin.doucette
#preflight 62bd5018a3568e30662ad3b4

#ROBOMERGE-OWNER: steve.robb
#ROBOMERGE-AUTHOR: steve.robb
#ROBOMERGE-SOURCE: CL 20890364 via CL 20890433 via CL 20890478
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20892157 by steve robb in ue5-main branch]
2022-06-30 07:58:27 -04:00
carl bystrom
ab93c60c6b Horde: Let agent join requested pools on each new session
Previously the pools were only joined when the agent was first created.
#preflight 62bd8e73a3568e306636612a

[CL 20892143 by carl bystrom in ue5-main branch]
2022-06-30 07:57:44 -04:00
Joakim Lindqvist
f5dd46bd00 Horde Storage - Fixed build issues with ambigous IBlobStore type
#preflight none

[CL 20891650 by Joakim Lindqvist in ue5-main branch]
2022-06-30 07:21:56 -04:00
Joakim Lindqvist
c8c0e329ab Horde Storage - Improved the orphan blob GC to run more in parallel making each objects state determined faster (we are still only GCing a single item at a time for now as we need to balance how quickly the GC runs with load on the DB).
#preflight none

[CL 20890543 by Joakim Lindqvist in ue5-main branch]
2022-06-30 06:02:03 -04:00
Joakim Lindqvist
6c37f3235a Horde Storage - Added some more logging for when we are replicating to know which blobs are actually being replicated. Will use this to try and determine why we are missing blobs in remote regions (could be they are not replicated, or they are replicated but then deleted).
Also tweaked some of the reporting around each ref being replicated (making it easier to find which ref is being replicated)

#preflight none

[CL 20890538 by Joakim Lindqvist in ue5-main branch]
2022-06-30 06:01:36 -04:00
axel riffard
df6740fdbe Set minimum version to iOS14 in IOSPlatformSDK
#jira none
#rb none
#preflight 62bd406f1c0b75879702fbf2

[CL 20889523 by axel riffard in ue5-main branch]
2022-06-30 02:25:14 -04:00
Ben Marsh
35e9ebc4c1 Horde: API for manipulating tree structures in storage. Designed to abstract the logical tree structure away from storage/retrieval when allow working on larger-than-memory data sets.
* ITreeStore defines an API for reading/writing named tree structures.
* ITreeStore<T> allows reading/writing trees of nodes derived from the TreeNode base class, which can be specialized by clients. TreeNode tracks whether the node has been mutated, and allows recursing through the tree with strongly typed objects. Weak references are kept to deserialized TreeNode objects to ensure synchronization with the serialized tree objects.
* Default (and only current) implementation of ITreeStore is BundleStore, which packs nodes together in an efficient binary format and supports incrementally updating bundles. Nodes are hashed and deduplicated within bundles (and the known working set of the BundleStore instance), but packed Bundles are stored using a unique id returned by IBlobStore.
* DirectoryNode and FileNode nodes allow storing file trees in bundles, and implement content-aware chunking of binary data using a rolling BuzHash over an input stream.

#fyi Joakim.Lindqvist
#preflight 62acb0a5b47403e5aef09f74

[CL 20887473 by Ben Marsh in ue5-main branch]
2022-06-29 21:14:05 -04:00
Ben Marsh
4c56f89c85 Low level blob storage interface.
* Blobs are not explicitly content addressed, but each uploaded blob is given an implementation-defined BlobId  for retrieval later. An implementation MAY return a hash value for a BlobId if desired.
* BlobIds are utf8 strings, with a format that is implementation defined. They may be hashes, guids, objectids, or locators within some storage hierarchy. Consumers MAY NOT assume any particular format of a BlobId.
* Blobs may reference other blobs via a table of references stored alongside (or within) it. A caller SHOULD enforce referential integrity. An implementation MAY verify and enforce it.
* Mapping from a known key to a particular blob is done via refs, using a similar interface to the existing storage interface.
* Blobs are expected to be small enough to fit into memory. Larger blobs should be split up. Max size is TBD; probably of the order of 1-10mb.

Abstracting blob storage at this level allows for simpler implementations where use cases allow it, such as writing directly to S3 or a filer, and allows for changes in the way we address blobs to allow them to be retrieved from locations encoded in the BlobId without having to ensure global replication.
#preflight 62bced9e3f0d6beee24f2d6b

[CL 20887285 by Ben Marsh in ue5-main branch]
2022-06-29 20:43:43 -04:00
Ben Marsh
dcd01339a8 Fix static analysis warnings.
#jira UE-157966
#preflight none

[CL 20887055 by Ben Marsh in ue5-main branch]
2022-06-29 20:20:40 -04:00
chris constantinescu
1b1fb1ce98 Change Tcp Messaging log level to Verbose on Horde
#rb Jerome.Delattre
#preflight 62bccb3fd94b57687c9e037f

[CL 20886061 by chris constantinescu in ue5-main branch]
2022-06-29 19:07:32 -04:00
chris caulfield
3f19a5e6ee Chaos
- add PhysicsAsset option to select linear or non-linear joint solver for RBAN (old assets default to non-linear, new to linear)
- optimize joint SLerp drive (asin approximation and quaternion to axes)
- add unit tests for AsinEst

#jira UE-157785
#rb cedric.caillaud, michael.forot
#preflight 62bcadcfb447118888a10aaf

#ROBOMERGE-OWNER: chris.caulfield
#ROBOMERGE-AUTHOR: chris.caulfield
#ROBOMERGE-SOURCE: CL 20881652 via CL 20881788 via CL 20882418
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20885785 by chris caulfield in ue5-main branch]
2022-06-29 19:01:50 -04:00
ben woodhouse
d62f104e0d PerfReportTool 4.82 - add -summaryTableToJsonFileStream param : use a file stream to write Json. Experimental but can avoid OOMs. Previously this was always on
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 20868817 via CL 20879830 via CL 20880045
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20885587 by ben woodhouse in ue5-main branch]
2022-06-29 18:57:28 -04:00
ben woodhouse
0725b9938e PerfReportTool 4.81 : Add -jsonToPrcDir mode which converts json serialized summary row data exported with -summaryTableToJson -summaryTableToJsonWriteAllElementData to PRCs
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 20866821 via CL 20878760 via CL 20878900
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20880929 by ben woodhouse in ue5-main branch]
2022-06-29 15:44:53 -04:00
ben woodhouse
8938bd88d2 PerfReportTool - add missing packages.config
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 20866738 via CL 20878718 via CL 20878884
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20880915 by ben woodhouse in ue5-main branch]
2022-06-29 15:44:38 -04:00
mitchell fisher
b748a1fabc [FORT-462269] Add optional flag to suppress logging within GetClientToken()
#rb trivial
#preflight 62b552a2b822fb9c1199ee39

#ROBOMERGE-AUTHOR: mitchell.fisher
#ROBOMERGE-SOURCE: CL 20835333 via CL 20863583 via CL 20875825 via CL 20875948
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20878393 by mitchell fisher in ue5-main branch]
2022-06-29 13:40:10 -04:00
dmytro vovk
8a6f237872 Added Android Toolchain option to disable stack protector
#rb Chris.Babcock

#ROBOMERGE-AUTHOR: dmytro.vovk
#ROBOMERGE-SOURCE: CL 20862565 via CL 20862589 via CL 20862601
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20876663 by dmytro vovk in ue5-main branch]
2022-06-29 12:19:45 -04:00
Florin Pascu
d952341915 Temp-fix for non-Windows platforms
#rb Brandon.Schaefer
#jira none
#preflight none
#fyi  Brandon.Schaefer

[CL 20876249 by Florin Pascu in ue5-main branch]
2022-06-29 11:51:42 -04:00