Commit Graph

791 Commits

Author SHA1 Message Date
Ben Marsh
0dfed3f566 Horde: Multi-threaded processing of files being added to bundles.
#preflight none

[CL 22208034 by Ben Marsh in ue5-main branch]
2022-09-27 14:42:23 -04:00
tim smith
0c077846eb Fixed issue where already built UBT plugins were not being listed properly.
#rb self
#rnx
#preflight 6332fb5ab20e73a0989d5f7d

[CL 22205909 by tim smith in ue5-main branch]
2022-09-27 10:35:15 -04:00
Ben Marsh
9f4e2c95e1 EpicGames.Core: Add utility method for generating SourceFile log values with custom display text.
#preflight none

[CL 22205245 by Ben Marsh in ue5-main branch]
2022-09-27 10:10:39 -04:00
Ben Marsh
80d884159f Fix missing comments.
#preflight none

[CL 22204156 by Ben Marsh in ue5-main branch]
2022-09-27 08:48:37 -04:00
Ben Marsh
0d70ed83e6 Horde: Refactor IStorageClient.
* Now supports partial reads of blobs, and caches them inside StorageClientBase.
* IStorageClient includes methods for reading/writing TreeNode-derived classes, and caches bundle information and encoded/decoded packets internally.
* TreeWriter class can be used for packing data together into bundles. Supports creating async tasks to fence nodes being flushed rather than an explicit concept of forking child writers.

#preflight none

[CL 22192856 by Ben Marsh in ue5-main branch]
2022-09-26 16:09:47 -04:00
Ben Marsh
83180e089d EpicGames.Perforce: Fix incorrect path copying native PDB to output directory.
#preflight none

[CL 22180965 by Ben Marsh in ue5-main branch]
2022-09-26 09:18:01 -04:00
Ben Marsh
8118b1a3e0 Horde: Move cache management and partial reads of bundles into the implementation of IStorageClient.
Implementation of TreeStore will likely be the same for all implementations, while there are many different strategies we might use for bulk data.

#preflight none

[CL 22158930 by Ben Marsh in ue5-main branch]
2022-09-23 14:52:11 -04:00
Ben Marsh
03bd4507be Horde: Store bundle packets in separate memory blocks, and move encode/decode logic out of TreeStore.
#preflight none

[CL 22157363 by Ben Marsh in ue5-main branch]
2022-09-23 13:12:10 -04:00
Ben Marsh
59a39161b0 Horde: Add support for ranged reads of blobs.
#preflight none

[CL 22155634 by Ben Marsh in ue5-main branch]
2022-09-23 11:26:56 -04:00
tim smith
c974960bd6 Modified C# UHT to generate errors when extra ';' are detected. C++ UHT will generate an error.
#rb self
#rnx
#preflight 632c69f2c7791417aa85136b

[CL 22145828 by tim smith in ue5-main branch]
2022-09-22 17:37:26 -04:00
tim smith
075437d87a Fixed C# UHT issue where unterminated strings were not detected properly and could result in an infinite loop.
#rb self
[FYI] matt.peters
#preflight 632c5744b4515b7e22c50162

[CL 22145735 by tim smith in ue5-main branch]
2022-09-22 17:34:34 -04:00
jeff newquist
8e7244f6b7 Fix turnkey valid SDK filtering
#rb josh.adams
#jira UE-164423
#preflight none

[CL 22141936 by jeff newquist in ue5-main branch]
2022-09-22 14:59:04 -04:00
Ben Marsh
c7960bdfae Horde: Add support for using Oodle to compress bundle packets.
#preflight none

[CL 22140891 by Ben Marsh in ue5-main branch]
2022-09-22 14:19:16 -04:00
tim smith
d97581da03 Fix wrong API macro being used in C# UHT
Cleaned up formatting in both C++ and C# UHT

#rb self
#preflight 632b37b21003050806ec9f3a

[CL 22140411 by tim smith in ue5-main branch]
2022-09-22 14:05:55 -04:00
Ben Marsh
654134a1a4 Horde: Add a C# wrapper library for Oodle data.
#preflight none

[CL 22140325 by Ben Marsh in ue5-main branch]
2022-09-22 14:03:34 -04:00
Ben Marsh
6edb2f147b Horde: Add support for Gzip compression in bundles.
#preflight none

[CL 22138345 by Ben Marsh in ue5-main branch]
2022-09-22 12:35:58 -04:00
Ben Marsh
a0ace7ac33 Horde: Encode data into bundles asynchonously while prefetching the next block of data.
#preflight none

[CL 22138005 by Ben Marsh in ue5-main branch]
2022-09-22 12:19:15 -04:00
Ben Marsh
d06078c7f2 Horde: Add Stream wrappers around IMemoryReader and IMemoryWriter, and fix ByteArrayBuilder.GetMemory() always returning the minimum buffer size.
#preflight none

[CL 22136931 by Ben Marsh in ue5-main branch]
2022-09-22 11:23:43 -04:00
tim smith
6f3ff51b2a Fixed issue in C# UHT where if an old style enum was returned from the "Implementation" method, the zero value would not be wrapped in the TEnumAsByte.
#rb self
#preflight 632b0945331ace46b571cd14

[CL 22120989 by tim smith in ue5-main branch]
2022-09-21 15:40:34 -04:00
Ben Marsh
0bd6aaf398 Horde: Add streaming methods to IStorageClient (in the form of direct blob read/write methods), so we can download bundles without having to parse them.
#preflight none

[CL 22113552 by Ben Marsh in ue5-main branch]
2022-09-21 11:20:31 -04:00
Ben Marsh
9890c661b5 Horde: Add a basic controller for reading/writing primitives to the storage service.
#preflight none

[CL 22112879 by Ben Marsh in ue5-main branch]
2022-09-21 10:44:59 -04:00
adam kinge
47d47510ab Add a static library version check for iOS/tvOS and Mac. A BuildException will be thrown if a library is not built with the minimum supported Xcode (13.4.1 or earlier for 5.1).
#jira UE-151508
#review-21059319
#preflight 62cdaa973d7ef9abccf8215b

[CL 22112491 by adam kinge in ue5-main branch]
2022-09-21 10:23:44 -04:00
Ben Marsh
7a69ca9160 Horde: Allow refs to point to specific exports within a bundle. Valuable when compacting a store, or rewriting old refs to use data in shared bundles.
#preflight none

[CL 22111845 by Ben Marsh in ue5-main branch]
2022-09-21 09:37:27 -04:00
henrik karlsson
19e2368228 [UHT]
* Fixed so dll export is added to GetLifetimeReplicatedProps
* Fixed so UFUNCTION that produce _Validate function adds dll export if class is not dll exported but function is

#preflight 632a522cb40000c8f099fccb
#rb Tim.Smith

[CL 22110139 by henrik karlsson in ue5-main branch]
2022-09-21 07:33:55 -04:00
Ben Marsh
17a8c71c86 Horde: Fix compression format not being respected in bundles.
#preflight none

[CL 22097643 by Ben Marsh in ue5-main branch]
2022-09-20 13:54:39 -04:00