Commit Graph

58 Commits

Author SHA1 Message Date
Marcus Wassmer
3b81cf8201 Merging using //UE5/Main_to_//UE5/Release-Engine-Staging @14384769
autoresolved files
#rb none

[CL 14384911 by Marcus Wassmer in ue5-main branch]
2020-09-24 00:43:27 -04:00
Marc Audy
7379fa99c5 Merging //UE5/Release-Engine-Staging to Main (//UE5/Main) @ 14229157
[CL 14233282 by Marc Audy in ue5-main branch]
2020-09-01 14:07:48 -04:00
Marc Audy
a7c9001a94 Merging //UE5/Release-Engine-Staging to Main (//UE5/Main) @ 14075166
#rb
#rnx

[CL 14075271 by Marc Audy in ue5-main branch]
2020-08-11 01:36:57 -04:00
Marc Audy
11f5b21210 Merging //UE5/Release-Engine-Staging @ 13752110 to Main (//UE5/Main)
#rnx

[CL 13753156 by Marc Audy in ue5-main branch]
2020-06-23 18:40:00 -04:00
Matt Kuhlenschmidt
603a4119c5 Fix HAL/PlatformFileManager.h non-portable casing CIS issues
#rb none

[CL 13214257 by Matt Kuhlenschmidt in ue5-main branch]
2020-05-06 17:58:18 -04:00
bob tellez
3426f20cb5 #UE4 IWYU fix
[FYI] per.larsson

#ROBOMERGE-SOURCE: CL 13183978 via CL 13183983 via CL 13183986
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13183996 by bob tellez in Main branch]
2020-05-05 14:19:45 -04:00
pj kack
e62102c8cf IoStore: Improve import log warnings output, and lower warnings to display level
#jira UE-92716
#rb none

#ROBOMERGE-SOURCE: CL 13178097 via CL 13178101 via CL 13178111 via CL 13178120
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13178136 by pj kack in Main branch]
2020-05-05 10:08:45 -04:00
per larsson
aca6a34679 IoDispatcher: Encryption support.
- updated IoStoreWriter to encrypt blocks (not assets)
- updated automation scripts to pass relevant encryption commands to IoStore comandlet
- added encryption guid to container TOC header
- added encryption guid to container meta when loading/saving release information
- updated IoStore command to enable container local namemap when encryption is enabled
- updated IoDispatcher file backend to decrypt blocks
- added encryption key cache to FileIoStore

#rb CarlMagnus.Nordin, PJ.Kack


#ushell-cherrypick of 13032243 by Per.Larsson

#ROBOMERGE-SOURCE: CL 13167088 via CL 13167091 via CL 13167092 via CL 13167094
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13167097 by per larsson in Main branch]
2020-05-05 03:49:22 -04:00
pj kack
c41e37b085 IoStore: Fix linux compile error
#jira UE-92713
#rb none

#ROBOMERGE-SOURCE: CL 13148659 via CL 13148667 via CL 13148673 via CL 13148684
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13148693 by pj kack in Main branch]
2020-05-04 11:13:06 -04:00
pj kack
8c9fad6666 IoStore: Add missing include
#jira UE-92713
#rb none

#ROBOMERGE-SOURCE: CL 13147856 via CL 13147861 via CL 13147868 via CL 13147874
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13147878 by pj kack in Main branch]
2020-05-04 10:15:42 -04:00
pj kack
4218910d99 IoStore: Replace GlobalImports (only referenced script objects and package exports) with ScriptObjects (all script objects) and PublicExports (all public exports)
1) First, parse all import tables to find the set of all referenced script packages (as a good approximation of which modules/script packages that are actually used for the target platform)
2) Then find and build import name lookup tables from all public non editoronly objects in memory in these packages.
3) Parse all export tables, to find all exports, and build import name lookup tables from all public exports.
4) Parse and validate all individual import entries in the import tables using the import name lookup tables from 2 & 3.
Dump all import and export data to/from the release version meta.

#rb per.larsson


#ushell-cherrypick of 13063212 by PJ.Kack

#ROBOMERGE-SOURCE: CL 13146983 via CL 13146985 via CL 13146986 via CL 13146988
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v688-13145358)

[CL 13146989 by pj kack in Main branch]
2020-05-04 05:57:35 -04:00
carlmagnus nordin
83dd0467b9 IoStore: Gracefully handle missing uasset files
#rnx
#rb pj.kack

#ROBOMERGE-SOURCE: CL 13063857 via CL 13063859 via CL 13064689 via CL 13064763
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v686-13045012)

[CL 13064817 by carlmagnus nordin in Main branch]
2020-04-29 09:00:36 -04:00
carlmagnus nordin
373fd671f7 Copying //UE4/Release-4.25Plus-Dev to Release-4.25Plus (//UE4/Release-4.25Plus)
#rnx
#jira none
#rb none

#ROBOMERGE-OWNER: carlmagnus.nordin
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 12973630 in //UE4/Release-4.25Plus/... via CL 12973644
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v682-12900288)

[CL 12973696 by carlmagnus nordin in Main branch]
2020-04-22 06:25:12 -04:00
carlmagnus nordin
25e8b4dd7d Copying //UE4/Release-4.25Plus-Dev to Release-4.25Plus (//UE4/Release-4.25Plus)
#rnx
#robomerge[BOT1] Main-For-EngineMerge
#rb none
#jira none
#lockdown stefan.boberg

#ROBOMERGE-OWNER: carlmagnus.nordin
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 12504704 in //UE4/Release-4.25Plus/... via CL 12504720
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v673-12478461)

[CL 12504759 by carlmagnus nordin in Main branch]
2020-04-01 05:00:26 -04:00
Per Larsson
e682841cdf IoDispatcher:
Gracefully handle missing packages when building containers
#rb pj.kack
#jira none

#ushell-cherrypick of 11279757 by CarlMagnus.Nordin


#ushell-cherrypick of 11603403 by CarlMagnus.Nordin

[CL 12493322 by Per Larsson in Main branch]
2020-03-31 04:29:23 -04:00
per larsson
e024a85433 Made path to package/cooker order and output directory safe to use with command line for IoStore commandlet.
#jira UE-89293
#rb none

#ROBOMERGE-SOURCE: CL 11894592 in //UE4/Release-4.25/... via CL 11894593
#ROBOMERGE-BOT: RELEASE (Release-4.25Plus -> Main) (v656-11643781)

[CL 11894595 by per larsson in Main branch]
2020-03-04 03:04:36 -05:00
Stefan Boberg
55a8b15f1f Copying //UE4/Dev-Core to Main (//UE4/Main)
#rb none

[CL 11258477 by Stefan Boberg in Main branch]
2020-02-05 14:26:36 -05:00
CarlMagnus Nordin
4b67fd622f Use CookerOpenOrder when building IoDispatcher containers
#rb per.larsson

[CL 11127827 by CarlMagnus Nordin in Dev-Core branch]
2020-01-28 06:49:34 -05:00
Per Larsson
89e82b7e5c IoStoreUtilities: Parallel serialize container files and cpu trace scopes
#rb CarlMagnus.Nordin, PJ.Kack

[CL 11114809 by Per Larsson in Dev-Core branch]
2020-01-27 07:18:53 -05:00
PJ Kack
14840e11d3 AsyncLoading2: Fix replay check failures when acessing shader code library entries before their corresponding external callbacks have been executed.
Add post load arcs for all packages for now.
They are actually only required for circular packages and packages with external read dependencies (but these are currently only known in runtime).

#fyi paul.chipchase
#rb none

[CL 11114572 by PJ Kack in Dev-Core branch]
2020-01-27 03:35:34 -05:00
PJ Kack
8596dbff4f IoStore: Linux compile fixes.
#rb none
#fyi per.larsson

[CL 11104072 by PJ Kack in Dev-Core branch]
2020-01-24 07:05:10 -05:00
Per Larsson
7b8fb88163 IoStoreUtilities: Refactored custom serialization to use standard serialization and added parallel parsing of uasset files
#rb CarlMagnus.Nordin

[CL 11103704 by Per Larsson in Dev-Core branch]
2020-01-24 03:50:37 -05:00
PJ Kack
6795731833 IoStore: Replace individual file GetStatData calls with one directory scan of the cooked directory.
#rb none

[CL 11093594 by PJ Kack in Dev-Core branch]
2020-01-23 10:46:14 -05:00
paul chipchase
d8f0d3753b Fix an issue that was causing occasional duplicate FIoChunkIds when generating them for Bulkdata.
Changed the way we generate the FIoChunkId by reducing the chance of losing data when discarding the top byte of the BulkDataChunkId.
Add a log error if we find we have discarded data

#rb none
#rnx

[CL 11082720 by paul chipchase in Dev-Core branch]
2020-01-22 10:29:25 -05:00
CarlMagnus Nordin
365c9d5723 IoStore:
Refactored to have access to the size of each chunk before the chunk is added to a container
Basic chunk ordering
Optional output of .csv container manifests

#rb none

[CL 11082359 by CarlMagnus Nordin in Dev-Core branch]
2020-01-22 09:38:57 -05:00