168 Commits

Author SHA1 Message Date
mic rooney
f5a58f4e71 Temp backout while Josh is out so that we don't break workflows and he can re-backout/unrevert this when he's back in.
* Contains some selected back outs from other cls that included config context dependent changes, though it's limited to only backing out broken parts as much as possible to minimize surface area.

[Backout] - CL20029182
[FYI] josh.adams
Original CL Desc
-----------------------------------------------------------------
- Adding FConfigContext which is used to repalce LoadExternalIniFile, LoadLocalIniFile, etc, as well as have localized data for all configs read on a thread (like the other platform configs loaded in the editor)
- The Load*IniFile functions will create a Context, but eventually those APIs will go away and the Context will be the only way to load ini files
- Simplified some of the ini loading code, like removing the HierarchyCache (it wasn't helping editor load times, and added much complexity, and was not thread-safe, and it shouldn't actually be helpful because all the calls to Load*IniFile should eventually be replaced with either GConfig or FCOnfigCacheIni::ForPlatform(), which won't need to re-read in files
- Ini reading time actually went down due to the simplification, including Cache removal
- Left in old code for now behing a #define (USE_CONTEXT) in case something goes wrong
- Added in VERIFY_CONTEXT mode which I used to run original and Context modes and compare (including preflighting builds) (I also added a Compare function that we may want to keep around to use for future debugging)
- Added a separate set of config layers for plugins which speeds up plugin parsing, but also will fix the issue with BaseEngine.ini vs DefaultEngine.ini in Engine vs Project plugins (this shows how Contexts can bring useful information down into the guts - however a later change will enable it)
- Once this is all seen to be working, I will clean up the non-Context functions, and some globals vs static members, etc
#rb paul.chipchase
#preflight 62716c1c5e6ce673f452005a


#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 20029165 via CL 20029180 via CL 20905839 via CL 20905880
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20908094 by mic rooney in ue5-main branch]
2022-06-30 20:54:32 -04:00
CarlMagnus Nordin
54f50ee466 UnrealPak: Add support for creating multiple pak files at once instead of running a separate process for each
#jira FORT-457704
#rb pk.kack
#preflight 62b00c75a4631339e9972976
#robomerge EngineMerge

[CL 20734429 by CarlMagnus Nordin in ue5-main branch]
2022-06-20 04:34:49 -04:00
Devin Doucette
ffb60052c5 Removed runtime dependencies on DerivedDataCache
#preflight 6298f3250f6e137393b9dea7
#rb Zousar.Shaker
#rnx

[CL 20472431 by Devin Doucette in ue5-main branch]
2022-06-02 13:44:07 -04:00
Josh Adams
c2b6817353 - Cleaned up old FConfigCacheIni stuff and new FConfigContext, getting rid of duplicated functions, and moving some stuff into FConfigContext and the new UE::ConfigUtilities namespace
- Deprecated some global functions now in ConfigUtilities
- Deleted a couple of old deprecated stuff from 3.24

#rb chris.waters
#preflight 628415e1ba3597a030b3b900

[CL 20259749 by Josh Adams in ue5-main branch]
2022-05-18 08:59:31 -04:00
Matt Peters
1bd1f52d00 Fix whitespace from bad merge.
#rb None, trivial
#rnx
#preflight 62686201bd324b1da7c9b47c

[CL 19929337 by Matt Peters in ue5-main branch]
2022-04-26 17:29:45 -04:00
steve robb
04c949d2bb TSizedInlineAllocator added as the inlined equivalent of TSizedHeapAllocator.
TInlineAlloctor changed to be an alias of TSizedInlineAllocator, and TInlineAlloctor64 added.
Fix for Pakfile creation when the uncompressed buffer size exceeds int32 capacity.

#rb devin.doucette
[FYI] scott.lindeneau
#jira UE-141912
#preflight 6203bc9b7244040418573f53

#ROBOMERGE-AUTHOR: steve.robb
#ROBOMERGE-SOURCE: CL 18921401 in //UE5/Release-5.0/... via CL 18926938 via CL 18928756
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v916-18915374)

[CL 18929198 by steve robb in ue5-main branch]
2022-02-09 19:26:03 -05:00
josh adams
7f106be255 - Moved the MakeBinaryConfig commandlet into UnrealPak (like IoStore commandlet) for much faster operation
- Fixes for the ini console command for other platforms
- Allow for reading Config files from another project (for instance from a program like UnrelPak)
#rb matt.peters
#preflight 61fae9189a71b11fd38faa0e

#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 18834077 via CL 18835502 via CL 18835961 via CL 18836096 via CL 18844966 via CL 18845578
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v910-18824042)

[CL 18845601 by josh adams in ue5-main branch]
2022-02-03 13:16:23 -05:00
josh adams
746998f00e - Allow UnrealPak to have remapped filenames, not just directories
#rb matt.peters
#preflight 61f8460b1c5ac552346620c5

#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 18796881 via CL 18826729 via CL 18826788 via CL 18826835 via CL 18835831 via CL 18836357
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v910-18824042)

[CL 18836432 by josh adams in ue5-main branch]
2022-02-02 18:25:36 -05:00
charles bloom
86695cf29a add config option to use Oodle on files that are forced to zlib compression in pak
because they are needed in startup phase (ini,res,uplugin,etc.)
it's now fine to use Oodle there
this commit does not enable the new option so behavior stays the same for now

#preflight 61ba896058796f05e14b6931
#rb none

#ROBOMERGE-AUTHOR: charles.bloom
#ROBOMERGE-SOURCE: CL 18480192 in //UE5/Release-5.0/... via CL 18481555
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18481827 by charles bloom in ue5-release-engine-test branch]
2021-12-16 19:57:47 -05:00
ionut matasaru
1c030f6852 Fixed usage of TCHAR_TO_ANSI in IoStoreUtilities.cpp, PakFileUtilities.cpp and in GeForceNOWWrapper.cpp.
Fixed usage of TCHAR_TO_UTF8 in FbxMainExport (ExportStaticMeshToFbx, ExportSplineMeshToFbx).

#rb CarlMagnus.Nordin
#preflight 61b7589bf42e2f02a8dbedaa

#ROBOMERGE-AUTHOR: ionut.matasaru
#ROBOMERGE-SOURCE: CL 18453463 in //UE5/Release-5.0/... via CL 18453474
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v898-18417669)

[CL 18453477 by ionut matasaru in ue5-release-engine-test branch]
2021-12-14 06:53:29 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
aurel cordonnier
fc542f6cfd Merge from Release-Engine-Staging @ 18081189 to Release-Engine-Test
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971

[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
2021-11-07 23:43:01 -05:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
aurel cordonnier
a12d56ff31 Merge from Release-Engine-Staging @ 17791557 to Release-Engine-Test
This represents UE4/Main @17774255, Release-5.0 @17791557 and Dev-PerfTest @17789485

[CL 17794212 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-12 21:21:22 -04:00
carlmagnus nordin
a627591ffa IoStore: Changes to allow IoStore to run as part of UnrealPak instead of as a cmdlet
#rb per.larsson
#rnx

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 17517167 via CL 17517189 via CL 17517191 via CL 17519703
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17519714 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-15 10:39:23 -04:00
robert millar
ce108ef424 Fix UnrealPak compile from pak file shared reader changes.
#jira none
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17448241 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17448243 by robert millar in ue5-release-engine-test branch]
2021-09-07 14:54:23 -04:00
aurel cordonnier
dc4bf61540 Merge from Release-Engine-Staging @ 17030559 to Release-Engine-Test
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17030553

[CL 17031509 by aurel cordonnier in ue5-release-engine-test branch]
2021-08-03 11:56:47 -04:00
chris varnsverry
ce4dd6767c - Fix some unnecessary string copies when calling FPaths::FileExists
#jira FORT-392314
[at]Michael.Kirzinger [at]Marc.Audy [at]Rob.Cannaday [at]Sam.Zamani

#ROBOMERGE-SOURCE: CL 16923987 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16924003 by chris varnsverry in ue5-release-engine-test branch]
2021-07-22 11:11:51 -04:00
charles bloom
e0987b11a6 Compression Flags add ForPackaging to differentiate packaging compression usage
add OodleDataCompression CommonUsage to translate Flags

#rb dan.thompson

#ROBOMERGE-SOURCE: CL 16908872 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16908880 by charles bloom in ue5-release-engine-test branch]
2021-07-21 09:52:44 -04:00
zousar shaker
c27625b056 Integrating //UE5/Dev-Cooker [at] 16678003 to //UE5/Main (Zousar.Shaker-YEG-0943-Quaternary)
Non-DevIteration_ShooterGame


#ROBOMERGE-SOURCE: CL 16678907 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v835-16672529)

[CL 16678928 by zousar shaker in ue5-release-engine-test branch]
2021-06-15 16:38:03 -04:00
Marc Audy
e80ea6b959 Merge from Release-Engine-Staging @ 16444985
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16445122 by Marc Audy in ue5-release-engine-test branch]
2021-05-25 02:43:26 -04:00
robert millar
4a16343dac Separate the relative ordering of packages assigned by different order files from the priority at which we use those order files.
#ROBOMERGE-OWNER: robert.millar
#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 16362667 via CL 16362689 via CL 16362713 via CL 16362729
#ROBOMERGE-BOT: (v804-16311228)
#ROBOMERGE-CONFLICT from-shelf

[CL 16363649 by robert millar in ue5-release-engine-staging branch]
2021-05-17 22:54:18 -04:00
Marc Audy
f02d489290 Update Release-Engine-Test from Release-Engine-Staging @ 16264272
[CL 16264458 by Marc Audy in ue5-release-engine-test branch]
2021-05-11 01:10:20 -04:00
UnrealBot
8afb476248 Branch snapshot for CL 16260158
[CL 16260158 in ue5-release-engine-staging branch]
2021-10-05 20:06:24 +00:00
charles bloom
e0e6c4d533 CompressMemoryIfWorthDecompressing to avoid sending compressed data that expanded or barely compressed
#rb none
#fyi alexander.suvorov

[CL 16244720 by charles bloom in ue5-main branch]
2021-05-09 12:47:12 -04:00