Commit Graph

250 Commits

Author SHA1 Message Date
sebastian thomeczek
7ef35c3511 Adjust LogPakFile logging verbosity
- added VeryVerbose message when access to any file from ExcludedNonPakExtensions is prevented
- Introduced new Display message to print mounted pak file name and mount point, moved the corresponding logs that were already printing that information from the shadercodelibrary to verbose
- Moved most FPakReadRequest messages to VeryVerbose
- Moved PrimaryIndexSize PathHashIndexSize and FullDirectoryIndeSize to Verbose
- Moved OnPakFileMounted2Time to Verbose

#rb Matt.Peters, PJ.Kack
#jira none
#preflight 61f00f308c16f837224ada89

#ROBOMERGE-AUTHOR: sebastian.thomeczek
#ROBOMERGE-SOURCE: CL 18722494 in //UE5/Release-5.0/... via CL 18722496 via CL 18722552
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v903-18687472)

[CL 18722570 by sebastian thomeczek in ue5-main branch]
2022-01-25 10:08:12 -05:00
marc audy
0af59ec276 AsyncLoading2:
Add support for importing uncooked source packages from cooked packages
#rnx
#jira UE-136265, FORT-426538
#rb pj.kack
#preflight 61e6ff6a3778a195debba826

#ROBOMERGE-OWNER: marc.audy
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 18655480 via CL 18664834 via CL 18665656 via CL 18665916 via CL 18667722 via CL 18667764 via CL 18668174
#ROBOMERGE-BOT: UE5 (Release-Engine-Test -> Main) (v901-18665521)

[CL 18668352 by marc audy in ue5-main branch]
2022-01-19 18:28:42 -05:00
dave barrett
e3adea40cd revert 18571612 which causes initialization failure on multiple platforms
#preflight 61de37f2b97cb668809cd78c
#jira UE-138902
#rb none

#ROBOMERGE-AUTHOR: dave.barrett
#ROBOMERGE-SOURCE: CL 18581245 in //UE5/Release-5.0/... via CL 18581267 via CL 18581273
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v899-18417669)

[CL 18581274 by dave barrett in ue5-main branch]
2022-01-11 23:07:51 -05:00
sebastian thomeczek
b580fbb4ff Adjust LogPakFile and add error message on unreachable pak mount points
- Added additional check and error message that triggers when a pak file is mounted with a mount point that is not mounted to any root directory
- added VeryVerbose message when access to any file from ExcludedNonPakExtensions is prevented
- Introduced now Display message to print mounted pak file name and mount point, moved the corresponding logs that were already printing that information from the shadercodelibrary to verbose
- Moved most FPakReadRequest messages to VeryVerbose
- Moved PrimaryIndexSize PathHashIndexSize and FullDirectoryIndeSize to Verbose
- Moved OnPakFileMounted2Time to Verbose

#rb Matt.Peters, PJ.Kack
#jira none
#preflight 61dd8d95676009ad46512283

#ROBOMERGE-AUTHOR: sebastian.thomeczek
#ROBOMERGE-SOURCE: CL 18571612 in //UE5/Release-5.0/... via CL 18571622
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18571623 by sebastian thomeczek in ue5-release-engine-test branch]
2022-01-11 09:49:52 -05:00
dan thompson
f903f566d5 Add a warning for when the FileCache block size doesn't match any iostore container compressed block sizes.
#rb CarlMagnus.Nordin
#preflight 61dc76678f44ab439b39e987

#ROBOMERGE-AUTHOR: dan.thompson
#ROBOMERGE-SOURCE: CL 18562735 in //UE5/Release-5.0/... via CL 18562758
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18562781 by dan thompson in ue5-release-engine-test branch]
2022-01-10 13:43:28 -05:00
carlmagnus nordin
3f35cbfed3 IoDispatcher:
Restored container mounting error message log text
More detailed error messages when reading container headers

#rnx
#jira UE-137253
#rb pj.kack

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 18475303 via CL 18475339 via CL 18475344 via CL 18475346 via CL 18475493 via CL 18481186
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18481210 by carlmagnus nordin in ue5-release-engine-test branch]
2021-12-16 19:09:32 -05:00
carlmagnus nordin
fdc3ad3cb7 Move IoDispatcherFileBackend from Core to PakFile
#rnx
#preflight 61b89ea22e65a1df0459b68a
#rb pj.kack

#ROBOMERGE-OWNER: carlmagnus.nordin
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 18465244 via CL 18465257 via CL 18465387 via CL 18465391 via CL 18465458 via CL 18465466
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18465469 by carlmagnus nordin in ue5-release-engine-test branch]
2021-12-15 03:24:48 -05:00
carlmagnus nordin
b783f6c882 SignedArchiveReader: Make sure to write some data to the output buffer even if the signatures are missing. Otherwise we could end up with a valid pak file magic number from a previous read and incorrectly consider the pak file valid.
#rnx
#rb pj.kack

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 18378980 via CL 18379001 via CL 18379016 via CL 18379019 via CL 18379023 via CL 18379027 via CL 18434282 via CL 18435644
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18436609 by carlmagnus nordin in ue5-release-engine-test branch]
2021-12-10 19:18:37 -05:00
carlmagnus nordin
4a7d7d277c Implemented -checkpak support for iostore containers
#rnx
#rb pj.kack
#preflight 61a5dd60be6d0d4512d6cd04

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 18322656 via CL 18322665 via CL 18323459 via CL 18323526 via CL 18323898 via CL 18323959
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18323988 by carlmagnus nordin in ue5-release-engine-test branch]
2021-11-30 09:00:43 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
aurel cordonnier
fc542f6cfd Merge from Release-Engine-Staging @ 18081189 to Release-Engine-Test
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971

[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
2021-11-07 23:43:01 -05:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
aurel cordonnier
a12d56ff31 Merge from Release-Engine-Staging @ 17791557 to Release-Engine-Test
This represents UE4/Main @17774255, Release-5.0 @17791557 and Dev-PerfTest @17789485

[CL 17794212 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-12 21:21:22 -04:00
robert millar
18676387ad Don't discard decryptor if there are existing loaned-out pak readers.
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17683632 via CL 17683642 via CL 17683653 via CL 17683658 via CL 17685546
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v875-17642767)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17685596 by robert millar in ue5-release-engine-test branch]
2021-09-30 20:06:51 -04:00
carlmagnus nordin
d7ad65bf0c Added missing include
#rnx

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 17642721 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v874-17637634)

[CL 17642729 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-28 04:10:53 -04:00
carlmagnus nordin
51c9794dea PackageStore refactor
* Decouple container concept from IoDispatcher
* Decoiuple PackageStore implementation from AsyncLoading2
* Restore ucas unmount fix that got kist when merrging from UE4
* Fix packages being left in the PackageStiore even after unmounting contaiiners

#rnx
#rb pj.kack, per.larsson
#preflight 61520cc52afc2d0001146ce7

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 17641845 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v874-17637634)

[CL 17642353 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-28 04:00:33 -04:00
devin doucette
b611884c48 IoDispatcher: Always initialize IoDispatcher
Only return true from FIoDispatcher::IsInitialized() when the script objects chunk exists to keep its behavior consistent. Later, this function will be deprecated in favor of a function on IAsyncPackageLoader.

#rb Zousar.Shaker
[FYI] CarlMagnus.Nordin
#preflight 614541e1bf494a0001bd76bc

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17570905 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)

[CL 17570916 by devin doucette in ue5-release-engine-test branch]
2021-09-20 11:00:30 -04:00
robert millar
099e0a7dab Fix crash in pak decryptor by giving the decryptor its own archive.
#jira none
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17454440 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: dev-enginemerge

[CL 17454441 by robert millar in ue5-release-engine-test branch]
2021-09-08 02:06:15 -04:00
per larsson
8f9252c12f Don't initialize the I/O dispatcher from PAK when running legacy cook-on-th-fly (-FileHostIP)
#rb none
#rnx
#jira none

#ROBOMERGE-AUTHOR: per.larsson
#ROBOMERGE-SOURCE: CL 17453975 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17453982 by per larsson in ue5-release-engine-test branch]
2021-09-08 00:19:48 -04:00
robert millar
0271ac152f More UnrealPak compile fixes.
#jira none
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17448461 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17448548 by robert millar in ue5-release-engine-test branch]
2021-09-07 15:19:04 -04:00
robert millar
6ba7dbe7fa Fix editor and clang compiles for pak file changes.
#jira none
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17447958 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17447973 by robert millar in ue5-release-engine-test branch]
2021-09-07 14:35:08 -04:00
robert millar
63bef39a53 Share pak readers between threads and retire pak readers that haven't been used after a few seconds.
#jira UE-120694
#rb carlmagnus.nordin, ben.woodhouse

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17447692 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17447706 by robert millar in ue5-release-engine-test branch]
2021-09-07 14:10:23 -04:00
carlmagnus nordin
7389e99e0e Prevent problems caused by waiting on pak read requests pulling in other pak jobs while clearing old block tassk.
#rb pj.kack
#rnx
#jira UE-120960

#ROBOMERGE-SOURCE: CL 17314120 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)

[CL 17315206 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-26 07:05:59 -04:00
carlmagnus nordin
a50fb24396 LLM tags fixup
#rnx
#rb none
#jira UE-120882

#ROBOMERGE-SOURCE: CL 17066062 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v852-17065384)

[CL 17066066 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-05 05:33:21 -04:00
matt peters
f8f9cb2cd4 #jira FORT-392393
Add comments and a test framework for testing FPakProcessedReadRequest.
#rb Graeme.Thornton
#rnx

#ROBOMERGE-SOURCE: CL 17029321 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v845-17028103)
#ROBOMERGE[bot1]: dev-enginemerge-test

[CL 17029333 by matt peters in ue5-release-engine-test branch]
2021-08-03 09:14:00 -04:00