Commit Graph

241 Commits

Author SHA1 Message Date
robert millar
6ba7dbe7fa Fix editor and clang compiles for pak file changes.
#jira none
#rb none

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17447958 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17447973 by robert millar in ue5-release-engine-test branch]
2021-09-07 14:35:08 -04:00
robert millar
63bef39a53 Share pak readers between threads and retire pak readers that haven't been used after a few seconds.
#jira UE-120694
#rb carlmagnus.nordin, ben.woodhouse

#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17447692 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: Dev-EngineMerge

[CL 17447706 by robert millar in ue5-release-engine-test branch]
2021-09-07 14:10:23 -04:00
carlmagnus nordin
7389e99e0e Prevent problems caused by waiting on pak read requests pulling in other pak jobs while clearing old block tassk.
#rb pj.kack
#rnx
#jira UE-120960

#ROBOMERGE-SOURCE: CL 17314120 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)

[CL 17315206 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-26 07:05:59 -04:00
carlmagnus nordin
a50fb24396 LLM tags fixup
#rnx
#rb none
#jira UE-120882

#ROBOMERGE-SOURCE: CL 17066062 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v852-17065384)

[CL 17066066 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-05 05:33:21 -04:00
matt peters
f8f9cb2cd4 #jira FORT-392393
Add comments and a test framework for testing FPakProcessedReadRequest.
#rb Graeme.Thornton
#rnx

#ROBOMERGE-SOURCE: CL 17029321 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v845-17028103)
#ROBOMERGE[bot1]: dev-enginemerge-test

[CL 17029333 by matt peters in ue5-release-engine-test branch]
2021-08-03 09:14:00 -04:00
matt peters
2bd028fd88 #jira FORT-392393
Add an earlier FATAL log to catch invalid premature deletion of FPakProcessedReadRequest before it can cause difficult-to-diagnose crashes on the asynchronous DoProcessing thread.
#rb Justin.Marcus
#rnx

#ROBOMERGE-SOURCE: CL 17015222 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
#ROBOMERGE[bot1]: dev-enginemerge-test

[CL 17015231 by matt peters in ue5-release-engine-test branch]
2021-08-02 08:49:12 -04:00
charles bloom
80bbe9ec95 FCompression::GetMaximumCompressedSize to clean up differentiation from CompressMemoryBound
use GetMaximumCompressedSize for decoding
use CompressMemoryBound for encoding

#rb dan.thompson

#ROBOMERGE-SOURCE: CL 16897963 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16897969 by charles bloom in ue5-release-engine-test branch]
2021-07-20 12:29:01 -04:00
charles bloom
645446f96c OodleDataCompression in Core
All games now use Engine Oodle for runtime decompression
Oodle in Engine can load an older Oodle DLL for encoding packages to keep making the same binary data

#rb dan.thompson,devin.doucette

#ROBOMERGE-SOURCE: CL 16879404 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16879428 by charles bloom in ue5-release-engine-test branch]
2021-07-18 13:31:39 -04:00
aurel cordonnier
02c0f425e8 Copy up from Release-Engine-Staging @ 16738359
This represents UE4/Main @ 16738161 and Dev-PerfTest @ 16737719

[CL 16738582 by aurel cordonnier in ue5-release-engine-test branch]
2021-06-22 00:27:54 -04:00
Dan Phillips
b1f07b35c4 Back out changelist 16406639
[CL 16410511 by Dan Phillips in ue5-release-engine-staging branch]
2021-05-20 17:22:17 -04:00
dan phillips
0ee56400a1 Bug fix for pak files, pending requests counter needs to be decremented when the request is complete not when the user deletes the request handle.
Expose the requests counter for requests that are fullfilable based on priority
Add in a way to suspend the IOStore if the pak cache is busy, this can help IO perf (disabled by default)

#rb robert.millar


#ROBOMERGE-SOURCE: CL 16401267 via CL 16401284 via CL 16401290 via CL 16401295 via CL 16401298
#ROBOMERGE-BOT: (v804-16311228)

[CL 16406639 by dan phillips in ue5-release-engine-staging branch]
2021-05-20 14:06:53 -04:00
Marc Audy
f02d489290 Update Release-Engine-Test from Release-Engine-Staging @ 16264272
[CL 16264458 by Marc Audy in ue5-release-engine-test branch]
2021-05-11 01:10:20 -04:00
UnrealBot
8afb476248 Branch snapshot for CL 16260158
[CL 16260158 in ue5-release-engine-staging branch]
2021-10-05 20:06:24 +00:00
Andrew Davidson
3ddc3a4da3 Merge up from //UE5/Dev-LargeWorldCoordinates
#rb none

[CL 16211417 by Andrew Davidson in ue5-main branch]
2021-05-05 15:07:25 -04:00
aurel cordonnier
50944fd712 Merge UE5/RES @ 16162155 to UE5/Main
This represents UE4/Main @ 16130047 and Dev-PerfTest @ 16126156

[CL 16163576 by aurel cordonnier in ue5-main branch]
2021-04-29 19:32:06 -04:00
Matt Peters
231c54ddd1 #jira UE-114482
FPakFile::DecodePakEntry: Fix special case handling for when CompressionBlockSize should be set equal to UncompressedSize.
The original legacy condition was to set CompressionBlockSize = UnCompressedSize when UncompressedSize < 65536.
That condition is incompatible with future plans for more flexible CompressionBlockSize.
We changed that to UnCompressedSize < CompressionBlockSize, but now we have found that
new check does not catch the case of e.g. UnCompressedSize == 909, CompressionBlockSize = 909, and encoded CompressionBlockSize == 909 >> 11 == 0.
The original legacy condition relied on the assumption that (UncompressedSize < 65536) implies (NumCompressionBlocks == 1).
In our second attempt at fixing the legacy condition, we now use the condition NumCompressionBlocks == 1.
#rb Charles.Bloom
#rnx

[CL 16161323 by Matt Peters in ue5-main branch]
2021-04-29 16:14:48 -04:00
Jian Ru
f700cc15dd Add recursion support to FCompressionScratchBuffers. This is needed to fix a race condition with the inflight decompression task. It wasn�t a problem in UE4 because FAsyncTask::SyncCompletion used to just wait on a completion event. In UE5, however, it will try to pull other tasks from task queues and execute them locally until either there is no more task or the completion event is triggered.
#jira UE-113581
#rb arne.schober,ben.woodhouse,carlmagnus.nordin

[CL 16073735 by Jian Ru in ue5-main branch]
2021-04-21 10:55:31 -04:00
Marc Audy
01b7c9f4f5 Merge UE5/RES @ 15958325 to UE5/Main
This represents UE4/Main @ 15913390 and Dev-PerfTest @ 15913304

[CL 15958515 by Marc Audy in ue5-main branch]
2021-04-08 14:32:07 -04:00
Marc Audy
0cbbc781ca Merge UE5/Release-Engine-Staging @ 15740152 to UE5/Main
This represents UE4/Main @ 15709114

[CL 15740605 by Marc Audy in ue5-main branch]
2021-03-18 15:20:03 -04:00
Marc Audy
9753392e2b Merge UE5/RES CL# 15462083 to UE5/Main
This represents UE4/Main @ 15414221

[CL 15463811 by Marc Audy in ue5-main branch]
2021-02-18 18:13:28 -04:00
Arne Schober
72469b131a U5 - Don't keep the lock across the waitpoint.
#RB Nuno.Leiria

[CL 15339348 by Arne Schober in ue5-main branch]
2021-02-05 13:07:07 -04:00
charles bloom
3aad0ff797 Fix EncodePakEntry for compressionblocksize. Maintains binary compatibility with existing paks.
#rb: josh.adams

[CL 15242874 by charles bloom in ue5-main branch]
2021-01-28 13:15:04 -04:00
Marc Audy
bc88b73a29 Merge Release-Engine-Staging to Main @ CL# 15151250
Represents UE4/Main @ 15133763

[CL 15158774 by Marc Audy in ue5-main branch]
2021-01-21 16:22:06 -04:00
CarlMagnus Nordin
c565398bdd IoDispatcher: Added support for external backends
#rnx
#rb pj.kack, per.larsson

[CL 15134585 by CarlMagnus Nordin in ue5-main branch]
2021-01-19 04:39:56 -04:00
Tim Smith
19dbfb1f07 Fixing PVS 7.7 Issues:
warning V1028: Possible overflow. Consider casting operands, not the result.

#rb trivial
#jira UE-91644

[CL 15068181 by Tim Smith in ue5-main branch]
2021-01-13 12:38:04 -04:00