#rb Per.Larsson
#rnx
#preflight 612e03f6677f0e000144b652
- Updated the comments to make the methods intent very clear (unload current payloads and prevent future payloads from being loaded from disk)
- Fix an inconsistency with BD2 running from IoStore, where calling ::RemoveBulkData was not preventing future loads in all cases. We now invalidate the PackageID when running from the IoStore in addition to unregistering the filepath token when running from pak files.
- No longer clear the flags when calling ::RemoveBulkData to be consistent with BD1.
- We might want to consider deprecating this method name and using something like ::Reset instead, but that would imply that we would reset all members and I do not see the value in making this much larger change if we do not need to do so.
#ROBOMERGE-SOURCE: CL 17366830 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17366843 by paul chipchase in ue5-release-engine-test branch]
This fix was originally made by Paul Chipchase.
#rb Paul.Chipchase
#preflight 61249d24cc11eb0001ac4ef2
#ROBOMERGE-SOURCE: CL 17282377 via CL 17282388
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v858-17259218)
[CL 17282396 by charles derousiers in ue5-release-engine-test branch]
Remove limit on pending package size since request buffers are no longer allocated up front.
Rely on the iodispatcher to sort requests instead of using the global load order for each package.
No longer store export bundle size and load order in the package store.
#jira FROST-4677
#rb per.larsson
#rnx
#ROBOMERGE-SOURCE: CL 17267090 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v858-17259218)
[CL 17267107 by carlmagnus nordin in ue5-release-engine-test branch]
Fixed edge case where imported packages failed to register as dependencies if they had serialized all their exports but not postloaded them yet
#rb pj.kack
#rnx
#jira UE-120987
#ROBOMERGE-SOURCE: CL 17099821 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17099850 by carlmagnus nordin in ue5-release-engine-test branch]
#rb cm
#rnx
#ROBOMERGE-SOURCE: CL 17048386 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v850-17047176)
[CL 17049897 by martin ridgers in ue5-release-engine-test branch]
Ensure that all reachable packages have all their exports serialized before starting post load instead of relying on the serialization order. This is still required in some cases.
Apply the same logic to ensure that all reachable packages are post loaded before finishing loading
#rb pj.kack
#rnx
#jira none
#ROBOMERGE-SOURCE: CL 17027677 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v843-17027566)
#ROBOMERGE[bot1]: dev-enginemerge-test
[CL 17027695 by carlmagnus nordin in ue5-release-engine-test branch]
AsyncLoading with EditorDomain: batch up the callbacks in FAsyncLoadingThread::ProcessLoadedPackages so that the EditorDomain callback that saves the just-loaded package does not cause a stack overflow by adding 14 functions on the stack for each pending package discovered in the FlushAsyncLoading call.
#rb Francis.Hurteau
#rnx
#ROBOMERGE-SOURCE: CL 17017812 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
[CL 17017898 by matt peters in ue5-release-engine-test branch]
Add more flexibility to the redirects/localization functionality by moving redirect information away from the package summaries and import tables
Changed import references from global import hashes to package local export hashes
#rb pj.kack
#rnx
#jira none
#ROBOMERGE-SOURCE: CL 17014898 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
#ROBOMERGE[bot1]: dev-enginemerge-test
[CL 17014905 by carlmagnus nordin in ue5-release-engine-test branch]
Add OnEndLoad calls for Async loaded packages, since the editor sometimes uses async loads.
#rb Francis.Hurteau
#rnx
#ROBOMERGE-SOURCE: CL 16861817 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16861829 by matt peters in ue5-release-engine-test branch]
Updating FVirtualizedUntypedBulkData and textures to use the BulkDataRegistry.
BulkDataRegistry: Add get/put accessors for the cached BulkDataList of packages.
EditorDomain: Move ClassDigests into a global variable that can be shared with BulkDataRegistry.
EditorDomain: Improve performance of GetFileSize by fetching metadata only.
Tickable Cook Objects, for systems used by the cooker that need to be ticked.
Implementation of the the BulkDataRegistry that uses the DDC cache for persistent storage of the BulkDataList.
#rb Devin.Doucette, Paul.Chipchase, Zousar.Shaker
#ROBOMERGE-SOURCE: CL 16768772 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v835-16672529)
[CL 16768778 by matt peters in ue5-release-engine-test branch]
- This has gone so long without being noticed as it is not expected that bulkdata will be compressed during a cook, as the pakfiles themselves will be compressed.
- InternalLoadFromIoStore now only loads via the IoDispatcher directly to the destination buffer if the data is in uncompressed format.
- If the data is going to be compressed we let the IoDispatcher allocate and return the compressed buffer and bulkdata will decompress that to the destination buffer instead.
#rb Per.Larsson, CM.Nordin
[FYI] Charles.deRousiers
#preflight 60c83e2143ec380001e2ad1b
#ROBOMERGE-SOURCE: CL 16670240 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v834-16658389)
[CL 16670246 by paul chipchase in ue5-release-engine-test branch]
- Since reloading inline data does not work in the old loader we need to make it more obvious to developers when they are doing it in the old loader so that it doesn't get submitted.
- An ensure will cause the process top break in the debugger and is more likely to get attention. It will also provide the callstack for any QA bug report which will make it easier for us to triage to the correct team to fix their calling code than a vague warning about bulkdata.
- Also provided a new define, UE_KEEP_INLINE_RELOADING_CONSISTENT, which when enabled will cause reloading of inline bulkdata to fail (and error) in the old loader as well.
- The ensure can be supressed by setting [Core.System]IgnoreInlineBulkDataReloadEnsures=True in an engine config file, this might be useful for projects that do not care about running from staged data for what ever reason (but supressing the ensure will not prevent the data from failing to load when run with the new loader so this is strictly a 'use at your own risk' option)
#rb CarlMagnus.Nordin
#preflight 60bf45f97bc5f2000173195a
[CL 16586071 by paul chipchase in ue5-main branch]
