Add PackageAccessTrackingOps::NAME_CookerBuildObject to catch references to other packages that are made from an object's BeginCacheForCookedPlatformData call.
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: matt.peters
#ROBOMERGE-SOURCE: CL 18279388 in //UE5/Release-5.0/... via CL 18279398
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)
[CL 18279406 by matt peters in ue5-release-engine-test branch]
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971
[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035
[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
This represents UE4/Main @17774255, Release-5.0 @17791557 and Dev-PerfTest @17789485
[CL 17794212 by aurel cordonnier in ue5-release-engine-test branch]
#rb Matt.Peters
#ROBOMERGE-AUTHOR: robert.millar
#ROBOMERGE-SOURCE: CL 17670090 via CL 17670131 via CL 17670137 via CL 17670141 via CL 17670157
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v875-17642767)
#ROBOMERGE[STARSHIP]: UE5-Main
[CL 17670162 by robert millar in ue5-release-engine-test branch]
This fix is a slightly modified version of PR #8248 (Contributed by alexey-pelykh)
Can be reproed with QAGame -run=DerivedDataCache -fill
#rnx
#rb Francis.Hurteau
#preflight 6101482c4cd79300018b738b
#ROBOMERGE-SOURCE: CL 16982467 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)
[CL 16982470 by alexey-pelykh in ue5-release-engine-test branch]
- WorldPartitionResaveActorsBuilder: detect and delete invalid actor files.
- DerivedDataCacheCommandlet: don't crash when encountering an invalid actor file.
#rb sebastien.lussier
#ROBOMERGE-SOURCE: CL 16836463 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16836475 by jeanfrancois dube in ue5-release-engine-test branch]
- Avoid redundant iterations and processing of UPackages by implementing a listener instead
- Process many packages asynchronously (not just one) by keeping them in memory longer and finishing them later
- Make the ddc fill job wait for async tasks properly
- Fix texture always being single threaded by allowing async at all time for ddc fill jobs
- Avoid calling IsCachedCookedPlatformDataLoaded too often on objects still being compiled
- Use a more sensible max memory usage in WorldPartitionHelpers to avoid calling the GC too often
- 30m16s to 7m44s when running -run=DerivedDataCache -fill -map=P_Construct_WP -mapsonly -projectonly with hot cache
- 2h30m to 1h11s when running -run=DerivedDataCache -fill -map=P_Construct_WP -mapsonly -projectonly with cold cache
#rb Zousar.Shaker, Devin.Doucette
#preflight 60d1fd5571002f0001b8880e
#ROBOMERGE-SOURCE: CL 16745009 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v835-16672529)
[CL 16745019 by danny couture in ue5-release-engine-test branch]
* Moved world setup from commandlet code to UWorldPartitionBuilder::RunBuilder()
* Moved actor iteration logic (reference loading + GC) from UWorldPartitionResaveActorsBuilder::RunInternal() to WorldPartition::ForEachActorWithLoading()
* Adjusted DerivedDataCacheCommandlet to (potentially) iterate on WP actors using UWorldPartitionActorsBuilder::ForEachActorWithLoading()
* Much faster processing of packages with no assets to cache (most ExternalActors packages)
#jira UE-114260
#rb patrick.enfedaque, jeanfrancois.dube
[CL 16157420 by Sebastien Lussier in ue5-main branch]
- DDC commandlet used number of outstanding jobs as a criterium to pump the compiler. This is not correct as there may be no outstanding jobs but the shadermaps aren't yet finalized.
- Another issue was FShaderCompilingManager::IsCompiling() also not being watertight and able to return false when there is known outstanding work. Thi can possibly fix more problems than the DDC commandlet (cooking as well).
#rb none
[CODEREVIEW] Matt.Peters, Ben.Ingram, Jason.Nadro
#jira none
#ROBOMERGE-SOURCE: CL 15908495 in //UE5/Release-5.0-EarlyAccess/...
#ROBOMERGE-BOT: STARSHIP (Release-5.0-EarlyAccess -> Main) (v786-15839533)
[CL 15908505 by arciel rekman in ue5-main branch]
#jira UE-108245
Change the DerivedDataCacheCommandlet to wait on all objects to return true for IsCachedCookedPlatformDataLoaded before moving on.
Change the loops over objects and packages to be faster and to not add packages as processed if we didn't handle them in the BeginCache loop.
#rnx
#rb Devin.Doucette
[CL 15876400 by Matt Peters in ue5-main branch]
#rnx
#rb none
#ROBOMERGE-SOURCE: CL 10869241 via CL 10869527 via CL 10869904
#ROBOMERGE-BOT: (v613-10869866)
[CL 10870586 by ryan durand in Main branch]
