Commit Graph

135 Commits

Author SHA1 Message Date
Devin Doucette
e074999d9a DDC: Renamed Dispatch[Op] to Schedule[Op] and tweaked formatting for consistency
#rb none
#rnx
#preflight 613a336abf5a710001674089

[CL 17474273 by Devin Doucette in ue5-main branch]
2021-09-09 13:36:28 -04:00
Johan Torp
7286b53430 Add DDC2 memory scheduler to limit peak memory consumption
Also:
* Implemented rough memory usage estimate for texture cooking
* Fixed build action -> constant copying bug

#rb devin.doucette

[CL 17470303 by Johan Torp in ue5-main branch]
2021-09-09 06:04:00 -04:00
Devin Doucette
d115ba8b34 DDC: Moved FPayloadId into a dedicated header
#rb Zousar.Shaker
#rnx

[CL 17426140 by Devin Doucette in ue5-main branch]
2021-09-03 16:28:51 -04:00
Devin Doucette
ff6c060a31 DDC: Implemented existing cache debug options for the new cache stores
#rb Zousar.Shaker
#rnx

[CL 17308400 by Devin Doucette in ue5-main branch]
2021-08-25 16:07:50 -04:00
Devin Doucette
e8d662c770 DDC: Added EBuildStatus::CacheKey and return EStatus::Ok from a build when no build or cache was requested
#rb Zousar.Shaker
#rnx
#preflight 611f304c008be900010bf006

[CL 17247202 by Devin Doucette in ue5-main branch]
2021-08-20 10:04:06 -04:00
Devin Doucette
5bdd0e67b3 DDC: Add FBuildConfigContext::SetRequiredMemory() and forward the estimate to the build scheduler
#rb Zousar.Shaker
#rnx

[CL 17088443 by Devin Doucette in ue5-main branch]
2021-08-06 17:32:53 -04:00
Devin Doucette
2d827a0a7a DDC: Added flags to control request barrier behavior
#rb Matt.Peters
#rnx

[CL 17088062 by Devin Doucette in ue5-main branch]
2021-08-06 17:11:24 -04:00
Devin Doucette
30760f545b DDC: Split DerivedDataRequest.h and rename DerivedDataBuildPolicy.h
#rb none
#rnx

[CL 17086960 by Devin Doucette in ue5-main branch]
2021-08-06 15:49:14 -04:00
Devin Doucette
48d8d5f7eb DDC: Removed ICacheFactory in favor of exported functions
FCacheBucket is now always exposed as FAnsiStringView.

#rb Zousar.Shaker
#rnx

[CL 17084521 by Devin Doucette in ue5-main branch]
2021-08-06 12:51:28 -04:00
Devin Doucette
c4e3574345 DDC: Removed IBuild::Load[Type] in favor of exported functions
#rb Zousar.Shaker
#rnx

[CL 17083958 by Devin Doucette in ue5-main branch]
2021-08-06 11:57:55 -04:00
Devin Doucette
0167604e91 DDC: Rename FRequestGroup to FRequestOwner and export its constructor
#rb Zousar.Shaker
#rnx

[CL 17074555 by Devin Doucette in ue5-main branch]
2021-08-05 15:45:41 -04:00
Devin Doucette
2d9736cdea DDC: Added conversions between FPayloadId and FCbObjectId
#rb Zousar.Shaker
#rnx

[CL 17071877 by Devin Doucette in ue5-main branch]
2021-08-05 13:36:44 -04:00
Devin Doucette
87792e1b5e DDC: Split the new API from the old API
The new API uses exported functions and cannot be included with the old API without compile errors in existing code that has an include-only dependency on DDC.

#rb Zousar.Shaker
#rnx
#preflight 610c01e3aeb05700011dc5ab

[CL 17071263 by Devin Doucette in ue5-main branch]
2021-08-05 13:11:50 -04:00
Devin Doucette
3513768988 DDC: Replaced FRequest with FRequestGroup to handle nested and chained requests more robustly
Any function that may create a request now has a IRequestOwner& parameter, and uses the Begin and End functions on the owner to manage the lifetime of any requests that it creates, as well as using End to invoke the completion callback for any request which has one.

The new FRequestBarrier may be used to block a group from being considered complete in a scope where more requests may be added to it.

#rb Matt.Peters
#rnx
#preflight 6109b5c403d303000144cce5
#preflight 610acf7103d30300016fda94

[CL 17060470 by Devin Doucette in ue5-main branch]
2021-08-04 17:52:40 -04:00
aurel cordonnier
dc856801cd Merge from Release-Engine-Test @ 17059716 to UE5/Main
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17029914

[CL 17060422 by aurel cordonnier in ue5-main branch]
2021-08-04 17:46:20 -04:00
Devin Doucette
a1fb614f8a DDC: Moved new stats functions into FDerivedDataCacheInterface to remove module dependency
#rb Aurel.Cordonnier
#rnx

[CL 16997387 by Devin Doucette in ue5-main branch]
2021-07-29 13:05:41 -04:00
Devin Doucette
89c7e45694 DDC: Compress payloads using Oodle Mermaid VeryFast
#rb Zousar.Shaker
#rnx

[CL 16956293 by Devin Doucette in ue5-main branch]
2021-07-26 10:28:55 -04:00
mark lintott
d790fa8c84 Updated DDC Widget
Added detailed resource and cache backend information.
Added new indicators for Busy, Upload, Download, LocalCache and RemoteCache
Minor modifications to StudioAnalytics to re-use the stats gathering code
#rb francis.hurteau
[FYI] jeff.farris


#ROBOMERGE-SOURCE: CL 16929122
#ROBOMERGE-BOT: (v838-16927207)

[CL 16929180 by mark lintott in ue5-main branch]
2021-07-22 15:09:44 -04:00
Devin Doucette
bea14d56ce DDC: Changed TRequest to cast to IRequest before invoking its functions
This allows the request type to make its functions on IRequest protected or private, or allows use with a request type that hides its IRequest behind an implicit conversion.

Also disabled operator-> and operator* for the base IRequest because it is preferred to use the functions on TRequest to the IRequest interface.

#rb Matt.Peters
#rnx

[CL 16911217 by Devin Doucette in ue5-main branch]
2021-07-21 12:42:51 -04:00
Devin Doucette
ca1582337c DDC: Switched to XXH3 for FPayloadId::FromName
#rb Zousar.Shaker
#rnx

[CL 16889028 by Devin Doucette in ue5-main branch]
2021-07-19 17:05:40 -04:00
Zousar Shaker
3f35355cc1 Add methods for iterating through build functions in the function registry.
#rb devin.doucette

[CL 16888770 by Zousar Shaker in ue5-main branch]
2021-07-19 16:47:17 -04:00
Devin Doucette
0748494fc6 DDC: Exposed the cache key and build status in the build complete callback params
#rb Zousar.Shaker
#rnx
#preflight 60f5c7a78da1560001c68086

[CL 16888763 by Devin Doucette in ue5-main branch]
2021-07-19 16:46:58 -04:00
Devin Doucette
431dab26ea DDC: Added EPutStatus::Skipped to avoid slow retry when simulating cache misses
#rb Zousar.Shaker
#preflight 60f12443a34bf50001654df1

[CL 16883247 by Devin Doucette in ue5-main branch]
2021-07-19 10:11:49 -04:00
Devin Doucette
090bdb178e DDC: Fixed a missing include in DerivedDataBuildVersion.h
#rb trivial
#rnx

[CL 16883233 by Devin Doucette in ue5-main branch]
2021-07-19 10:10:26 -04:00
Devin Doucette
f64bc61bb7 DDC: Fixed race conditions in the build job
#rb Zousar.Shaker
#rnx

[CL 16870676 by Devin Doucette in ue5-main branch]
2021-07-16 01:11:20 -04:00