devin doucette
55ac73b651
DDC: Renamed Dispatch[Op] to Schedule[Op] and tweaked formatting for consistency
...
#rb none
#rnx
#preflight 613a336abf5a710001674089
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17474273 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17474278 by devin doucette in ue5-release-engine-test branch]
2021-09-09 13:36:48 -04:00
johan torp
4afc055300
Add DDC2 memory scheduler to limit peak memory consumption
...
Also:
* Implemented rough memory usage estimate for texture cooking
* Fixed build action -> constant copying bug
#rb devin.doucette
#ROBOMERGE-AUTHOR: johan.torp
#ROBOMERGE-SOURCE: CL 17470303 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17470308 by johan torp in ue5-release-engine-test branch]
2021-09-09 06:04:13 -04:00
devin doucette
9c01e2fc04
DDC: Moved FPayloadId into a dedicated header
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17426140 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17426194 by devin doucette in ue5-release-engine-test branch]
2021-09-03 16:30:53 -04:00
devin doucette
a066ec0c49
DDC: Implemented existing cache debug options for the new cache stores
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17308400 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)
[CL 17308416 by devin doucette in ue5-release-engine-test branch]
2021-08-25 16:08:33 -04:00
devin doucette
ae7825b29c
DDC: Added EBuildStatus::CacheKey and return EStatus::Ok from a build when no build or cache was requested
...
#rb Zousar.Shaker
#rnx
#preflight 611f304c008be900010bf006
#ROBOMERGE-SOURCE: CL 17247202 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17247215 by devin doucette in ue5-release-engine-test branch]
2021-08-20 10:04:41 -04:00
devin doucette
d55593526e
DDC: Add FBuildConfigContext::SetRequiredMemory() and forward the estimate to the build scheduler
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17088443 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17089009 by devin doucette in ue5-release-engine-test branch]
2021-08-06 17:53:47 -04:00
devin doucette
af0f2d277f
DDC: Added flags to control request barrier behavior
...
#rb Matt.Peters
#rnx
#ROBOMERGE-SOURCE: CL 17088062 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17088067 by devin doucette in ue5-release-engine-test branch]
2021-08-06 17:11:37 -04:00
devin doucette
c67fcf1702
DDC: Split DerivedDataRequest.h and rename DerivedDataBuildPolicy.h
...
#rb none
#rnx
#ROBOMERGE-SOURCE: CL 17086960 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17086977 by devin doucette in ue5-release-engine-test branch]
2021-08-06 15:50:00 -04:00
devin doucette
bd60f3ef1b
DDC: Removed ICacheFactory in favor of exported functions
...
FCacheBucket is now always exposed as FAnsiStringView.
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17084521 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17084549 by devin doucette in ue5-release-engine-test branch]
2021-08-06 12:53:08 -04:00
devin doucette
7ae4b64cd6
DDC: Removed IBuild::Load[Type] in favor of exported functions
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17083958 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17083970 by devin doucette in ue5-release-engine-test branch]
2021-08-06 11:58:24 -04:00
devin doucette
f9a760f21f
DDC: Rename FRequestGroup to FRequestOwner and export its constructor
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17074555 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17074567 by devin doucette in ue5-release-engine-test branch]
2021-08-05 15:46:22 -04:00
devin doucette
733d9c1a97
DDC: Added conversions between FPayloadId and FCbObjectId
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17071877 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17071890 by devin doucette in ue5-release-engine-test branch]
2021-08-05 13:37:13 -04:00
devin doucette
d50e330b94
DDC: Split the new API from the old API
...
The new API uses exported functions and cannot be included with the old API without compile errors in existing code that has an include-only dependency on DDC.
#rb Zousar.Shaker
#rnx
#preflight 610c01e3aeb05700011dc5ab
#ROBOMERGE-SOURCE: CL 17071263 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17071271 by devin doucette in ue5-release-engine-test branch]
2021-08-05 13:12:08 -04:00
devin doucette
bfda02d384
DDC: Replaced FRequest with FRequestGroup to handle nested and chained requests more robustly
...
Any function that may create a request now has a IRequestOwner& parameter, and uses the Begin and End functions on the owner to manage the lifetime of any requests that it creates, as well as using End to invoke the completion callback for any request which has one.
The new FRequestBarrier may be used to block a group from being considered complete in a scope where more requests may be added to it.
#rb Matt.Peters
#rnx
#preflight 6109b5c403d303000144cce5
#preflight 610acf7103d30300016fda94
#ROBOMERGE-SOURCE: CL 17060470 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v850-17047176)
[CL 17060649 by devin doucette in ue5-release-engine-test branch]
2021-08-04 18:08:50 -04:00
aurel cordonnier
dc4bf61540
Merge from Release-Engine-Staging @ 17030559 to Release-Engine-Test
...
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17030553
[CL 17031509 by aurel cordonnier in ue5-release-engine-test branch]
2021-08-03 11:56:47 -04:00
devin doucette
77b340efea
DDC: Moved new stats functions into FDerivedDataCacheInterface to remove module dependency
...
#rb Aurel.Cordonnier
#rnx
#ROBOMERGE-SOURCE: CL 16997387 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)
[CL 16997407 by devin doucette in ue5-release-engine-test branch]
2021-07-29 13:07:00 -04:00
devin doucette
c29fdcf532
DDC: Compress payloads using Oodle Mermaid VeryFast
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 16956293 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)
[CL 16956298 by devin doucette in ue5-release-engine-test branch]
2021-07-26 10:29:10 -04:00
mark lintott
fe9766c261
Updated DDC Widget
...
Added detailed resource and cache backend information.
Added new indicators for Busy, Upload, Download, LocalCache and RemoteCache
Minor modifications to StudioAnalytics to re-use the stats gathering code
#rb francis.hurteau
[FYI] jeff.farris
#ROBOMERGE-SOURCE: CL 16929122 via CL 16929180
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)
[CL 16929193 by mark lintott in ue5-release-engine-test branch]
2021-07-22 15:10:11 -04:00
devin doucette
3eb56fc792
DDC: Changed TRequest to cast to IRequest before invoking its functions
...
This allows the request type to make its functions on IRequest protected or private, or allows use with a request type that hides its IRequest behind an implicit conversion.
Also disabled operator-> and operator* for the base IRequest because it is preferred to use the functions on TRequest to the IRequest interface.
#rb Matt.Peters
#rnx
#ROBOMERGE-SOURCE: CL 16911217 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16911221 by devin doucette in ue5-release-engine-test branch]
2021-07-21 12:43:20 -04:00
devin doucette
57259e9a7b
DDC: Switched to XXH3 for FPayloadId::FromName
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 16889028 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16889059 by devin doucette in ue5-release-engine-test branch]
2021-07-19 17:07:28 -04:00
zousar shaker
cd9c332085
Add methods for iterating through build functions in the function registry.
...
#rb devin.doucette
#ROBOMERGE-SOURCE: CL 16888770 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16888793 by zousar shaker in ue5-release-engine-test branch]
2021-07-19 16:49:35 -04:00
devin doucette
58774329d7
DDC: Exposed the cache key and build status in the build complete callback params
...
#rb Zousar.Shaker
#rnx
#preflight 60f5c7a78da1560001c68086
#ROBOMERGE-SOURCE: CL 16888763 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16888787 by devin doucette in ue5-release-engine-test branch]
2021-07-19 16:49:25 -04:00
devin doucette
bed1f486f8
DDC: Added EPutStatus::Skipped to avoid slow retry when simulating cache misses
...
#rb Zousar.Shaker
#preflight 60f12443a34bf50001654df1
#ROBOMERGE-SOURCE: CL 16883247 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16883252 by devin doucette in ue5-release-engine-test branch]
2021-07-19 10:12:20 -04:00
devin doucette
6619a666b6
DDC: Fixed a missing include in DerivedDataBuildVersion.h
...
#rb trivial
#rnx
#ROBOMERGE-SOURCE: CL 16883233 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16883240 by devin doucette in ue5-release-engine-test branch]
2021-07-19 10:11:00 -04:00
devin doucette
0af9901545
DDC: Fixed race conditions in the build job
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 16870676 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16870677 by devin doucette in ue5-release-engine-test branch]
2021-07-16 01:11:34 -04:00
