devin doucette
cf19925e08
DDC: Made CacheRecord serialized field order consistent with other types
...
#rb none
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17583018 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)
[CL 17583024 by devin doucette in ue5-release-engine-test branch]
2021-09-21 11:31:48 -04:00
per larsson
c6fafd4b7a
DDC2: Use compressed buffer as attachment
...
#rb Devin.Doucette
#rnx
#ROBOMERGE-AUTHOR: per.larsson
#ROBOMERGE-SOURCE: CL 17580737 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)
[CL 17580740 by per larsson in ue5-release-engine-test branch]
2021-09-21 04:51:59 -04:00
devin doucette
750419503e
DDC: Added ECachePolicy::KeepAlive and EBuildPolicy::CacheKeepAlive
...
The new flags are meant to prevent a cache store from evicting the associated cache records for the duration of the session.
#rb Zousar.Shaker
#rnx
#preflight 614954b611925a00017c525f
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17579887 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)
[CL 17579899 by devin doucette in ue5-release-engine-test branch]
2021-09-21 01:10:55 -04:00
stefan boberg
553dd501f1
Package marshaling now properly flags the root object as compressed
...
#rb none
#rnx
#ROBOMERGE-AUTHOR: stefan.boberg
#ROBOMERGE-SOURCE: CL 17573969 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)
[CL 17573973 by stefan boberg in ue5-release-engine-test branch]
2021-09-20 15:03:03 -04:00
per larsson
ba0ff4ff28
ZenDDC: Remove the use of Save/LoadCbPackage
...
#rb Stefan.Boberg
#rnx
#ROBOMERGE-AUTHOR: per.larsson
#ROBOMERGE-SOURCE: CL 17569390 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)
[CL 17569391 by per larsson in ue5-release-engine-test branch]
2021-09-20 07:13:37 -04:00
devin doucette
a6226e2f2e
DDC: Improved handling of build cancellation
...
#rb Zousar.Shaker
#rnx
#preflight 6143d4423c7c670001e9aa66
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17551334 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17551348 by devin doucette in ue5-release-engine-test branch]
2021-09-17 09:32:55 -04:00
stefan boberg
f9c84cc25a
Added code for Zen/HTTP marshaling of CbPackages. There is some more work to do to handle package responses properly but otherwise functional
...
#rnx
#ROBOMERGE-AUTHOR: stefan.boberg
#ROBOMERGE-SOURCE: CL 17543082 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17543094 by stefan boberg in ue5-release-engine-test branch]
2021-09-16 15:15:09 -04:00
stefan boberg
0f2f14b409
Added initial revision of CbPackage POST message formatting, along with fixes to Content-Type: header handling
...
Also improved conditionals in logging, to ensure all 2xx results are treated as success
#ROBOMERGE-AUTHOR: stefan.boberg
#ROBOMERGE-SOURCE: CL 17502033 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17502060 by stefan boberg in ue5-release-engine-test branch]
2021-09-14 05:24:51 -04:00
devin doucette
ec3fa9680f
CompositeBuffer: Renamed Flatten() to ToShared()
...
#rb none
#rnx
[FYI] Zousar.Shaker
#preflight 613f872b3bbb48000114081d
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17495384 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17495398 by devin doucette in ue5-release-engine-test branch]
2021-09-13 15:16:06 -04:00
devin doucette
55ac73b651
DDC: Renamed Dispatch[Op] to Schedule[Op] and tweaked formatting for consistency
...
#rb none
#rnx
#preflight 613a336abf5a710001674089
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17474273 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17474278 by devin doucette in ue5-release-engine-test branch]
2021-09-09 13:36:48 -04:00
johan torp
4afc055300
Add DDC2 memory scheduler to limit peak memory consumption
...
Also:
* Implemented rough memory usage estimate for texture cooking
* Fixed build action -> constant copying bug
#rb devin.doucette
#ROBOMERGE-AUTHOR: johan.torp
#ROBOMERGE-SOURCE: CL 17470303 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17470308 by johan torp in ue5-release-engine-test branch]
2021-09-09 06:04:13 -04:00
zousar shaker
8c80e5a866
Change Compact Binary Package API to represent binary attachments as compressed buffers identified by their raw hash.
...
Change Compact Binary Package serialization for binary attachments, compressed binary attachments and objects.
#rb devin.doucette
#ROBOMERGE-AUTHOR: zousar.shaker
#ROBOMERGE-SOURCE: CL 17450533 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17450587 by zousar shaker in ue5-release-engine-test branch]
2021-09-07 18:07:00 -04:00
aurel cordonnier
7f517562d5
Merge from Release-Engine-Staging @ 17438845 to Release-Engine-Test
...
This represents UE4/Main @17430120 and Dev-PerfTest @17437669
[CL 17439044 by aurel cordonnier in ue5-release-engine-test branch]
2021-09-06 12:23:53 -04:00
devin doucette
c39e30cfd7
Added missing includes of DerivedDataPayload.h found by the non-unity build
...
#rb none
#rnx
#ROBOMERGE-SOURCE: CL 17426590 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17426595 by devin doucette in ue5-release-engine-test branch]
2021-09-03 17:11:57 -04:00
devin doucette
9c01e2fc04
DDC: Moved FPayloadId into a dedicated header
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17426140 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17426194 by devin doucette in ue5-release-engine-test branch]
2021-09-03 16:30:53 -04:00
devin doucette
3d262ca7f0
CompressedBuffer: Removed the FormatName functionality and update its last remaining callers
...
#rb Paul.Chipchase, Zousar.Shaker
#rnx
#preflight 612feb940380e700016fc8e5
#ROBOMERGE-SOURCE: CL 17403021 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17403035 by devin doucette in ue5-release-engine-test branch]
2021-09-02 10:30:25 -04:00
matt peters
30ac4d4b22
Fix error in ZenDerivedDataBackend::Put. It needs to make payloads with missing data references to existing data in the CacheStore, and reject the put if any don't exist. This error was causing population of editordomain packages in a Zen store from a shareddatacache to fail.
...
Change GetZenData to only take TArray64, and to use PerformBlockingHead instead of PerformBlockingDownload if outputdata is null.
#rb Devin.Doucette
#rnx
[FYI] Stefan.Boberg
#ROBOMERGE-SOURCE: CL 17388568 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17388571 by matt peters in ue5-release-engine-test branch]
2021-09-01 12:26:46 -04:00
devin doucette
71a00b6367
DDC: Changed the heuristic for local cache backends to identify them more accurately
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17358471 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17358493 by devin doucette in ue5-release-engine-test branch]
2021-08-30 16:38:46 -04:00
devin doucette
ce01b1fb44
DDC: Stopped loading build inputs for local execution when execution is disabled
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17358468 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17358490 by devin doucette in ue5-release-engine-test branch]
2021-08-30 16:38:36 -04:00
devin doucette
a066ec0c49
DDC: Implemented existing cache debug options for the new cache stores
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17308400 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)
[CL 17308416 by devin doucette in ue5-release-engine-test branch]
2021-08-25 16:08:33 -04:00
devin doucette
b575156c6f
DDC: Added request barriers to the build job constructors
...
The barriers are needed to handle re-entrant AdvanceToState calls within the constructor of jobs with Blocking priority.
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17302241 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)
[CL 17302256 by devin doucette in ue5-release-engine-test branch]
2021-08-25 10:15:39 -04:00
devin doucette
275765055a
DDC: Fixed build callback status when the policy allows querying the cache but not building
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17291662 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v861-17282326)
[CL 17291681 by devin doucette in ue5-release-engine-test branch]
2021-08-24 15:25:59 -04:00
devin doucette
89b91075e8
DDC: Reverted the exclusion of DDCUtils from non-editor targets
...
#jira UE-120421
#jira UE-121792
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17253977 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17253985 by devin doucette in ue5-release-engine-test branch]
2021-08-20 17:18:05 -04:00
devin doucette
ae7825b29c
DDC: Added EBuildStatus::CacheKey and return EStatus::Ok from a build when no build or cache was requested
...
#rb Zousar.Shaker
#rnx
#preflight 611f304c008be900010bf006
#ROBOMERGE-SOURCE: CL 17247202 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17247215 by devin doucette in ue5-release-engine-test branch]
2021-08-20 10:04:41 -04:00
stefan boberg
85a811cb21
Refactored the UE-side Zen project store interface so that we now use a common HTTP interface implementation across cache / project store classes. No functional impact, tested with ShooterGame
...
#rb none
#ROBOMERGE-SOURCE: CL 17234463 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17234464 by stefan boberg in ue5-release-engine-test branch]
2021-08-19 11:13:10 -04:00
