Stefan Boberg
2592eb32fa
Package marshaling now properly flags the root object as compressed
...
#rb none
#rnx
[CL 17573969 by Stefan Boberg in ue5-main branch]
2021-09-20 15:02:31 -04:00
Per Larsson
d2d4010673
ZenDDC: Remove the use of Save/LoadCbPackage
...
#rb Stefan.Boberg
#rnx
[CL 17569390 by Per Larsson in ue5-main branch]
2021-09-20 07:13:29 -04:00
Devin Doucette
1c4926f324
DDC: Improved handling of build cancellation
...
#rb Zousar.Shaker
#rnx
#preflight 6143d4423c7c670001e9aa66
[CL 17551334 by Devin Doucette in ue5-main branch]
2021-09-17 09:32:28 -04:00
Stefan Boberg
0738f8db34
Added code for Zen/HTTP marshaling of CbPackages. There is some more work to do to handle package responses properly but otherwise functional
...
#rnx
[CL 17543082 by Stefan Boberg in ue5-main branch]
2021-09-16 15:14:21 -04:00
Stefan Boberg
ce4833424f
Added initial revision of CbPackage POST message formatting, along with fixes to Content-Type: header handling
...
Also improved conditionals in logging, to ensure all 2xx results are treated as success
[CL 17502033 by Stefan Boberg in ue5-main branch]
2021-09-14 05:23:24 -04:00
Devin Doucette
3ce878a8f1
CompositeBuffer: Renamed Flatten() to ToShared()
...
#rb none
#rnx
#fyi Zousar.Shaker
#preflight 613f872b3bbb48000114081d
[CL 17495384 by Devin Doucette in ue5-main branch]
2021-09-13 15:15:35 -04:00
Devin Doucette
e074999d9a
DDC: Renamed Dispatch[Op] to Schedule[Op] and tweaked formatting for consistency
...
#rb none
#rnx
#preflight 613a336abf5a710001674089
[CL 17474273 by Devin Doucette in ue5-main branch]
2021-09-09 13:36:28 -04:00
Johan Torp
7286b53430
Add DDC2 memory scheduler to limit peak memory consumption
...
Also:
* Implemented rough memory usage estimate for texture cooking
* Fixed build action -> constant copying bug
#rb devin.doucette
[CL 17470303 by Johan Torp in ue5-main branch]
2021-09-09 06:04:00 -04:00
aurel cordonnier
e3f7878676
Merge from Release-Engine-Test @ 17462327 to UE5/Main
...
This represents UE4/Main @17430120 and Dev-PerfTest @17437669
[CL 17463546 by aurel cordonnier in ue5-main branch]
2021-09-08 16:42:26 -04:00
Zousar Shaker
11d6112f21
Change Compact Binary Package API to represent binary attachments as compressed buffers identified by their raw hash.
...
Change Compact Binary Package serialization for binary attachments, compressed binary attachments and objects.
#rb devin.doucette
[CL 17450533 by Zousar Shaker in ue5-main branch]
2021-09-07 18:02:34 -04:00
Devin Doucette
4537929a0d
Added missing includes of DerivedDataPayload.h found by the non-unity build
...
#rb none
#rnx
[CL 17426590 by Devin Doucette in ue5-main branch]
2021-09-03 17:11:27 -04:00
Devin Doucette
d115ba8b34
DDC: Moved FPayloadId into a dedicated header
...
#rb Zousar.Shaker
#rnx
[CL 17426140 by Devin Doucette in ue5-main branch]
2021-09-03 16:28:51 -04:00
Devin Doucette
beba4c2cce
CompressedBuffer: Removed the FormatName functionality and update its last remaining callers
...
#rb Paul.Chipchase, Zousar.Shaker
#rnx
#preflight 612feb940380e700016fc8e5
[CL 17403021 by Devin Doucette in ue5-main branch]
2021-09-02 10:29:17 -04:00
Matt Peters
b5f4953e70
Fix error in ZenDerivedDataBackend::Put. It needs to make payloads with missing data references to existing data in the CacheStore, and reject the put if any don't exist. This error was causing population of editordomain packages in a Zen store from a shareddatacache to fail.
...
Change GetZenData to only take TArray64, and to use PerformBlockingHead instead of PerformBlockingDownload if outputdata is null.
#rb Devin.Doucette
#rnx
#fyi Stefan.Boberg
[CL 17388568 by Matt Peters in ue5-main branch]
2021-09-01 12:26:38 -04:00
Devin Doucette
736f3df50b
DDC: Changed the heuristic for local cache backends to identify them more accurately
...
#rb Zousar.Shaker
#rnx
[CL 17358471 by Devin Doucette in ue5-main branch]
2021-08-30 16:37:45 -04:00
Devin Doucette
a7aa76fea0
DDC: Stopped loading build inputs for local execution when execution is disabled
...
#rb Zousar.Shaker
#rnx
[CL 17358468 by Devin Doucette in ue5-main branch]
2021-08-30 16:37:42 -04:00
Devin Doucette
ff6c060a31
DDC: Implemented existing cache debug options for the new cache stores
...
#rb Zousar.Shaker
#rnx
[CL 17308400 by Devin Doucette in ue5-main branch]
2021-08-25 16:07:50 -04:00
Devin Doucette
3962c6493a
DDC: Added request barriers to the build job constructors
...
The barriers are needed to handle re-entrant AdvanceToState calls within the constructor of jobs with Blocking priority.
#rb Zousar.Shaker
#rnx
[CL 17302241 by Devin Doucette in ue5-main branch]
2021-08-25 10:14:58 -04:00
Devin Doucette
ef978526fa
DDC: Fixed build callback status when the policy allows querying the cache but not building
...
#rb Zousar.Shaker
#rnx
[CL 17291662 by Devin Doucette in ue5-main branch]
2021-08-24 15:24:58 -04:00
Devin Doucette
e8d662c770
DDC: Added EBuildStatus::CacheKey and return EStatus::Ok from a build when no build or cache was requested
...
#rb Zousar.Shaker
#rnx
#preflight 611f304c008be900010bf006
[CL 17247202 by Devin Doucette in ue5-main branch]
2021-08-20 10:04:06 -04:00
Stefan Boberg
d44fa85240
Refactored the UE-side Zen project store interface so that we now use a common HTTP interface implementation across cache / project store classes. No functional impact, tested with ShooterGame
...
#rb none
[CL 17234463 by Stefan Boberg in ue5-main branch]
2021-08-19 11:13:03 -04:00
Stefan Boberg
cd127ff786
Updated Zen HTTP interfaces to accept large payloads as a preparation for unifying the cache/store client implementations
...
[CL 17218879 by Stefan Boberg in ue5-main branch]
2021-08-18 14:11:58 -04:00
Stefan Boberg
f85fda5612
DLL-exported functions for Zen HTTP interfaces to allow them to be consumed from other modules, and renamed them to make it easier to search for them (previous names were derived from the Jupiter HTTP back-end)
...
#rb trivial
[CL 17187385 by Stefan Boberg in ue5-main branch]
2021-08-17 03:31:20 -04:00
Andriy Tylychko
2a295eb685
deprecated FTicker and family and replaced by thread-safe FTSTicker
...
#jira UE-120090
#rb francis.hurteau
[CL 17176325 by Andriy Tylychko in ue5-main branch]
2021-08-16 11:05:18 -04:00
Devin Doucette
4bea29a1d4
DDC: Fixed a build job assert caused by canceling at the wrong time
...
#rb Zousar.Shaker
#rnx
[CL 17108375 by Devin Doucette in ue5-main branch]
2021-08-09 17:54:54 -04:00
