Commit Graph

401 Commits

Author SHA1 Message Date
Zousar Shaker
9709a3a5bd Avoid a compile error due to narrowing of types when compiling win64 editor with clang.
#rb trivial

[CL 17603577 by Zousar Shaker in ue5-main branch]
2021-09-22 21:58:34 -04:00
Zousar Shaker
097375247d Allow ZenServer to be autolaunched by editor use cases that require its presence without insisting that it always be autolaunched.
#rb matt.peters
#preflight 614b4150ee16e20001b146e3

[CL 17597162 by Zousar Shaker in ue5-main branch]
2021-09-22 12:57:39 -04:00
Devin Doucette
72da9cf78e DDC: Made CacheRecord serialized field order consistent with other types
#rb none
#rnx

[CL 17583018 by Devin Doucette in ue5-main branch]
2021-09-21 11:29:56 -04:00
Per Larsson
f37ebb8cf0 DDC2: Use compressed buffer as attachment
#rb Devin.Doucette
#rnx

[CL 17580737 by Per Larsson in ue5-main branch]
2021-09-21 04:51:47 -04:00
Devin Doucette
0f862d5a9a DDC: Added ECachePolicy::KeepAlive and EBuildPolicy::CacheKeepAlive
The new flags are meant to prevent a cache store from evicting the associated cache records for the duration of the session.

#rb Zousar.Shaker
#rnx
#preflight 614954b611925a00017c525f

[CL 17579887 by Devin Doucette in ue5-main branch]
2021-09-21 01:07:30 -04:00
Stefan Boberg
2592eb32fa Package marshaling now properly flags the root object as compressed
#rb none
#rnx

[CL 17573969 by Stefan Boberg in ue5-main branch]
2021-09-20 15:02:31 -04:00
Per Larsson
d2d4010673 ZenDDC: Remove the use of Save/LoadCbPackage
#rb Stefan.Boberg
#rnx

[CL 17569390 by Per Larsson in ue5-main branch]
2021-09-20 07:13:29 -04:00
Devin Doucette
1c4926f324 DDC: Improved handling of build cancellation
#rb Zousar.Shaker
#rnx
#preflight 6143d4423c7c670001e9aa66

[CL 17551334 by Devin Doucette in ue5-main branch]
2021-09-17 09:32:28 -04:00
Stefan Boberg
0738f8db34 Added code for Zen/HTTP marshaling of CbPackages. There is some more work to do to handle package responses properly but otherwise functional
#rnx

[CL 17543082 by Stefan Boberg in ue5-main branch]
2021-09-16 15:14:21 -04:00
Stefan Boberg
ce4833424f Added initial revision of CbPackage POST message formatting, along with fixes to Content-Type: header handling
Also improved conditionals in logging, to ensure all 2xx results are treated as success

[CL 17502033 by Stefan Boberg in ue5-main branch]
2021-09-14 05:23:24 -04:00
Devin Doucette
3ce878a8f1 CompositeBuffer: Renamed Flatten() to ToShared()
#rb none
#rnx
#fyi Zousar.Shaker
#preflight 613f872b3bbb48000114081d

[CL 17495384 by Devin Doucette in ue5-main branch]
2021-09-13 15:15:35 -04:00
Devin Doucette
e074999d9a DDC: Renamed Dispatch[Op] to Schedule[Op] and tweaked formatting for consistency
#rb none
#rnx
#preflight 613a336abf5a710001674089

[CL 17474273 by Devin Doucette in ue5-main branch]
2021-09-09 13:36:28 -04:00
Johan Torp
7286b53430 Add DDC2 memory scheduler to limit peak memory consumption
Also:
* Implemented rough memory usage estimate for texture cooking
* Fixed build action -> constant copying bug

#rb devin.doucette

[CL 17470303 by Johan Torp in ue5-main branch]
2021-09-09 06:04:00 -04:00
aurel cordonnier
e3f7878676 Merge from Release-Engine-Test @ 17462327 to UE5/Main
This represents UE4/Main @17430120 and Dev-PerfTest @17437669

[CL 17463546 by aurel cordonnier in ue5-main branch]
2021-09-08 16:42:26 -04:00
Zousar Shaker
11d6112f21 Change Compact Binary Package API to represent binary attachments as compressed buffers identified by their raw hash.
Change Compact Binary Package serialization for binary attachments, compressed binary attachments and objects.

#rb devin.doucette

[CL 17450533 by Zousar Shaker in ue5-main branch]
2021-09-07 18:02:34 -04:00
Devin Doucette
4537929a0d Added missing includes of DerivedDataPayload.h found by the non-unity build
#rb none
#rnx

[CL 17426590 by Devin Doucette in ue5-main branch]
2021-09-03 17:11:27 -04:00
Devin Doucette
d115ba8b34 DDC: Moved FPayloadId into a dedicated header
#rb Zousar.Shaker
#rnx

[CL 17426140 by Devin Doucette in ue5-main branch]
2021-09-03 16:28:51 -04:00
Devin Doucette
beba4c2cce CompressedBuffer: Removed the FormatName functionality and update its last remaining callers
#rb Paul.Chipchase, Zousar.Shaker
#rnx
#preflight 612feb940380e700016fc8e5

[CL 17403021 by Devin Doucette in ue5-main branch]
2021-09-02 10:29:17 -04:00
Matt Peters
b5f4953e70 Fix error in ZenDerivedDataBackend::Put. It needs to make payloads with missing data references to existing data in the CacheStore, and reject the put if any don't exist. This error was causing population of editordomain packages in a Zen store from a shareddatacache to fail.
Change GetZenData to only take TArray64, and to use PerformBlockingHead instead of PerformBlockingDownload if outputdata is null.
#rb Devin.Doucette
#rnx
#fyi Stefan.Boberg

[CL 17388568 by Matt Peters in ue5-main branch]
2021-09-01 12:26:38 -04:00
Devin Doucette
736f3df50b DDC: Changed the heuristic for local cache backends to identify them more accurately
#rb Zousar.Shaker
#rnx

[CL 17358471 by Devin Doucette in ue5-main branch]
2021-08-30 16:37:45 -04:00
Devin Doucette
a7aa76fea0 DDC: Stopped loading build inputs for local execution when execution is disabled
#rb Zousar.Shaker
#rnx

[CL 17358468 by Devin Doucette in ue5-main branch]
2021-08-30 16:37:42 -04:00
Devin Doucette
ff6c060a31 DDC: Implemented existing cache debug options for the new cache stores
#rb Zousar.Shaker
#rnx

[CL 17308400 by Devin Doucette in ue5-main branch]
2021-08-25 16:07:50 -04:00
Devin Doucette
3962c6493a DDC: Added request barriers to the build job constructors
The barriers are needed to handle re-entrant AdvanceToState calls within the constructor of jobs with Blocking priority.

#rb Zousar.Shaker
#rnx

[CL 17302241 by Devin Doucette in ue5-main branch]
2021-08-25 10:14:58 -04:00
Devin Doucette
ef978526fa DDC: Fixed build callback status when the policy allows querying the cache but not building
#rb Zousar.Shaker
#rnx

[CL 17291662 by Devin Doucette in ue5-main branch]
2021-08-24 15:24:58 -04:00
Devin Doucette
a613d7f360 DDC: Reverted the exclusion of DDCUtils from non-editor targets
#jira UE-120421
#jira UE-121792
#rb Zousar.Shaker
#rnx

[CL 17253977 by Devin Doucette in ue5-main branch]
2021-08-20 17:17:46 -04:00