Commit Graph

51 Commits

Author SHA1 Message Date
zousar shaker
d4e2723732 Fix handling of cancelation in Zen DDC client to avoid having it treated as equivalent to an unexpected error.
#rb devin.doucette

[CL 27969813 by zousar shaker in ue5-main branch]
2023-09-18 15:22:34 -04:00
zousar shaker
8c75ff393b ZenDashboard refresh to add project stats and clean up reporting of disk size.
#rb dan.engelbrecht

[CL 27546624 by zousar shaker in ue5-main branch]
2023-08-31 22:30:53 -04:00
devin doucette
402d04cde9 DDC: Added request name to FCacheStoreRequestStats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26210120 by devin doucette in ue5-main branch]
2023-06-23 10:51:52 -04:00
zousar shaker
f92dc5c090 Fix a collection of bugs related to ZenServer launching:
- Fix a message that had the text and caption fields inverted.
- Ensure that sandbox instances don't overwrite the .runcontext file used by non-sandbox instances.
- Fix a bug where the Zen data path when following DDC path settings wasn't normalizing the path leading to needless shutdown and startup of zenserver.

#rb matt.peters

[CL 26205402 by zousar shaker in ue5-main branch]
2023-06-23 00:49:34 -04:00
dan engelbrecht
46b88104b8 Return error if we receive a partial record from zenserver
#rb devin.doucette
#prefligth 648a3d2f88385dd88cfdda4a

[CL 26006460 by dan engelbrecht in ue5-main branch]
2023-06-15 04:54:40 -04:00
dan engelbrecht
a46531dd35 Make sure record policy is set up correctly in batch requests to Zen
#rb devin.doucette

[CL 25982752 by dan engelbrecht in ue5-main branch]
2023-06-14 12:31:13 -04:00
devin doucette
ab371b64e2 DDC: Fixed leaking cache store stats in the Zen cache
#jira UE-133395
#rb none
#rnx

[CL 25977512 by devin doucette in ue5-main branch]
2023-06-14 10:12:47 -04:00
devin doucette
d3b72ca4be DDC: Added ICacheStoreStats to the Zen cache
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25964028 by devin doucette in ue5-main branch]
2023-06-13 17:14:59 -04:00
zousar shaker
b7989e78f3 Fix crash when using -ddc=Cold on projects using ZenServer as Local DDC and Multi-Process Cook simultaneously.
#rb devin.doucette

[CL 25649292 by zousar shaker in ue5-main branch]
2023-05-26 13:52:11 -04:00
dan engelbrecht
97a2f5064b Don't continue initialization of ZenCacheStore of backend is deemed unusable (unable to connect)
#rb per.larsson
#preflight 646cb0a22e78be9841ff6463

[CL 25580746 by dan engelbrecht in ue5-main branch]
2023-05-23 08:45:48 -04:00
dan engelbrecht
9388d8e1bd Check status code for responses received from zenserver DDC requests.
#rb stefan.boberg
#preflight 645a3339013f3751584a39ed

[CL 25385641 by dan engelbrecht in ue5-main branch]
2023-05-09 08:08:07 -04:00
devin doucette
8ff0cd05ca DDC: Added EHttpVersion to HttpClient
#rb Zousar.Shaker
#rnx

[CL 25184555 by devin doucette in ue5-main branch]
2023-04-25 13:54:42 -04:00
zousar shaker
2a4b4cdaf5 Change Zen DDC cache store to allow:
- Local storage flag to be inferred by whether the service is run locally or set explicitly in config.
- Remote storage flag to be inferred by whether the service is NOT run locally or set explicitly in config.
- ReadOnly storage flag to be set explicitly in config (defaults to true).

#rb devin.doucette

[CL 24822351 by zousar shaker in ue5-main branch]
2023-03-28 13:43:50 -04:00
dan engelbrecht
85b808b153 Accept duplicated file handles in Zen RPC responses
#preflight 641c11bf76461c460b8eabb4
#rb stefan.boberg per.larsson

[CL 24759274 by dan engelbrecht in ue5-main branch]
2023-03-23 05:15:22 -04:00
dan engelbrecht
e7c1e5fa6a Only report local stats for Zen DDC.
ZenCacheStore now only tracks what the client sees, regardless if the zenserver instance gets a hit from a configured upstream.
As we don't currently have any upstreams configured in the zen server instance this should give a more accurate number for hit/miss stats that matches the file cache.

#preflight 63eabb1bb96a6b2718326d15
#rb zousar.shaker devin.doucette

[CL 24206594 by dan engelbrecht in ue5-main branch]
2023-02-14 03:09:44 -05:00
zousar shaker
d52719ba40 Add support for a Zen cache store Host to be None (implying that it is disabled) and to have both commandline and environment overrides (similar to the HTTP cache store).
#rb devin.doucette

[CL 23815887 by zousar shaker in ue5-main branch]
2023-01-23 12:48:38 -05:00
zousar shaker
bfbf54d4ca ZenCacheStore - ignore "None" as an override value for a local DDC path when using sandboxes (in line with past behavior for non-default local caches like Warm/Cold).
#rb devin.doucette

[CL 23658565 by zousar shaker in ue5-main branch]
2023-01-11 20:57:13 -05:00
Zousar Shaker
624d3b7dbf Add support for Zen DDC sandboxes which are separate instances of zenserver with separate data paths and can be optionally flushed from run-to-run. It is used to implement Warm and Cold DDC graphs using Zen sandboxes for projects/platforms that use Zen for local DDC by default, and to provide new ZenColdDDC and ZenWarmDDC as new graphs that have Cold/Warm behavior for projects that don't use Zen for local DDC by default.
#rb devin.doucette
#preflight 63b493d5202bee5e27a645ed

[CL 23569648 by Zousar Shaker in ue5-main branch]
2023-01-03 15:58:30 -05:00
Zousar Shaker
e27b568f2e Add capability for things that depend on the Zen service to attempt to recover the service if there is an interruption. The Zen DDC cache store is using this to allow recovery and retry of a cache request that fails to connect or times out when communicating with a Zen service on the same machine.
#rb devin.doucette
#preflight 639cc26343330e63e5db1750

[CL 23541143 by Zousar Shaker in ue5-main branch]
2022-12-16 15:47:14 -05:00
Zousar Shaker
e7fb0b1751 Ensure that Zen as a local service can be configured to follow the same commandline overrides as a filesystem cache store. Also ensure that if the configured override mechanisms for cache store paths yield a path of "None" that we disable the Zen DDC cache. These are in support of using Zen as a drop-in replacement for an existing filesystem DDC store.
#rb devin.doucette
#preflight 6398ea4e680483bcb1057b0a

[CL 23517045 by Zousar Shaker in ue5-main branch]
2022-12-14 15:06:30 -05:00
Zousar Shaker
b9548ddad4 Move Zen module public headers into an "Experimental" subfolder to have them reflect the feature status.
Fix locations that include the headers to use the "Experimental" subfolder and re-sort includes.  No functional change, purely a move, search+replace, and sort of includes.

#rb matt.peters
#preflight 63939eebc415e8dc78d35d63

[CL 23468934 by Zousar Shaker in ue5-main branch]
2022-12-09 16:11:41 -05:00
dan engelbrecht
d81aef1e6c Allow support for receiving local file references for cache items
Companion PR in zen: https://github.com/EpicGames/zen/pull/184
#rb stefan.boberg
#preflight 6368ce57d0174259cc1e7b7a

[CL 23009037 by dan engelbrecht in ue5-main branch]
2022-11-07 05:33:21 -05:00
Zousar Shaker
8b31a778bf Update ShooterGame, QAGame, and Lyra to use Zen for LOCAL DDC only.
#rb devin.doucette
#preflight 63643f6d882365b8596ce430

[CL 22970016 by Zousar Shaker in ue5-main branch]
2022-11-03 18:48:54 -04:00
dan engelbrecht
b0b3345d11 Add "Accept" field in Zen RPC request to enable new style RPC responses.
See https://github.com/EpicGames/zen/pull/180 for Zen side change.
#rb stefan.boberg zousar.shaker
#preflight 6347c2568a0a7b2adcbe4d71

[CL 22505182 by dan engelbrecht in ue5-main branch]
2022-10-13 11:17:53 -04:00
dan engelbrecht
0f1143130a Use Http::TryLoadCbPackage as first option to parse packages from Zen.
This will allow UE to talk to both old and new zen servers as we move to use the new package wire format in Zen responses.
#rb devin.doucette
#preflight 6334bf81691c0168b71bc0a9

[CL 22233160 by dan engelbrecht in ue5-main branch]
2022-09-28 18:22:23 -04:00