148 Commits

Author SHA1 Message Date
devin doucette
bc2186b361 DDC: Added -DDC-ForceMemoryCache to allow the editor to boot when the cache is misconfigured
#jira UE-217488
#rb Zousar.Shaker

[CL 35747231 by devin doucette in ue5-main branch]
2024-08-22 13:35:41 -04:00
devin doucette
c7cee256ca DDC: Added a fatal error if the cache is not readable or writable
#rb Zousar.Shaker

[CL 30294521 by devin doucette in ue5-main branch]
2023-12-13 11:07:59 -05:00
dan engelbrecht
b30f7932e4 If we find an active parsed note in the ddc graph when creating it, return it instead of returning nullptr.
The main cooker process sets up the environment variable UE-ZenSharedDataCacheHost as part of it's initialization so the ZenShared instance is created by the worker processes when they initialize before the redirection for the file share is detected.

In the main cooker process that env-variable is not set so it skips creating the ZenShared instance until it finds the redirection.

Renamed ICacheStoreGraph::Create -> ICacheStoreGraph::FindOrCreate to better reflect the functionality.

#rb Devin.Doucette, Zousar.Shaker

[CL 30248058 by dan engelbrecht in ue5-main branch]
2023-12-11 15:52:04 -05:00
zousar shaker
5a3feaca1a Add mechanism to redirect filesystem cache stores to other cache store entries in the graph.
#rb devin.doucette

[CL 29093197 by zousar shaker in ue5-main branch]
2023-10-25 12:54:23 -04:00
devin doucette
814720d7fd DDC: Fixed a crash when a boot cache is present
#jira UE-197936
#rb Tim.Smith

[CL 28759412 by devin doucette in ue5-main branch]
2023-10-13 13:26:35 -04:00
devin doucette
ce32414b30 DDC: Disabled propagation of gets from the cache of in-flight puts and added support for write-only cache stores
- Do not invoke the put completion callback from the hierarchy until a put to a readable node succeeds, which is now tracked by bFinished.
- Use StopGetStore on the in-flight put cache to stop gets from that cache from propagating as duplicate puts.
- Disable the in-flight put cache for async wrappers used by propagation of gets.

#jira UE-192655
#rb Zousar.Shaker

[CL 27771618 by devin doucette in ue5-main branch]
2023-09-11 17:24:27 -04:00
devin doucette
24924bde18 DDC: Fixed creation of stats when using a throttle node
#rb Zousar.Shaker

[CL 27321110 by devin doucette in ue5-main branch]
2023-08-23 17:16:33 -04:00
kirill zorin
66c882e375 Fix instances of incorrect usage of UE_LOG.
#rb trivial

[CL 27306121 by kirill zorin in ue5-main branch]
2023-08-23 11:04:15 -04:00
devin doucette
1da80becdf DDC: Fixed -DDC-Verify being ignored if there is no verify node in the graph
#jira UE-193488
#rb Zousar.Shaker
#rnx

[CL 27257444 by devin doucette in ue5-main branch]
2023-08-21 19:00:46 -04:00
devin doucette
3df0bf7f14 DDC: Gather bucket stats from the new ICacheStats
#jira UE-133395
#rb Matt.Peters
#rnx

[CL 26555188 by devin doucette in ue5-main branch]
2023-07-24 16:52:05 -04:00
devin doucette
788aec3845 DDC: Disable stats for cache stores that should not be visible
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26192921 by devin doucette in ue5-main branch]
2023-06-22 16:35:48 -04:00
devin doucette
23c14b391a DDC: Added ICacheStoreStats to S3
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26158531 by devin doucette in ue5-main branch]
2023-06-21 15:23:06 -04:00
devin doucette
c4e4dfad44 DDC: Prepared the Jupiter cache for ICacheStoreStats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26154477 by devin doucette in ue5-main branch]
2023-06-21 13:32:34 -04:00
devin doucette
f8198f77f0 DDC: Fixed the in-flight memory cache to be read-only
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26150641 by devin doucette in ue5-main branch]
2023-06-21 11:24:03 -04:00
devin doucette
d3b72ca4be DDC: Added ICacheStoreStats to the Zen cache
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25964028 by devin doucette in ue5-main branch]
2023-06-13 17:14:59 -04:00
devin doucette
be4f2696da DDC: Added ICacheStoreStats to the pak file cache and added physical size to memory cache stats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25897379 by devin doucette in ue5-main branch]
2023-06-09 12:50:57 -04:00
devin doucette
27cdd0bc2a DDC: Fixed the tests of the cache hierarchy
#rb Zousar.Shaker
#rnx

[CL 25871631 by devin doucette in ue5-main branch]
2023-06-08 10:50:44 -04:00
devin doucette
3897ae4e92 DDC: Added ICacheStoreStats to the memory cache and cleaned up graph node lifetime
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25870464 by devin doucette in ue5-main branch]
2023-06-08 10:07:21 -04:00
devin doucette
5229f46947 DDC: Added ICacheStoreStats and related functionality for cache stores to report stats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25843613 by devin doucette in ue5-main branch]
2023-06-07 09:47:55 -04:00
devin doucette
6fff9c0396 DDC: Started toward exposing the cache store owner to the cache stores and flattening the hierarchy
- Construct an empty hierarchy first and populate it as the graph is parsed.
- Record the need for async and verify nodes, and create them only at the end.
- Extract parsing of debug options including throttling into the cache store owner.
- Expose the cache store owner to the cache store parsing/creation functions.
- Remove the unused speed class debug option.

#preflight 64777c254b0d5a1eb157ac8b
#rb Joe.Pribele
#rnx

[CL 25713242 by devin doucette in ue5-main branch]
2023-05-31 16:32:05 -04:00
devin doucette
defbfeb737 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25495944 by devin doucette in ue5-main branch]
2023-05-16 16:00:11 -04:00
zousar shaker
56c35e9b4b [Backout] - CL25480019
[FYI] Devin.Doucette
Original CL Desc
-----------------------------------------------------------------
DDC: Moved file system cache store configuration into the file system cache store

#rb Zousar.Shaker
#rnx

[CL 25482846 by zousar shaker in ue5-main branch]
2023-05-15 19:35:44 -04:00
devin doucette
5da0a6ca50 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25482693 by devin doucette in ue5-main branch]
2023-05-15 19:29:13 -04:00
Devin Doucette
d081f5a477 DDC: Fixed the file system cache EditorOverrideSetting not handling paths with \ in them
#jira none
#preflight 63b78d3ad862fdd347ea642b
#rb Zousar.Shaker

[CL 23595626 by Devin Doucette in ue5-main branch]
2023-01-05 22:10:29 -05:00
Devin Doucette
7962247e4e DDC: Added a DeleteOnly mode to FileSystemCacheStore
This allows a cache to be kept in the hierarchy solely to ensure that it is cleaned up as its contents expire. Maintenance has been improved to delete more empty folders and to count every scanned folder.

#preflight 6363370154471d10be395619
#rb Zousar.Shaker

[CL 22953493 by Devin Doucette in ue5-main branch]
2022-11-03 11:01:04 -04:00