Commit Graph

43 Commits

Author SHA1 Message Date
devin doucette
0d7d858915 DDC: Added explicit configuration of the file system cache as local or remote
Windows has a fallback to detect a remote cache.

#rb Zousar.Shaker

[CL 34174205 by devin doucette in ue5-main branch]
2024-06-06 16:48:18 -04:00
marc audy
19e84555b3 Silence PVS warnings
[CL 30653812 by marc audy in ue5-main branch]
2024-01-17 01:34:02 -05:00
dan engelbrecht
b30f7932e4 If we find an active parsed note in the ddc graph when creating it, return it instead of returning nullptr.
The main cooker process sets up the environment variable UE-ZenSharedDataCacheHost as part of it's initialization so the ZenShared instance is created by the worker processes when they initialize before the redirection for the file share is detected.

In the main cooker process that env-variable is not set so it skips creating the ZenShared instance until it finds the redirection.

Renamed ICacheStoreGraph::Create -> ICacheStoreGraph::FindOrCreate to better reflect the functionality.

#rb Devin.Doucette, Zousar.Shaker

[CL 30248058 by dan engelbrecht in ue5-main branch]
2023-12-11 15:52:04 -05:00
marc audy
763a611985 Fix C4072 warnings
#rnx

[CL 29852844 by marc audy in ue5-main branch]
2023-11-20 17:26:53 -05:00
zousar shaker
e0fba69c4e Fix a mis-named variable (name change only).
[CL 29421133 by zousar shaker in ue5-main branch]
2023-11-03 16:50:18 -04:00
zousar shaker
5a3feaca1a Add mechanism to redirect filesystem cache stores to other cache store entries in the graph.
#rb devin.doucette

[CL 29093197 by zousar shaker in ue5-main branch]
2023-10-25 12:54:23 -04:00
zousar shaker
0ba09b3e1f Remove erroneous text from filesystem cache store speed test logs. The logic for whether the file store gets used or not is more subtle than implied by the log text.
#rb none
[FYI] devin.doucette
[FYI] dan.thompson

[CL 28467641 by zousar shaker in ue5-main branch]
2023-10-04 14:38:53 -04:00
devin doucette
402d04cde9 DDC: Added request name to FCacheStoreRequestStats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26210120 by devin doucette in ue5-main branch]
2023-06-23 10:51:52 -04:00
devin doucette
788aec3845 DDC: Disable stats for cache stores that should not be visible
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26192921 by devin doucette in ue5-main branch]
2023-06-22 16:35:48 -04:00
devin doucette
3897ae4e92 DDC: Added ICacheStoreStats to the memory cache and cleaned up graph node lifetime
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25870464 by devin doucette in ue5-main branch]
2023-06-08 10:07:21 -04:00
devin doucette
5229f46947 DDC: Added ICacheStoreStats and related functionality for cache stores to report stats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25843613 by devin doucette in ue5-main branch]
2023-06-07 09:47:55 -04:00
devin doucette
0190309348 DDC: Removed an erroneous check from the file system cache store
#rb none
#rnx

[CL 25529485 by devin doucette in ue5-main branch]
2023-05-18 13:52:53 -04:00
devin doucette
defbfeb737 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25495944 by devin doucette in ue5-main branch]
2023-05-16 16:00:11 -04:00
zousar shaker
56c35e9b4b [Backout] - CL25480019
[FYI] Devin.Doucette
Original CL Desc
-----------------------------------------------------------------
DDC: Moved file system cache store configuration into the file system cache store

#rb Zousar.Shaker
#rnx

[CL 25482846 by zousar shaker in ue5-main branch]
2023-05-15 19:35:44 -04:00
devin doucette
5da0a6ca50 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25482693 by devin doucette in ue5-main branch]
2023-05-15 19:29:13 -04:00
zousar shaker
3d140963d1 When a deactivation latency limit is defined, make the initial speed test executed by filesystem DDC time limited so we don't spend an inordinate amount of time speed testing if we're just going to deactivate it due to high latency.
#rb devin.doucette

[CL 24831864 by zousar shaker in ue5-main branch]
2023-03-29 02:28:27 -04:00
devin doucette
72f0249b95 Replaced uses of FLazyEvent with FManualResetEvent
#rb none
#rnx

[CL 24810985 by devin doucette in ue5-main branch]
2023-03-27 18:26:53 -04:00
devin doucette
f52cece901 Reverted the conversion of FLazyEvent to FManualResetEvent while investigating an issue
#rb none
#rnx

[CL 24763649 by devin doucette in ue5-main branch]
2023-03-23 12:35:09 -04:00
devin doucette
18dfce3eca Added FManualResetEvent
This is a one-byte manual-reset event that can replace that use case for the experimental FLazyEvent.

#rb Zousar.Shaker

[CL 24756514 by devin doucette in ue5-main branch]
2023-03-22 19:47:06 -04:00
devin doucette
672818b928 StringBuilder: Converted WriteToString from a type to a function
This was not possible on C++14 and is possible now due to guaranteed copy elision in C++17.
This will break backward compatibility when WriteToString was used as a type or in a context where it would be copied.

#preflight 640a0460af3fc3529234c216
#rb Matt.Peters

[CL 24583299 by devin doucette in ue5-main branch]
2023-03-09 17:06:55 -05:00
danny couture
74782129ec Fix race in FCounters used in FileSystemCacheStore and AsyncLoading
#rnx
#rb Devin.Doucette
#preflight 63d1d57e6a14d8406d8fc7d4

[CL 23863764 by danny couture in ue5-main branch]
2023-01-25 21:07:51 -05:00
zousar shaker
d1afea0f1f Allow ReadOnly mode for a DDC FileSystemCacheStore to have maintenance performed if Clean=true or DeleteUnused=true. When ReadOnly, they are now both false by default, but usable if explicitly set to true. When not ReadOnly, DeleteUnused remains true by default.
#rb devin.doucette

[CL 23592522 by zousar shaker in ue5-main branch]
2023-01-05 16:11:30 -05:00
Devin Doucette
7962247e4e DDC: Added a DeleteOnly mode to FileSystemCacheStore
This allows a cache to be kept in the hierarchy solely to ensure that it is cleaned up as its contents expire. Maintenance has been improved to delete more empty folders and to count every scanned folder.

#preflight 6363370154471d10be395619
#rb Zousar.Shaker

[CL 22953493 by Devin Doucette in ue5-main branch]
2022-11-03 11:01:04 -04:00
zousar shaker
11736e9e50 If multiple active FileSystemCacheStores in DDC are configured to have the same path, ignore all but the first one to become active.
#rb devin.doucette

[CL 22660595 by zousar shaker in ue5-main branch]
2022-10-20 12:54:34 -04:00
devin doucette
6c0954fb0d DDC: Added to the summary when file system cache store maintenance completes
#rb Zousar.Shaker
#rnx

[CL 22105271 by devin doucette in ue5-main branch]
2022-09-20 19:32:44 -04:00