Commit Graph

740 Commits

Author SHA1 Message Date
devin doucette
695762674e DDC: Reverted the change to FCacheStoreAsync::LegacyStats() because it breaks assumptions in reporting of cook stats
#rb none
#rnx

[CL 25717089 by devin doucette in ue5-main branch]
2023-05-31 18:40:14 -04:00
devin doucette
6fff9c0396 DDC: Started toward exposing the cache store owner to the cache stores and flattening the hierarchy
- Construct an empty hierarchy first and populate it as the graph is parsed.
- Record the need for async and verify nodes, and create them only at the end.
- Extract parsing of debug options including throttling into the cache store owner.
- Expose the cache store owner to the cache store parsing/creation functions.
- Remove the unused speed class debug option.

#preflight 64777c254b0d5a1eb157ac8b
#rb Joe.Pribele
#rnx

[CL 25713242 by devin doucette in ue5-main branch]
2023-05-31 16:32:05 -04:00
kirill zorin
b6ee3a6c64 Fix UE_LOG callsites that have format string-related UB
#rb trivial
#preflight 647107780a6634dbb236a0a6

[CL 25651638 by kirill zorin in ue5-main branch]
2023-05-26 15:52:39 -04:00
zousar shaker
b7989e78f3 Fix crash when using -ddc=Cold on projects using ZenServer as Local DDC and Multi-Process Cook simultaneously.
#rb devin.doucette

[CL 25649292 by zousar shaker in ue5-main branch]
2023-05-26 13:52:11 -04:00
dan engelbrecht
97a2f5064b Don't continue initialization of ZenCacheStore of backend is deemed unusable (unable to connect)
#rb per.larsson
#preflight 646cb0a22e78be9841ff6463

[CL 25580746 by dan engelbrecht in ue5-main branch]
2023-05-23 08:45:48 -04:00
devin doucette
0190309348 DDC: Removed an erroneous check from the file system cache store
#rb none
#rnx

[CL 25529485 by devin doucette in ue5-main branch]
2023-05-18 13:52:53 -04:00
devin doucette
defbfeb737 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25495944 by devin doucette in ue5-main branch]
2023-05-16 16:00:11 -04:00
zousar shaker
56c35e9b4b [Backout] - CL25480019
[FYI] Devin.Doucette
Original CL Desc
-----------------------------------------------------------------
DDC: Moved file system cache store configuration into the file system cache store

#rb Zousar.Shaker
#rnx

[CL 25482846 by zousar shaker in ue5-main branch]
2023-05-15 19:35:44 -04:00
devin doucette
5da0a6ca50 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25482693 by devin doucette in ue5-main branch]
2023-05-15 19:29:13 -04:00
dan engelbrecht
9388d8e1bd Check status code for responses received from zenserver DDC requests.
#rb stefan.boberg
#preflight 645a3339013f3751584a39ed

[CL 25385641 by dan engelbrecht in ue5-main branch]
2023-05-09 08:08:07 -04:00
joakim lindqvist
54660ae511 Added ability to override the http version used for the http cache using "UE-CloudDataCacheHttpVersion" env variable or "-CloudDataCacheHttpVersion" command line argument
#preflight 644b93ac09453df548007245
#rb zousar.shaker

[CL 25333909 by joakim lindqvist in ue5-main branch]
2023-05-04 09:31:50 -04:00
devin doucette
6448fc343a DDC: Added EnvOAuthSecretOverride parameter to HttpCacheStore
#rb none
[FYI] Zousar.Shaker

[CL 25323458 by devin doucette in ue5-main branch]
2023-05-03 15:37:06 -04:00
devin doucette
5c3f44df32 DDC: Removed logging of the OAuth secret from HttpCacheStore
#rb none
#rnx

[CL 25323451 by devin doucette in ue5-main branch]
2023-05-03 15:36:58 -04:00
devin doucette
7bcc3722c1 DDC: Fixed merging and filtering of partial records in the cache hierarchy
#rb Zousar.Shaker

[CL 25310446 by devin doucette in ue5-main branch]
2023-05-02 19:07:42 -04:00
devin doucette
8ff0cd05ca DDC: Added EHttpVersion to HttpClient
#rb Zousar.Shaker
#rnx

[CL 25184555 by devin doucette in ue5-main branch]
2023-04-25 13:54:42 -04:00
devin doucette
90200ff6d0 DDC: Fixes related to the use of OIDC functionality from DesktopPlatform
- Fixed a crash when HttpCacheStore is used without DesktopPlatform.
- Fixed GetOidcAccessToken and GetOidcTokenStatus failing for targets with no Intermediate directory.
- Added DesktopPlatform to DerivedDataTool to allow it to use HttpCacheStore with OIDC.

#rb Zousar.Shaker
[FYI] Dan.Engelbrecht

[CL 25072527 by devin doucette in ue5-main branch]
2023-04-17 15:23:51 -04:00
zousar shaker
3bd034edf7 Add commandline option to enable the "repair" mode for UE Cloud DDC client so that blobs that are missing get re-populated.
#rb devin.doucette

[CL 25027230 by zousar shaker in ue5-main branch]
2023-04-13 12:15:21 -04:00
zousar shaker
3d140963d1 When a deactivation latency limit is defined, make the initial speed test executed by filesystem DDC time limited so we don't spend an inordinate amount of time speed testing if we're just going to deactivate it due to high latency.
#rb devin.doucette

[CL 24831864 by zousar shaker in ue5-main branch]
2023-03-29 02:28:27 -04:00
zousar shaker
2a4b4cdaf5 Change Zen DDC cache store to allow:
- Local storage flag to be inferred by whether the service is run locally or set explicitly in config.
- Remote storage flag to be inferred by whether the service is NOT run locally or set explicitly in config.
- ReadOnly storage flag to be set explicitly in config (defaults to true).

#rb devin.doucette

[CL 24822351 by zousar shaker in ue5-main branch]
2023-03-28 13:43:50 -04:00
devin doucette
72f0249b95 Replaced uses of FLazyEvent with FManualResetEvent
#rb none
#rnx

[CL 24810985 by devin doucette in ue5-main branch]
2023-03-27 18:26:53 -04:00
devin doucette
085d8cd57b Changed complex uses of events to use FEventCount
#rb Zousar.Shaker
#rnx

[CL 24810984 by devin doucette in ue5-main branch]
2023-03-27 18:26:44 -04:00
mark lintott
071272eb3f Formatting Changes to Cook Profiling Telemetry for Grafana. Replaced "." with "_". Bumped SchemaVersion of Cook Telemetry to 2.
Format changes will not have any impact on existing telemetry or analytics dashboards
#rb trivial
[FYI] devin.doucette, zousar.shaker
#preflight 64218253973e6096708e6714

[CL 24802042 by mark lintott in ue5-main branch]
2023-03-27 09:49:14 -04:00
devin doucette
9b540c4c54 Reverted use of FManualResetEvent while investigating an issue
#jira UE-181229
#rb none
#rnx

[CL 24781860 by devin doucette in ue5-main branch]
2023-03-24 12:55:38 -04:00
bob tellez
c248e6e469 [Backout] - CLs 24735827, 24746530, 24750104, 24751543, 24752787, 24753773
[FYI] Devin.Doucette
Original CL Desc
-----------------------------------------------------------------
Added PlatformManualResetEvent

This private abstraction is used to signal a single waiting thread to wake.
This first implementation is only specialized for Microsoft platforms. Other platforms will be specialized later.

#preflight 6418bc6a5d3e25354f1a2a5b
#rb Andriy.Tylychko, Zousar.Shaker

[CL 24773885 by bob tellez in ue5-main branch]
2023-03-23 23:28:45 -04:00
zousar shaker
90749b3b1a DDC: Restored the use of ManualResetEvent by HttpClient
#rb Zousar.Shaker
#rnx

[CL 24771744 by zousar shaker in ue5-main branch]
2023-03-23 20:59:56 -04:00