Commit Graph

803 Commits

Author SHA1 Message Date
devin doucette
be4f2696da DDC: Added ICacheStoreStats to the pak file cache and added physical size to memory cache stats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25897379 by devin doucette in ue5-main branch]
2023-06-09 12:50:57 -04:00
devin doucette
27cdd0bc2a DDC: Fixed the tests of the cache hierarchy
#rb Zousar.Shaker
#rnx

[CL 25871631 by devin doucette in ue5-main branch]
2023-06-08 10:50:44 -04:00
devin doucette
3897ae4e92 DDC: Added ICacheStoreStats to the memory cache and cleaned up graph node lifetime
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25870464 by devin doucette in ue5-main branch]
2023-06-08 10:07:21 -04:00
devin doucette
5229f46947 DDC: Added ICacheStoreStats and related functionality for cache stores to report stats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 25843613 by devin doucette in ue5-main branch]
2023-06-07 09:47:55 -04:00
devin doucette
695762674e DDC: Reverted the change to FCacheStoreAsync::LegacyStats() because it breaks assumptions in reporting of cook stats
#rb none
#rnx

[CL 25717089 by devin doucette in ue5-main branch]
2023-05-31 18:40:14 -04:00
devin doucette
6fff9c0396 DDC: Started toward exposing the cache store owner to the cache stores and flattening the hierarchy
- Construct an empty hierarchy first and populate it as the graph is parsed.
- Record the need for async and verify nodes, and create them only at the end.
- Extract parsing of debug options including throttling into the cache store owner.
- Expose the cache store owner to the cache store parsing/creation functions.
- Remove the unused speed class debug option.

#preflight 64777c254b0d5a1eb157ac8b
#rb Joe.Pribele
#rnx

[CL 25713242 by devin doucette in ue5-main branch]
2023-05-31 16:32:05 -04:00
kirill zorin
b6ee3a6c64 Fix UE_LOG callsites that have format string-related UB
#rb trivial
#preflight 647107780a6634dbb236a0a6

[CL 25651638 by kirill zorin in ue5-main branch]
2023-05-26 15:52:39 -04:00
zousar shaker
b7989e78f3 Fix crash when using -ddc=Cold on projects using ZenServer as Local DDC and Multi-Process Cook simultaneously.
#rb devin.doucette

[CL 25649292 by zousar shaker in ue5-main branch]
2023-05-26 13:52:11 -04:00
dan engelbrecht
97a2f5064b Don't continue initialization of ZenCacheStore of backend is deemed unusable (unable to connect)
#rb per.larsson
#preflight 646cb0a22e78be9841ff6463

[CL 25580746 by dan engelbrecht in ue5-main branch]
2023-05-23 08:45:48 -04:00
devin doucette
0190309348 DDC: Removed an erroneous check from the file system cache store
#rb none
#rnx

[CL 25529485 by devin doucette in ue5-main branch]
2023-05-18 13:52:53 -04:00
devin doucette
defbfeb737 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25495944 by devin doucette in ue5-main branch]
2023-05-16 16:00:11 -04:00
zousar shaker
56c35e9b4b [Backout] - CL25480019
[FYI] Devin.Doucette
Original CL Desc
-----------------------------------------------------------------
DDC: Moved file system cache store configuration into the file system cache store

#rb Zousar.Shaker
#rnx

[CL 25482846 by zousar shaker in ue5-main branch]
2023-05-15 19:35:44 -04:00
devin doucette
5da0a6ca50 DDC: Moved file system cache store configuration into the file system cache store
#rb Zousar.Shaker
#rnx

[CL 25482693 by devin doucette in ue5-main branch]
2023-05-15 19:29:13 -04:00
bryan sefcik
91c57d395e Removed redundant module includes.
#preflight 645d4bf3aa3c584c0b5b3a67

[CL 25435653 by bryan sefcik in ue5-main branch]
2023-05-11 16:48:21 -04:00
dan engelbrecht
9388d8e1bd Check status code for responses received from zenserver DDC requests.
#rb stefan.boberg
#preflight 645a3339013f3751584a39ed

[CL 25385641 by dan engelbrecht in ue5-main branch]
2023-05-09 08:08:07 -04:00
joakim lindqvist
54660ae511 Added ability to override the http version used for the http cache using "UE-CloudDataCacheHttpVersion" env variable or "-CloudDataCacheHttpVersion" command line argument
#preflight 644b93ac09453df548007245
#rb zousar.shaker

[CL 25333909 by joakim lindqvist in ue5-main branch]
2023-05-04 09:31:50 -04:00
devin doucette
6448fc343a DDC: Added EnvOAuthSecretOverride parameter to HttpCacheStore
#rb none
[FYI] Zousar.Shaker

[CL 25323458 by devin doucette in ue5-main branch]
2023-05-03 15:37:06 -04:00
devin doucette
5c3f44df32 DDC: Removed logging of the OAuth secret from HttpCacheStore
#rb none
#rnx

[CL 25323451 by devin doucette in ue5-main branch]
2023-05-03 15:36:58 -04:00
devin doucette
7bcc3722c1 DDC: Fixed merging and filtering of partial records in the cache hierarchy
#rb Zousar.Shaker

[CL 25310446 by devin doucette in ue5-main branch]
2023-05-02 19:07:42 -04:00
devin doucette
8ff0cd05ca DDC: Added EHttpVersion to HttpClient
#rb Zousar.Shaker
#rnx

[CL 25184555 by devin doucette in ue5-main branch]
2023-04-25 13:54:42 -04:00
mark lintott
e63c334048 EpicStudioAnalytics plugin rewrite
High Level Vision:
https://docs.google.com/document/d/13R4nJ2UNMJZlf6JCjYssFMSY-5CrURazE4tqxW77yBw/edit#heading=h.bpycydduomgi

Details of changes:
Removed "most" references to FStudioAnalytics from Engine code.
Deprecated use of FStudioAnalytics::FireEvent_Loading(), will deprecate FStudioAnalytics in due course.
Added FAnalyticsFlowTracker to the engine code base based on the flow system used in UEFN.
Added explicit DDC Resource and DDC Summary events to track DDC usage by resource type.
Moved common Editor analytics callbacks into EpicStudioAnalytics plugin
Added a variety of delegates to the engine code to so that analytics capture can be defined in the plugin code or within the game code instead of the engine code ( eg. load map, editor initialization, cooking, slow task )
Added JSON serializer for analytics events to provide facility to capture analytics in restriced environments ( eg. UEFN CookWorker ). Though this fetaure is not enabled yet.
This will temporarily break Loading and Cooking analytics for Lyra, ShooterGame, CitySample but not Fortnite or UEFN. The remainder will need to be "fixed up" in UE5/Main once the changes have propogated (stakeholders have been notified)

[FYI] zousar.shaker, devin.doucette, eric.knapik, francis.hurteau
#rb wes.hunt
#preflight 643e45150a5a4b944e603be8

[CL 25083739 by mark lintott in ue5-main branch]
2023-04-18 07:16:36 -04:00
devin doucette
90200ff6d0 DDC: Fixes related to the use of OIDC functionality from DesktopPlatform
- Fixed a crash when HttpCacheStore is used without DesktopPlatform.
- Fixed GetOidcAccessToken and GetOidcTokenStatus failing for targets with no Intermediate directory.
- Added DesktopPlatform to DerivedDataTool to allow it to use HttpCacheStore with OIDC.

#rb Zousar.Shaker
[FYI] Dan.Engelbrecht

[CL 25072527 by devin doucette in ue5-main branch]
2023-04-17 15:23:51 -04:00
zousar shaker
3bd034edf7 Add commandline option to enable the "repair" mode for UE Cloud DDC client so that blobs that are missing get re-populated.
#rb devin.doucette

[CL 25027230 by zousar shaker in ue5-main branch]
2023-04-13 12:15:21 -04:00
Devin Doucette
32c049c3f5 Removed some includes of Function.h in Core
#preflight 6435cf83127980724b0f16b9
#rnx

[CL 25006462 by Devin Doucette in ue5-main branch]
2023-04-12 10:05:50 -04:00
zousar shaker
3d140963d1 When a deactivation latency limit is defined, make the initial speed test executed by filesystem DDC time limited so we don't spend an inordinate amount of time speed testing if we're just going to deactivate it due to high latency.
#rb devin.doucette

[CL 24831864 by zousar shaker in ue5-main branch]
2023-03-29 02:28:27 -04:00