Commit Graph

158 Commits

Author SHA1 Message Date
robert rouhani
ca717406de [DDC] Change FDerivedDataCache::GetAsynchronous priority from Blocking to Normal to avoid long hitches in GameThread
#tests Editor, PIE
#rnx
#rb Devin.Doucette

[CL 35193177 by robert rouhani in ue5-main branch]
2024-07-30 15:00:02 -04:00
devin doucette
67a1ffc6fa DDC: Added a missing request barrier
#rnx

[CL 33800167 by devin doucette in ue5-main branch]
2024-05-21 13:04:36 -04:00
devin doucette
6fccd4be26 DDC: Eliminated blocking tasks used by the legacy cache API
#rb Zousar.Shaker

[CL 33794360 by devin doucette in ue5-main branch]
2024-05-21 10:20:40 -04:00
mark lintott
d571e68c92 Latest updates to Editor Performance tool
Added Virtual Assets Efficiency KPI
Added Stall Rate KPI
Added failure count for KPIs and added this to the UI
Insights Snapshots will generate multiple captures for each failure within the session upto a a maximum of 10 per session
Insights capture and Telemetry event generation movede from StatusBar to EditorPerformanceModule
Fixed issue where Editor Load Map tiem was incorrect when booting without a Map
Split Hitch and Stall rate KPIs bewteen Editor and PIE scopes
Added LocalGetMisses to DDC cache statistics
Turned off notifications by default, users should opt-in

[CL 33654736 by mark lintott in ue5-main branch]
2024-05-15 07:52:22 -04:00
devin doucette
bc29cf55d0 DDC: Fixed a race in the legacy CachedDataProbablyExistsBatch
#rb Matt.Peters

[CL 33521157 by devin doucette in ue5-main branch]
2024-05-08 14:27:40 -04:00
steve robb
bc28537104 Fixed some Printf specifiers.
#rb brandon.schaefer

[CL 33211124 by steve robb in ue5-main branch]
2024-04-24 15:59:50 -04:00
mark lintott
0026ca99de Fixes for Studio Telemetry
Fixed Local DDC stats so they correctly count Zen Local DDC as a Local DDC if a file based Local DDC is not present
Added explicit AssetRegistryScan Start/Stop callbacks and removed the less reliable sample based method.
Added AssetRegistryScan as a KPI for the Editor Performance UI
[FYI] matt.breindel, Devin.Doucette

[CL 32471256 by mark lintott in ue5-main branch]
2024-03-25 11:32:11 -04:00
zousar shaker
a5d833e390 Add EQueuedWorkFlags::DoNotRunInsideBusyWait to tasks started by DDC so that as long running tasks, they don't get picked up by arbitrary busy waits.
#rb Devin.Doucette

[CL 30043718 by zousar shaker in ue5-main branch]
2023-12-01 11:56:56 -05:00
mark lintott
b99d530ce0 Moved EpicStudioAnalytics plugin to StudioTelemetry which is now public facing.
The intention is to provide a set of "in the box" telemetry hooks to our most common developer workflows for use internal Epic use and licensees
Moved startup of StudioTelemetry plugin much earlier to PostConfigInit stage so that sessions can start much earlier in the workflow
Added WIP Client support to telemetry plugin
Added data driven provider support for FAnlayiticProvidersET interfaces via BaseEngine.ini for common games and sample projects. Settings and URLs for EPic are only avaliable in Resttricted/NotForLicensee config folders for Lyra and Shooter game.
Added support for Horde telemetry and fixed up various problems with duplicate attributes being sent.
Added Core.VirtualAssets telemetry event
Added Core.Zen telemetry event
Added Core.IAS telemetry event
Added check for IOStoreOnDemand IsEnabled to avoid sending empty IAS events
Added FAnalyticsMulticastProvider to forward telemetry events to multiple providers contained within
Removed deprecated Fire_LoadingEvent from StudioAnalytics
[FYI] paul.chipchase
#rb Wes.Hunt

[CL 29908039 by mark lintott in ue5-main branch]
2023-11-23 07:06:10 -05:00
devin doucette
3df0bf7f14 DDC: Gather bucket stats from the new ICacheStats
#jira UE-133395
#rb Matt.Peters
#rnx

[CL 26555188 by devin doucette in ue5-main branch]
2023-07-24 16:52:05 -04:00
mark lintott
071272eb3f Formatting Changes to Cook Profiling Telemetry for Grafana. Replaced "." with "_". Bumped SchemaVersion of Cook Telemetry to 2.
Format changes will not have any impact on existing telemetry or analytics dashboards
#rb trivial
[FYI] devin.doucette, zousar.shaker
#preflight 64218253973e6096708e6714

[CL 24802042 by mark lintott in ue5-main branch]
2023-03-27 09:49:14 -04:00
mark lintott
ad70d0d087 Fix up of Event Attribute names to support Grafana in StudioAnalytics, DerivedData, Zen, Virtualization and CookProfiling. Grafana does not like the . separator so these have been replaced by _. I have checked this with the DPE team ( and verified ) this is still compatible with Snowflake/Tableau telemetry and such will not requires any changes to Snowflake or exisitng Tableau dashboards.
[FYI] wes.hunt, eric.knapik, paul.chipchase, devin.doucette
#rb devin.doucette
#preflight 641c6e31c44ce895fc452a84

[CL 24764989 by mark lintott in ue5-main branch]
2023-03-23 13:43:00 -04:00
devin doucette
18dfce3eca Added FManualResetEvent
This is a one-byte manual-reset event that can replace that use case for the experimental FLazyEvent.

#rb Zousar.Shaker

[CL 24756514 by devin doucette in ue5-main branch]
2023-03-22 19:47:06 -04:00
devin doucette
592c55ccc8 DDC: Removed deprecated code
#preflight 6410d4770e1f02786b69ac5a
#rb Zousar.Shaker
#rnx

[CL 24654027 by devin doucette in ue5-main branch]
2023-03-15 10:15:30 -04:00
mark lintott
fe1ee99e15 Fix for DDC and Cook analytics event attributes not being transmitted as numbers to the backend. This allows us to correctly aggregate DDC/Cook values in Grafana.
[FYI] Devin.Doucette, Garry.Casey, Erik.Knapik
#rb trivial
#preflight 63fdf46fef1b24bf940111c1

[CL 24446536 by mark lintott in ue5-main branch]
2023-02-28 13:24:40 -05:00
devin doucette
d802756cf3 DDC: Added logging if legacy requests fail to copy the buffer
Includes a speculative workaround for check(Data.Num()) failing.

#rb Matt.Peters
#rnx

[CL 24412735 by devin doucette in ue5-main branch]
2023-02-24 19:01:05 -05:00
devin doucette
ee3c2bc2fd DDC: Initialized bGetResult in case the callback is somehow missed
#rb none

[CL 24408000 by devin doucette in ue5-main branch]
2023-02-24 15:48:03 -05:00
mark lintott
7126d3c2ed Split up the DDC cache analytics per back end so we can more easily reason about specific abck end perf
#rb zousar.shaker, devin.doucette
#preflight 63da8e557a39a18021722350

[CL 23984212 by mark lintott in ue5-main branch]
2023-02-02 18:47:48 -05:00
mark lintott
72bf7a2d8c Fixed the Cloud, Local and Shared Percentages that exceed 100% when more than one backend is used. These were flawed, Root Get/Hit count cannot be used for the percentages for each backend in this way.
#rb devin.doucette
 #preflight 63c93722ac35a0e9da754473

[CL 23773901 by mark lintott in ue5-main branch]
2023-01-19 10:45:32 -05:00
mark lintott
8bad2c0365 Removed the callback system from core Analytics system. Fixed up analytics gathering in DerivedDataCache, Virtualization and HttpCacheStore
#rb wes.hunt
#preflight 63be95bd68068a8bd6a4438e

[CL 23651011 by mark lintott in ue5-main branch]
2023-01-11 14:28:01 -05:00
matt peters
71802fb86c Analytics: Backed out 22909100 and 22951911
#rnx

[CL 23583550 by matt peters in ue5-main branch]
2023-01-04 18:51:41 -05:00
Zousar Shaker
b9548ddad4 Move Zen module public headers into an "Experimental" subfolder to have them reflect the feature status.
Fix locations that include the headers to use the "Experimental" subfolder and re-sort includes.  No functional change, purely a move, search+replace, and sort of includes.

#rb matt.peters
#preflight 63939eebc415e8dc78d35d63

[CL 23468934 by Zousar Shaker in ue5-main branch]
2022-12-09 16:11:41 -05:00
Devin Doucette
110afa128b DDC: Added new build scheduler modular features to queue by type and reserve memory
#preflight 638128f3cc307d6fa5b4ee80
#rb Zousar.Shaker

[CL 23271781 by Devin Doucette in ue5-main branch]
2022-11-25 21:38:59 -05:00
Devin Doucette
e2483014be DDC: Added LaunchTaskInThreadPool as a replacement for the two existing thread pool task requests
#preflight 6380f7c4170bc34a93b9104b
#rb Zousar.Shaker

[CL 23267593 by Devin Doucette in ue5-main branch]
2022-11-25 12:35:29 -05:00
Devin Doucette
f1d54c3a16 DDC: Sorted and removed duplicate includes in DerivedDataCache.cpp
#preflight 63627f0254471d10bef32ed7
#rb none
#rnx

[CL 22918352 by Devin Doucette in ue5-main branch]
2022-11-02 11:58:13 -04:00