866 Commits

Author SHA1 Message Date
devin doucette
99545b03c0 DDC: Added FValueId::MakeIndexed to more easily support arrays of values
#rb Dan.Elksnitis, Matt.Peters

[CL 35881628 by devin doucette in ue5-main branch]
2024-08-28 17:35:13 -04:00
joakim lindqvist
52d3712f1a DDC - Added ability to override OAuthIdentifier for Cloud DDC layer with env variables or command line arguments
#rb Zousar.Shaker

[CL 35797453 by joakim lindqvist in ue5-main branch]
2024-08-26 09:54:55 -04:00
devin doucette
bc2186b361 DDC: Added -DDC-ForceMemoryCache to allow the editor to boot when the cache is misconfigured
#jira UE-217488
#rb Zousar.Shaker

[CL 35747231 by devin doucette in ue5-main branch]
2024-08-22 13:35:41 -04:00
robert rouhani
ca717406de [DDC] Change FDerivedDataCache::GetAsynchronous priority from Blocking to Normal to avoid long hitches in GameThread
#tests Editor, PIE
#rnx
#rb Devin.Doucette

[CL 35193177 by robert rouhani in ue5-main branch]
2024-07-30 15:00:02 -04:00
steve robb
a9436b8578 Fixed an unnecessary array copy in FCacheKeyFilter::Parse caused by incompatible allocators.
#rb devin.doucette

[CL 35091880 by steve robb in ue5-main branch]
2024-07-25 15:00:00 -04:00
devin doucette
ef41453691 DDC: Fixed cache policy merging for chunk requests in HttpCacheStore
#jira UE-218960
#rb Matt.Peters

[CL 34715315 by devin doucette in ue5-main branch]
2024-06-27 13:28:09 -04:00
devin doucette
01cb852a23 Deprecated the old names and paths for TSharedString
#rb Zousar.Shaker
#rnx

[CL 34567121 by devin doucette in ue5-main branch]
2024-06-21 12:52:32 -04:00
devin doucette
36f5a24ddd Moved TSharedString from DDC into Core
#rb Steve.Robb

[CL 34340152 by devin doucette in ue5-main branch]
2024-06-13 10:40:59 -04:00
dan engelbrecht
34b096a816 Revert prefix for custom UE custom http headers in DDC Http layer
[CL 34338409 by dan engelbrecht in ue5-main branch]
2024-06-13 09:36:25 -04:00
zousar shaker
f187081f6f Change UE custom http headers in DDC Http layer to use X- prefix. Print session identifier to the log from the Jupiter cache store. Add commandlet name to User-Agent header, and add IsBuildMachine as a separate Http header.
#rb Devin.Doucette

[CL 34299322 by zousar shaker in ue5-main branch]
2024-06-12 01:12:47 -04:00
devin doucette
0d7d858915 DDC: Added explicit configuration of the file system cache as local or remote
Windows has a fallback to detect a remote cache.

#rb Zousar.Shaker

[CL 34174205 by devin doucette in ue5-main branch]
2024-06-06 16:48:18 -04:00
charles bloom
5e932ff8b5 TextureBuildFunction : methodology to validate RequiredMemoryEstimate vs. actual mem use using standalone texture build workers and process memory counters
#rb Dan.Thompson

[CL 34109385 by charles bloom in ue5-main branch]
2024-06-04 18:12:55 -04:00
devin doucette
6f9e8a3995 DDC: Added detection and reporting of Cancel() and Wait() deadlocks in FRequestOwner
#rb Zousar.Shaker

[CL 33982474 by devin doucette in ue5-main branch]
2024-05-29 14:46:55 -04:00
devin doucette
31ec11b0f5 DDC: Eliminated most blocking during requests in ZenCacheStore
#rb Zousar.Shaker

[CL 33874002 by devin doucette in ue5-main branch]
2024-05-23 16:37:20 -04:00
devin doucette
24cd18db32 DDC: Extracted FHttpCacheStoreRequestQueue for reuse by Zen
#rb Zousar.Shaker
#rnx

[CL 33843384 by devin doucette in ue5-main branch]
2024-05-22 16:38:43 -04:00
devin doucette
67a1ffc6fa DDC: Added a missing request barrier
#rnx

[CL 33800167 by devin doucette in ue5-main branch]
2024-05-21 13:04:36 -04:00
devin doucette
6fccd4be26 DDC: Eliminated blocking tasks used by the legacy cache API
#rb Zousar.Shaker

[CL 33794360 by devin doucette in ue5-main branch]
2024-05-21 10:20:40 -04:00
mark lintott
d571e68c92 Latest updates to Editor Performance tool
Added Virtual Assets Efficiency KPI
Added Stall Rate KPI
Added failure count for KPIs and added this to the UI
Insights Snapshots will generate multiple captures for each failure within the session upto a a maximum of 10 per session
Insights capture and Telemetry event generation movede from StatusBar to EditorPerformanceModule
Fixed issue where Editor Load Map tiem was incorrect when booting without a Map
Split Hitch and Stall rate KPIs bewteen Editor and PIE scopes
Added LocalGetMisses to DDC cache statistics
Turned off notifications by default, users should opt-in

[CL 33654736 by mark lintott in ue5-main branch]
2024-05-15 07:52:22 -04:00
devin doucette
bc29cf55d0 DDC: Fixed a race in the legacy CachedDataProbablyExistsBatch
#rb Matt.Peters

[CL 33521157 by devin doucette in ue5-main branch]
2024-05-08 14:27:40 -04:00
steve robb
bc28537104 Fixed some Printf specifiers.
#rb brandon.schaefer

[CL 33211124 by steve robb in ue5-main branch]
2024-04-24 15:59:50 -04:00
dan engelbrecht
96aeb2545b Don't try to read the payload buffer as a package in FZenCacheStore::FCbPackageReceiver if the request failed or was cancelled
Add hardening to TryLoadCbPackage to handle incomplete messages

[CL 32929188 by dan engelbrecht in ue5-main branch]
2024-04-12 10:31:10 -04:00
zousar shaker
77d204ed2c Don't have the cook director close the worker socket before forcible worker process termination and detach because otherwise DetachFromRemoteProcess won't call OnMultiprocessWorkerDetached for the worker leading to issues like DerivedDataReplay emitting in error because a worker is not detached and it can't merge replay files. Also have the multi-process detach context inform the delegate of whether the detach was abnormal so that delegate methods can make context-appropriate choices about how to handle abnormal detach scenarios. The derived data replay mechanism will ignore replays from abnormally detached processes when doing replay merging and warn about the fact that the replay is incomplete.
#rb Devin.Doucette, Matt.Peters

[CL 32580894 by zousar shaker in ue5-main branch]
2024-03-28 12:16:40 -04:00
kevin macaulayvacher
6bddcafc06 Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.
#jira UE-206398
#rb Zousar.Shaker
[FYI] Francis.Hurteau

[CL 32519384 by kevin macaulayvacher in ue5-main branch]
2024-03-26 15:15:39 -04:00
zousar shaker
17460608a5 Add option to bypass proxies to the derived data http client (default is no bypass). Zen cache store client uses it and defaults to bypassing proxies (but can be overridden in INI). UE Cloud DDC client uses it and defaults to NOT bypassing proxies (but can be overridden in INI).
#rb Devin.Doucette
[FYI] dan.engelbrecht
[FYI] joakim.lindqvist
#jira UE-210567

[CL 32490735 by zousar shaker in ue5-main branch]
2024-03-25 18:59:10 -04:00
devin doucette
3c9df3b454 DDC: Eliminated most blocking during get requests in HttpCacheStore
#rb Zousar.Shaker

[CL 32475187 by devin doucette in ue5-main branch]
2024-03-25 13:28:43 -04:00