izzy/UnrealEngineUWP
0
0
Fork 0
mirror of https://github.com/izzy2lost/UnrealEngineUWP.git synced 2026-03-26 18:15:20 -07:00
Code Issues Packages Projects Releases Wiki Activity
272,034 Commits 23 Branches 254 Tags
f3ef3e01acd183eefb864f2adcffe65fed783e3f
Commit Graph

868 Commits

Author SHA1 Message Date
zousar shaker
a5d833e390 Add EQueuedWorkFlags::DoNotRunInsideBusyWait to tasks started by DDC so that as long running tasks, they don't get picked up by arbitrary busy waits. 
#rb Devin.Doucette

[CL 30043718 by zousar shaker in ue5-main branch]
 2023-12-01 11:56:56 -05:00
zousar shaker
e1d9e1c096 Don't attempt immediate retry when a 502 error happens during communication with the UE Cloud DDC server. 
[FYI] joakim.lindqvist

[CL 30024951 by zousar shaker in ue5-main branch]
 2023-11-30 17:03:55 -05:00
zousar shaker
81874f5865 Change the way ZenCacheStore configuration and presentation is implemented to align with the pattern used in HttpCacheStore so that we can use a ServerID parameter to refer to a configuration in the StorageServers section of the config while still retaining the ability to override values as needed. No config changes at this point, those will happen later. 
#rb Devin.Doucette

[CL 29926397 by zousar shaker in ue5-main branch]
 2023-11-25 16:22:26 -05:00
zousar shaker
9fbac7bd41 Change the strategy for HttpCacheStore Put operations to have larger and distinct queues for each of the put operation phases. Instead of one queue of 24 maximum in-flight requests, we can now have 64 PutRef requests AND 64 PutBlobs requests, and 64 PutFinalize requests operating simultaneously. The purpose is to allow per-shader caching to: 
1. Put a higher volume of individual cache items in a lesser amount of wall time
2. Reduce the gap in time between when a ref is put and when it is finalized during times of heavy Put workload

Along with this change there is a System.DerivedDataCache.HttpDerivedDataBackend.CacheStoreStressPut automated test (StressFilter) that puts 1000 records containing 12 byte values in each.  Before this change, the test took 21 seconds to complete.  It now takes 9 seconds to complete.  There are opportunities to improve this further through batching.

#rb Devin.Doucette

[CL 29913201 by zousar shaker in ue5-main branch]
 2023-11-23 14:48:23 -05:00
mark lintott
b99d530ce0 Moved EpicStudioAnalytics plugin to StudioTelemetry which is now public facing. 
The intention is to provide a set of "in the box" telemetry hooks to our most common developer workflows for use internal Epic use and licensees
Moved startup of StudioTelemetry plugin much earlier to PostConfigInit stage so that sessions can start much earlier in the workflow
Added WIP Client support to telemetry plugin
Added data driven provider support for FAnlayiticProvidersET interfaces via BaseEngine.ini for common games and sample projects. Settings and URLs for EPic are only avaliable in Resttricted/NotForLicensee config folders for Lyra and Shooter game.
Added support for Horde telemetry and fixed up various problems with duplicate attributes being sent.
Added Core.VirtualAssets telemetry event
Added Core.Zen telemetry event
Added Core.IAS telemetry event
Added check for IOStoreOnDemand IsEnabled to avoid sending empty IAS events
Added FAnalyticsMulticastProvider to forward telemetry events to multiple providers contained within
Removed deprecated Fire_LoadingEvent from StudioAnalytics
[FYI] paul.chipchase
#rb Wes.Hunt

[CL 29908039 by mark lintott in ue5-main branch]
 2023-11-23 07:06:10 -05:00
marc audy
763a611985 Fix C4072 warnings 
#rnx

[CL 29852844 by marc audy in ue5-main branch]
 2023-11-20 17:26:53 -05:00
zousar shaker
922be064fe Downgrade warning severity messages to display severity when we are unable to reach a remote zenserver (as opposed to a local one). 
#rb Devin.Doucette

[CL 29761186 by zousar shaker in ue5-main branch]
 2023-11-15 17:17:29 -05:00
zousar shaker
6d67757420 Restore the printing of the response body when an unexpected error is received, but now with consideration for the content type of the response. 
#rb Devin.Doucette
#okfogithub public

[CL 29729528 by zousar shaker in ue5-main branch]
 2023-11-14 18:20:37 -05:00
joakim lindqvist
bf3f772a3e DDC Http Store - Added ability to configure AuthScheme (defaulting to JWTBearer as before) and the ability to directly specify a auth token. This can be used to run with the ServiceAccount scheme in Cloud DDC which we intend to use for getting onboarded quicker by licensees (it is not a recommended approch to use for wider deployments across teams). 
#rb Zousar.Shaker

[CL 29716236 by joakim lindqvist in ue5-main branch]
 2023-11-14 12:05:35 -05:00
steve robb
0bbd5e4d69 Fixed deprecated FString constructors. 
#rb james.hopkin

[CL 29690489 by steve robb in ue5-main branch]
 2023-11-13 14:15:15 -05:00
zousar shaker
e7e4572e95 Restoring the previous rate limit on the jupiter client, and specifically disabling the rate limit for operations in the PUT queue. 
[FYI] devin.doucette

[CL 29674526 by zousar shaker in ue5-main branch]
 2023-11-11 18:56:10 -05:00
zousar shaker
c5c124a279 Reduce frequency of "partial put" operations where we put a ref but not the blobs it refers to because of either a 502 "Bad Gateway" response, or because we experience an "operation too slow" condition. 
#rb devin.doucette

[CL 29656642 by zousar shaker in ue5-main branch]
 2023-11-10 17:01:43 -05:00
zousar shaker
3dd1d6493a Change certain messages relating to PUTting data into jupiter from Log verbosity to Display verbosity. 
[CL 29633571 by zousar shaker in ue5-main branch]
 2023-11-10 02:27:01 -05:00
zousar shaker
540ba6901f Add performance disabling (via latency) for ZenCacheStore. 
#rb devin.doucette

[CL 29537962 by zousar shaker in ue5-main branch]
 2023-11-07 17:56:15 -05:00
zousar shaker
e0fba69c4e Fix a mis-named variable (name change only). 
[CL 29421133 by zousar shaker in ue5-main branch]
 2023-11-03 16:50:18 -04:00
zousar shaker
d9368d0642 Ensure that FCacheStoreRequestTimer increments timings and doesn't overwrite them. 
[CL 29421057 by zousar shaker in ue5-main branch]
 2023-11-03 16:49:25 -04:00
dan elksnitis
12648749a1 [ddc] expose option for more granular prioritization of ddc query/response tasks 
#rb Devin.Doucette

[CL 29406572 by dan elksnitis in ue5-main branch]
 2023-11-03 10:50:19 -04:00
zousar shaker
cce1a015d6 Fix memory leak caused by reference counted objects capturing references to themselves in function captures held on members of itself. This manifested as memory never being freed when performing some operations with HttpCacheStore and ZenCacheStore. 
#rb devin.doucette

[CL 29316880 by zousar shaker in ue5-main branch]
 2023-11-01 10:33:43 -04:00
devin doucette
3f6992e87a DDC: Temporarily restored blocking during get requests in HttpCacheStore 
#rb Zousar.Shaker
#rnx

[CL 29279339 by devin doucette in ue5-main branch]
 2023-10-31 12:26:11 -04:00
zousar shaker
5a3feaca1a Add mechanism to redirect filesystem cache stores to other cache store entries in the graph. 
#rb devin.doucette

[CL 29093197 by zousar shaker in ue5-main branch]
 2023-10-25 12:54:23 -04:00
devin doucette
4cb30fbc48 DDC: Fixed accumulation and reporting of cache store latency 
#jira UE-198599
#rb Zousar.Shaker

[CL 29079042 by devin doucette in ue5-main branch]
 2023-10-25 03:15:00 -04:00
devin doucette
e3d69ab88a DDC: Eliminated most blocking during get requests in HttpCacheStore 
#rb Zousar.Shaker

[CL 29016155 by devin doucette in ue5-main branch]
 2023-10-23 09:46:03 -04:00
zousar shaker
d4b51b1b16 Avoid printing response body when receiving an unexpected error in the HttpCacheStore. The response body could be of arbitrary type and could be truncated or malformed, so it's not safe to attempt to reinterpret it as a UTF8 string. If GetBodyAsString is expanded later to cover all media types and the possibility of truncated or malformed data, we can consider re-enabling the printing of the body at the time of an unexpected error. 
#rb devin.doucette

[CL 28969779 by zousar shaker in ue5-main branch]
 2023-10-20 12:43:23 -04:00
matt peters
e53bae0868 MPCook: Add global function UE::GetMultiprocessId to handle the commandline parsing of MultiprocessId for CookWorkers. 
#rnx
#rb Zousar.Shaker

[CL 28938402 by matt peters in ue5-main branch]
 2023-10-19 18:18:01 -04:00
zousar shaker
077fb381b6 Allow HttpCacheStore to retry on requests that experience an Unknown error code. This is to help mitigate issues where the client experiences "connection reset by peer". 
#rb devin.doucette

[CL 28933535 by zousar shaker in ue5-main branch]
 2023-10-19 16:57:16 -04:00