Commit Graph

619 Commits

Author SHA1 Message Date
Devin Doucette
5c2b7f7381 DDC: Temporary compile fix for platforms that should not include DerivedDataCache
#preflight skip
#rb none
#rnx

[CL 20445864 by Devin Doucette in ue5-main branch]
2022-05-31 23:25:37 -04:00
Devin Doucette
1bbb384300 DDC: Removed the legacy cache implementation from the clients for Horde Storage and Zen
#preflight 62967fd60c151996e13038ec
#rb Zousar.Shaker

[CL 20445538 by Devin Doucette in ue5-main branch]
2022-05-31 22:01:53 -04:00
Zousar Shaker
edf8ae1f0b 2nd submit:
Switch Zen cache store to use the HTTP request codepath in the Jupiter cache store while taking some of the improvements that had been made when that code was branched off to make the Zen HTTP codepath.  This is a precursor for getting Zen cache store using non-blocking operations like Jupiter cache store - this has started to be stubbed in with the EnqueueAsyncRpc methods that are stubbed in but not used from the Zen cache store.  Eventually I'd like this HTTP code to move out of the DerivedDataCache module and be usable elsewhere and supplant the HTTP code currently in the Zen module, but this will require some decisions about whether IRequestOwner should move out of the DerivedDataCache module or not.

Tested Zen operation using ShooterGame editor.
Tested Jupiter operation using CitySample editor (empty local cache).

#rb devin.doucette
#fyi stefan.boberg
#preflight 62953e65401169f78c57c298
#preflight 629642a1be0ae0b33a46d012

[CL 20438549 by Zousar Shaker in ue5-main branch]
2022-05-31 12:42:17 -04:00
Devin Doucette
633521c203 DDC: Exposed IsCanceled and LaunchTask through FRequestOwner
#preflight 62958df65370042eb050c1c3
#rb Zousar.Shaker
#rnx

[CL 20436079 by Devin Doucette in ue5-main branch]
2022-05-31 09:01:19 -04:00
mark lintott
da46ade47c Added Cache Speed Stats to Analytics
Added Zen Server Stats to Analytics
#rb zousar.shaker, devin.doucette
#jira none
#preflight 6295d84bd57da28cc8ee9eab

[CL 20434901 by mark lintott in ue5-main branch]
2022-05-31 05:11:05 -04:00
Zousar Shaker
77f51a02b9 [Backout] - CL20433163
#fyi Zousar.Shaker
Original CL Desc
-----------------------------------------------------------------
Switch Zen cache store to use the HTTP request codepath in the Jupiter cache store while taking some of the improvements that had been made when that code was branched off to make the Zen HTTP codepath.  This is a precursor for getting Zen cache store using non-blocking operations like Jupiter cache store - this has started to be stubbed in with the EnqueueAsyncRpc methods that are stubbed in but not used from the Zen cache store.  Eventually I'd like this HTTP code to move out of the DerivedDataCache module and be usable elsewhere and supplant the HTTP code currently in the Zen module, but this will require some decisions about whether IRequestOwner should move out of the DerivedDataCache module or not.

Tested Zen operation using ShooterGame editor.
Tested Jupiter operation using CitySample editor (empty local cache).

#rb devin.doucette
#fyi stefan.boberg
#preflight 62953e65401169f78c57c298

[CL 20433363 by Zousar Shaker in ue5-main branch]
2022-05-30 19:32:59 -04:00
Zousar Shaker
2f6cbf5012 Switch Zen cache store to use the HTTP request codepath in the Jupiter cache store while taking some of the improvements that had been made when that code was branched off to make the Zen HTTP codepath. This is a precursor for getting Zen cache store using non-blocking operations like Jupiter cache store - this has started to be stubbed in with the EnqueueAsyncRpc methods that are stubbed in but not used from the Zen cache store. Eventually I'd like this HTTP code to move out of the DerivedDataCache module and be usable elsewhere and supplant the HTTP code currently in the Zen module, but this will require some decisions about whether IRequestOwner should move out of the DerivedDataCache module or not.
Tested Zen operation using ShooterGame editor.
Tested Jupiter operation using CitySample editor (empty local cache).

#rb devin.doucette
#fyi stefan.boberg
#preflight 62953e65401169f78c57c298

[CL 20433163 by Zousar Shaker in ue5-main branch]
2022-05-30 18:14:02 -04:00
David Harvey
b5840fed7f removing several PLATFORM_HOLOLENS references, mostly around WindowsHWrapper etc.
#jira UE-149794
#rnx
#preflight 628f7a4df622d972b5db8318
#rb pending

[CL 20391626 by David Harvey in ue5-main branch]
2022-05-27 07:04:22 -04:00
Zousar Shaker
56023240e1 Cleanup and private detail pass on Http Client code within DDC in preparation for re-use from multiple cache stores.
#rb devin.doucette
#preflight 628fd292f622d972b5f27a6c

[CL 20386642 by Zousar Shaker in ue5-main branch]
2022-05-26 18:07:41 -04:00
dan engelbrecht
e4e1ba5527 Allow configuration for separate namespace for structured data
#preflight 628e494382597362d1f8050d
#preflight 628e70d72c7cb2d10d71c033

[CL 20369511 by dan engelbrecht in ue5-main branch]
2022-05-25 14:55:57 -04:00
Matt Peters
95a91fb502 FCacheStoreAsync: Fix empty initialization statement warning when COOK_STAT is not defined.
#rb Devin.Doucette
#rnx
#preflight 628d49923d365c54f14cfa71

[CL 20356986 by Matt Peters in ue5-main branch]
2022-05-24 18:11:43 -04:00
Zousar Shaker
b0c4a2516e Fix incorrect handling of empty "needs" list when performing existence check in Horde Storage.
#rb devin.doucette
#fyi paul.chipchase
#preflight 6287ac2c2c34da686ae7c760

[CL 20295308 by Zousar Shaker in ue5-main branch]
2022-05-20 11:32:33 -04:00
dan engelbrecht
d02fe97130 Pass on configured namespace for Zen cache RPC requests.
Current Zen server implementations ignore this field so no functional change until new Zen server with namespace support are deploy/integrated into p4
#preflight 628674f79016c6dd898a6616

[CL 20287017 by dan engelbrecht in ue5-main branch]
2022-05-19 16:32:16 -04:00
Dan Thompson
7f5df95274 no functionality change, misc comments
#rb none
#preflight 62869724f15d967ff4d1e712

[CL 20286015 by Dan Thompson in ue5-main branch]
2022-05-19 15:44:07 -04:00
Zousar Shaker
f6b11394e3 Avoid compile error on WinGDK target due to absence of WITH_SSL.
#rb none
#rnx
#preflight 62866530614041edb7080bf9

[CL 20282697 by Zousar Shaker in ue5-main branch]
2022-05-19 12:54:26 -04:00
Zousar Shaker
a17b5d1431 Fix missing includes in HttpClient.h and HttpRequest.cpp identified by the NoPCH build.
#rb none
#rnx
#preflight 62855106ce2518860fe84032

[CL 20267701 by Zousar Shaker in ue5-main branch]
2022-05-18 16:21:02 -04:00
Zousar Shaker
f263b7ed54 2nd check-in:
Separate re-usable HTTP types from the HttpCacheStore to allow for re-use in the future by other cache stores.

#rb devin.doucette
#rnx
#preflight 62841cbdf536779152dfc561

[CL 20260417 by Zousar Shaker in ue5-main branch]
2022-05-18 09:58:59 -04:00
Zousar Shaker
b4cb8da065 [Backout] - CL20252872
#fyi Zousar.Shaker
Original CL Desc
-----------------------------------------------------------------
Separate re-usable HTTP types from the HttpCacheStore to allow for re-use in the future by other cache stores.

#rb devin.doucette
#rnx
#preflight 62841cbdf536779152dfc561

[CL 20254560 by Zousar Shaker in ue5-main branch]
2022-05-17 20:51:15 -04:00
Zousar Shaker
8805f32c05 Separate re-usable HTTP types from the HttpCacheStore to allow for re-use in the future by other cache stores.
#rb devin.doucette
#rnx
#preflight 62841cbdf536779152dfc561

[CL 20252872 by Zousar Shaker in ue5-main branch]
2022-05-17 18:36:19 -04:00
danny couture
623896568d Improve frame rate stability in editor by reducing the priority of the DDC IO threads which are now doing CPU intensive compression to avoid them preempting more important threads (GT/RT/RHI)
#rnx
#rb Devin.Doucette
#preflight 62825177cf7e4667a991a6cc

[CL 20223281 by danny couture in ue5-main branch]
2022-05-16 09:52:19 -04:00
Zousar Shaker
d08f81b885 Ensure that http headers can be found in a case-insensitive way as expected by the callers of GetHeader.
#rb devin.doucette
#rnx
#preflight 627b53295b58374330b5484c
#preflight 627bf3ce0a5817c9d952fc57

[CL 20144831 by Zousar Shaker in ue5-main branch]
2022-05-11 13:52:26 -04:00
Devin Doucette
5021354ab8 DDC: Fixed HttpCacheStore to shut down its thread
FHttpSharedData is no longer constructed as a function-local static because that makes shutdown more difficult to handle correctly. The cache store now owns the shared data and destroys it when it shuts down.

Includes greater encapsulation of the shared data and migration from FRunnable/FRunnableThread to FThread.

#preflight 627aad2bc42338be65272366
#rb Zousar.Shaker
#rnx

[CL 20138109 by Devin Doucette in ue5-main branch]
2022-05-11 09:10:24 -04:00
Devin Doucette
da04ab9644 DDC: Fixed cache put propagation for nodes that store async
#preflight 62798a72242446ce6c69df25
#rb Zousar.Shaker
#rnx

[CL 20121708 by Devin Doucette in ue5-main branch]
2022-05-10 08:46:00 -04:00
Devin Doucette
7a50c98265 DDC: Added propagation of cache records that contain metadata with no values
#preflight 62797bdd4561731dbe10ecdf
#rb Matt.Peters

[CL 20111217 by Devin Doucette in ue5-main branch]
2022-05-09 17:18:23 -04:00
Zousar Shaker
4ee0c804e0 [Backout] - CL20029407
#fyi Zousar.Shaker
Original CL Desc
-----------------------------------------------------------------
Limit concurrent connections when using the Curl multi API for Jupiter DDC operations.

#rb devin.doucette
#preflight 627040b4645c64f3a25a14ca
#preflight 62716d2c9d6c2f8f5b2558f2

[CL 20057204 by Zousar Shaker in ue5-main branch]
2022-05-05 09:58:02 -04:00