Commit Graph

95 Commits

Author SHA1 Message Date
joakim lindqvist
bf3f772a3e DDC Http Store - Added ability to configure AuthScheme (defaulting to JWTBearer as before) and the ability to directly specify a auth token. This can be used to run with the ServiceAccount scheme in Cloud DDC which we intend to use for getting onboarded quicker by licensees (it is not a recommended approch to use for wider deployments across teams).
#rb Zousar.Shaker

[CL 29716236 by joakim lindqvist in ue5-main branch]
2023-11-14 12:05:35 -05:00
steve robb
0bbd5e4d69 Fixed deprecated FString constructors.
#rb james.hopkin

[CL 29690489 by steve robb in ue5-main branch]
2023-11-13 14:15:15 -05:00
zousar shaker
e7e4572e95 Restoring the previous rate limit on the jupiter client, and specifically disabling the rate limit for operations in the PUT queue.
[FYI] devin.doucette

[CL 29674526 by zousar shaker in ue5-main branch]
2023-11-11 18:56:10 -05:00
zousar shaker
c5c124a279 Reduce frequency of "partial put" operations where we put a ref but not the blobs it refers to because of either a 502 "Bad Gateway" response, or because we experience an "operation too slow" condition.
#rb devin.doucette

[CL 29656642 by zousar shaker in ue5-main branch]
2023-11-10 17:01:43 -05:00
zousar shaker
3dd1d6493a Change certain messages relating to PUTting data into jupiter from Log verbosity to Display verbosity.
[CL 29633571 by zousar shaker in ue5-main branch]
2023-11-10 02:27:01 -05:00
zousar shaker
cce1a015d6 Fix memory leak caused by reference counted objects capturing references to themselves in function captures held on members of itself. This manifested as memory never being freed when performing some operations with HttpCacheStore and ZenCacheStore.
#rb devin.doucette

[CL 29316880 by zousar shaker in ue5-main branch]
2023-11-01 10:33:43 -04:00
devin doucette
3f6992e87a DDC: Temporarily restored blocking during get requests in HttpCacheStore
#rb Zousar.Shaker
#rnx

[CL 29279339 by devin doucette in ue5-main branch]
2023-10-31 12:26:11 -04:00
devin doucette
e3d69ab88a DDC: Eliminated most blocking during get requests in HttpCacheStore
#rb Zousar.Shaker

[CL 29016155 by devin doucette in ue5-main branch]
2023-10-23 09:46:03 -04:00
zousar shaker
d4b51b1b16 Avoid printing response body when receiving an unexpected error in the HttpCacheStore. The response body could be of arbitrary type and could be truncated or malformed, so it's not safe to attempt to reinterpret it as a UTF8 string. If GetBodyAsString is expanded later to cover all media types and the possibility of truncated or malformed data, we can consider re-enabling the printing of the body at the time of an unexpected error.
#rb devin.doucette

[CL 28969779 by zousar shaker in ue5-main branch]
2023-10-20 12:43:23 -04:00
zousar shaker
077fb381b6 Allow HttpCacheStore to retry on requests that experience an Unknown error code. This is to help mitigate issues where the client experiences "connection reset by peer".
#rb devin.doucette

[CL 28933535 by zousar shaker in ue5-main branch]
2023-10-19 16:57:16 -04:00
devin doucette
197b2197ba DDC: Removed the synchronous request pools from HttpCacheStore
These are not used by default and were only kept to support A/B testing in the past.

#rb Zousar.Shaker
#rnx

[CL 28415416 by devin doucette in ue5-main branch]
2023-10-03 11:22:39 -04:00
devin doucette
8e1e6dea73 DDC: Added cancellation support to FHttpCacheStoreRequestQueue
#rb Steve.Robb
#rnx

[CL 28413356 by devin doucette in ue5-main branch]
2023-10-03 10:23:20 -04:00
devin doucette
abb87ce201 DDC: Eliminated most blocking during put requests in HttpCacheStore
#rb Zousar.Shaker

[CL 28141466 by devin doucette in ue5-main branch]
2023-09-22 12:45:45 -04:00
zousar shaker
d59b5d40f3 Fix bug where the key used for simulate miss checks on the GetRecord operation could be uninitialized on the HttpCacheStore.
#rb none,trivial

[CL 27867807 by zousar shaker in ue5-main branch]
2023-09-14 00:36:06 -04:00
zousar shaker
046403de46 Fix mislabeled bVerbose variable name in Jupiter Http code.
#rb none,trivial

[CL 27332573 by zousar shaker in ue5-main branch]
2023-08-23 23:38:40 -04:00
zousar shaker
6b75b9a36e Change HTTP cache store to allow GetChunks to execute asynchronous network operations.
#rb devin.doucette
#rnx

[CL 27104962 by zousar shaker in ue5-main branch]
2023-08-15 11:49:22 -04:00
david harvey
bdb4199eeb Remove unnecessary WindowsHWrapper.h & MinWindows.h include - both files will be automatically included by AllowWindowsPlatformTypes.h
#jira UE-152863
#rnx
#rb Josh.Adams

[CL 26912096 by david harvey in ue5-main branch]
2023-08-08 05:50:53 -04:00
zousar shaker
ba55084a82 DDC: Fixed missing cache bucket on GetChunks for stats
#rb devin.doucette
#rnx

[CL 26755084 by zousar shaker in ue5-main branch]
2023-08-01 17:07:33 -04:00
devin doucette
451859a759 DDC: Fixed missing cache bucket for stats
#rb Matt.Peters
#rnx

[CL 26673157 by devin doucette in ue5-main branch]
2023-07-28 10:37:53 -04:00
devin doucette
3df0bf7f14 DDC: Gather bucket stats from the new ICacheStats
#jira UE-133395
#rb Matt.Peters
#rnx

[CL 26555188 by devin doucette in ue5-main branch]
2023-07-24 16:52:05 -04:00
devin doucette
402d04cde9 DDC: Added request name to FCacheStoreRequestStats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26210120 by devin doucette in ue5-main branch]
2023-06-23 10:51:52 -04:00
devin doucette
3a730d179e DDC: Added ICacheStoreStats to the Jupiter cache
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26186125 by devin doucette in ue5-main branch]
2023-06-22 12:55:58 -04:00
devin doucette
c4e4dfad44 DDC: Prepared the Jupiter cache for ICacheStoreStats
#jira UE-133395
#rb Zousar.Shaker
#rnx

[CL 26154477 by devin doucette in ue5-main branch]
2023-06-21 13:32:34 -04:00
kirill zorin
b6ee3a6c64 Fix UE_LOG callsites that have format string-related UB
#rb trivial
#preflight 647107780a6634dbb236a0a6

[CL 25651638 by kirill zorin in ue5-main branch]
2023-05-26 15:52:39 -04:00
joakim lindqvist
54660ae511 Added ability to override the http version used for the http cache using "UE-CloudDataCacheHttpVersion" env variable or "-CloudDataCacheHttpVersion" command line argument
#preflight 644b93ac09453df548007245
#rb zousar.shaker

[CL 25333909 by joakim lindqvist in ue5-main branch]
2023-05-04 09:31:50 -04:00