zousar shaker
922be064fe
Downgrade warning severity messages to display severity when we are unable to reach a remote zenserver (as opposed to a local one).
...
#rb Devin.Doucette
[CL 29761186 by zousar shaker in ue5-main branch]
2023-11-15 17:17:29 -05:00
zousar shaker
6d67757420
Restore the printing of the response body when an unexpected error is received, but now with consideration for the content type of the response.
...
#rb Devin.Doucette
#okfogithub public
[CL 29729528 by zousar shaker in ue5-main branch]
2023-11-14 18:20:37 -05:00
joakim lindqvist
bf3f772a3e
DDC Http Store - Added ability to configure AuthScheme (defaulting to JWTBearer as before) and the ability to directly specify a auth token. This can be used to run with the ServiceAccount scheme in Cloud DDC which we intend to use for getting onboarded quicker by licensees (it is not a recommended approch to use for wider deployments across teams).
...
#rb Zousar.Shaker
[CL 29716236 by joakim lindqvist in ue5-main branch]
2023-11-14 12:05:35 -05:00
steve robb
0bbd5e4d69
Fixed deprecated FString constructors.
...
#rb james.hopkin
[CL 29690489 by steve robb in ue5-main branch]
2023-11-13 14:15:15 -05:00
zousar shaker
e7e4572e95
Restoring the previous rate limit on the jupiter client, and specifically disabling the rate limit for operations in the PUT queue.
...
[FYI] devin.doucette
[CL 29674526 by zousar shaker in ue5-main branch]
2023-11-11 18:56:10 -05:00
zousar shaker
c5c124a279
Reduce frequency of "partial put" operations where we put a ref but not the blobs it refers to because of either a 502 "Bad Gateway" response, or because we experience an "operation too slow" condition.
...
#rb devin.doucette
[CL 29656642 by zousar shaker in ue5-main branch]
2023-11-10 17:01:43 -05:00
zousar shaker
3dd1d6493a
Change certain messages relating to PUTting data into jupiter from Log verbosity to Display verbosity.
...
[CL 29633571 by zousar shaker in ue5-main branch]
2023-11-10 02:27:01 -05:00
zousar shaker
540ba6901f
Add performance disabling (via latency) for ZenCacheStore.
...
#rb devin.doucette
[CL 29537962 by zousar shaker in ue5-main branch]
2023-11-07 17:56:15 -05:00
zousar shaker
e0fba69c4e
Fix a mis-named variable (name change only).
...
[CL 29421133 by zousar shaker in ue5-main branch]
2023-11-03 16:50:18 -04:00
zousar shaker
d9368d0642
Ensure that FCacheStoreRequestTimer increments timings and doesn't overwrite them.
...
[CL 29421057 by zousar shaker in ue5-main branch]
2023-11-03 16:49:25 -04:00
dan elksnitis
12648749a1
[ddc] expose option for more granular prioritization of ddc query/response tasks
...
#rb Devin.Doucette
[CL 29406572 by dan elksnitis in ue5-main branch]
2023-11-03 10:50:19 -04:00
zousar shaker
cce1a015d6
Fix memory leak caused by reference counted objects capturing references to themselves in function captures held on members of itself. This manifested as memory never being freed when performing some operations with HttpCacheStore and ZenCacheStore.
...
#rb devin.doucette
[CL 29316880 by zousar shaker in ue5-main branch]
2023-11-01 10:33:43 -04:00
devin doucette
3f6992e87a
DDC: Temporarily restored blocking during get requests in HttpCacheStore
...
#rb Zousar.Shaker
#rnx
[CL 29279339 by devin doucette in ue5-main branch]
2023-10-31 12:26:11 -04:00
zousar shaker
5a3feaca1a
Add mechanism to redirect filesystem cache stores to other cache store entries in the graph.
...
#rb devin.doucette
[CL 29093197 by zousar shaker in ue5-main branch]
2023-10-25 12:54:23 -04:00
devin doucette
4cb30fbc48
DDC: Fixed accumulation and reporting of cache store latency
...
#jira UE-198599
#rb Zousar.Shaker
[CL 29079042 by devin doucette in ue5-main branch]
2023-10-25 03:15:00 -04:00
devin doucette
e3d69ab88a
DDC: Eliminated most blocking during get requests in HttpCacheStore
...
#rb Zousar.Shaker
[CL 29016155 by devin doucette in ue5-main branch]
2023-10-23 09:46:03 -04:00
zousar shaker
d4b51b1b16
Avoid printing response body when receiving an unexpected error in the HttpCacheStore. The response body could be of arbitrary type and could be truncated or malformed, so it's not safe to attempt to reinterpret it as a UTF8 string. If GetBodyAsString is expanded later to cover all media types and the possibility of truncated or malformed data, we can consider re-enabling the printing of the body at the time of an unexpected error.
...
#rb devin.doucette
[CL 28969779 by zousar shaker in ue5-main branch]
2023-10-20 12:43:23 -04:00
matt peters
e53bae0868
MPCook: Add global function UE::GetMultiprocessId to handle the commandline parsing of MultiprocessId for CookWorkers.
...
#rnx
#rb Zousar.Shaker
[CL 28938402 by matt peters in ue5-main branch]
2023-10-19 18:18:01 -04:00
zousar shaker
077fb381b6
Allow HttpCacheStore to retry on requests that experience an Unknown error code. This is to help mitigate issues where the client experiences "connection reset by peer".
...
#rb devin.doucette
[CL 28933535 by zousar shaker in ue5-main branch]
2023-10-19 16:57:16 -04:00
devin doucette
814720d7fd
DDC: Fixed a crash when a boot cache is present
...
#jira UE-197936
#rb Tim.Smith
[CL 28759412 by devin doucette in ue5-main branch]
2023-10-13 13:26:35 -04:00
nick edwards
69726f5ee7
Update code using FJsonObject to use TCHAR strings instead of ANSI strings. Removes unnecessary string conversions and removes compilation errors when FJsonObject is updated to use FStringViews.
...
[CL 28536648 by nick edwards in ue5-main branch]
2023-10-06 08:18:42 -04:00
zousar shaker
0ba09b3e1f
Remove erroneous text from filesystem cache store speed test logs. The logic for whether the file store gets used or not is more subtle than implied by the log text.
...
#rb none
[FYI] devin.doucette
[FYI] dan.thompson
[CL 28467641 by zousar shaker in ue5-main branch]
2023-10-04 14:38:53 -04:00
devin doucette
197b2197ba
DDC: Removed the synchronous request pools from HttpCacheStore
...
These are not used by default and were only kept to support A/B testing in the past.
#rb Zousar.Shaker
#rnx
[CL 28415416 by devin doucette in ue5-main branch]
2023-10-03 11:22:39 -04:00
devin doucette
8e1e6dea73
DDC: Added cancellation support to FHttpCacheStoreRequestQueue
...
#rb Steve.Robb
#rnx
[CL 28413356 by devin doucette in ue5-main branch]
2023-10-03 10:23:20 -04:00
zousar shaker
2a2910744f
Downgrade messages from ZenCacheStore from Warning to Display as they can be expected to come up due to network conditions or temporary outages and do not break functionality.
...
#rb devin.doucette
[CL 28357691 by zousar shaker in ue5-main branch]
2023-09-29 17:36:33 -04:00