devin doucette 31ec11b0f5 DDC: Eliminated most blocking during requests in ZenCacheStore ...

#rb Zousar.Shaker

[CL 33874002 by devin doucette in ue5-main branch]

2024-05-23 16:37:20 -04:00

..

Http

Add option to bypass proxies to the derived data http client (default is no bypass). Zen cache store client uses it and defaults to bypassing proxies (but can be overridden in INI). UE Cloud DDC client uses it and defaults to NOT bypassing proxies (but can be overridden in INI).

2024-03-25 18:59:10 -04:00

Tests

…

BatchView.h

…

DerivedDataBackendInterface.h

…

DerivedDataBackends.cpp

…

DerivedDataBuild.cpp

…

DerivedDataBuildAction.cpp

…

DerivedDataBuildDefinition.cpp

…

DerivedDataBuildFunctionRegistry.cpp

…

DerivedDataBuildInputs.cpp

…

DerivedDataBuildJob.cpp

…

DerivedDataBuildJobContext.cpp

…

DerivedDataBuildJobContext.h

…

DerivedDataBuildOutput.cpp

…

DerivedDataBuildPrivate.h

…

DerivedDataBuildScheduler.cpp

…

DerivedDataBuildSession.cpp

…

DerivedDataBuildWorkerRegistry.cpp

…

DerivedDataCache.cpp

DDC: Added a missing request barrier

2024-05-21 13:04:36 -04:00

DerivedDataCacheKey.cpp

…

DerivedDataCacheKeyFilter.cpp

…

DerivedDataCacheMethod.cpp

…

DerivedDataCacheModule.cpp

…

DerivedDataCachePolicy.cpp

…

DerivedDataCachePrivate.h

…

DerivedDataCacheRecord.cpp

…

DerivedDataCacheReplay.cpp

Don't have the cook director close the worker socket before forcible worker process termination and detach because otherwise DetachFromRemoteProcess won't call OnMultiprocessWorkerDetached for the worker leading to issues like DerivedDataReplay emitting in error because a worker is not detached and it can't merge replay files. Also have the multi-process detach context inform the delegate of whether the detach was abnormal so that delegate methods can make context-appropriate choices about how to handle abnormal detach scenarios. The derived data replay mechanism will ignore replays from abnormally detached processes when doing replay merging and warn about the fact that the replay is incomplete.

2024-03-28 12:16:40 -04:00

DerivedDataCacheStats.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStats.h

…

DerivedDataCacheStore.cpp

…

DerivedDataCacheStore.h

…

DerivedDataCacheStoreAsync.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStoreHierarchy.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStoreThrottle.cpp

…

DerivedDataCacheStoreVerify.cpp

…

DerivedDataCacheUsageStats.cpp

…

DerivedDataHttpRequestQueue.cpp

DDC: Extracted FHttpCacheStoreRequestQueue for reuse by Zen

2024-05-22 16:38:43 -04:00

DerivedDataHttpRequestQueue.h

DDC: Extracted FHttpCacheStoreRequestQueue for reuse by Zen

2024-05-22 16:38:43 -04:00

DerivedDataLegacyCacheStore.cpp

…

DerivedDataLegacyCacheStore.h

…

DerivedDataPrivate.h

…

DerivedDataRequestOwner.cpp

Replaced RemoveAt(N, 1, EAllowShrinking::*) with RemoveAt(N, EAllowShrinking::*).

2024-02-19 16:51:58 -05:00

DerivedDataRequestTypes.cpp

…

DerivedDataSharedString.cpp

…

DerivedDataThreadPoolTask.cpp

…

DerivedDataValue.cpp

…

FileSystemCacheStore.cpp

…

HashingArchiveProxy.h

…

HttpCacheStore.cpp

DDC: Extracted FHttpCacheStoreRequestQueue for reuse by Zen

2024-05-22 16:38:43 -04:00

MemoryCacheStore.cpp

…

MemoryCacheStore.h

…

PakFileCacheStore.cpp

…

PakFileCacheStore.h

…

S3CacheStore.cpp

…

ZenCacheStore.cpp

DDC: Eliminated most blocking during requests in ZenCacheStore

2024-05-23 16:37:20 -04:00