zousar shaker 77d204ed2c Don't have the cook director close the worker socket before forcible worker process termination and detach because otherwise DetachFromRemoteProcess won't call OnMultiprocessWorkerDetached for the worker leading to issues like DerivedDataReplay emitting in error because a worker is not detached and it can't merge replay files. Also have the multi-process detach context inform the delegate of whether the detach was abnormal so that delegate methods can make context-appropriate choices about how to handle abnormal detach scenarios. The derived data replay mechanism will ignore replays from abnormally detached processes when doing replay merging and warn about the fact that the replay is incomplete. ...

#rb Devin.Doucette, Matt.Peters

[CL 32580894 by zousar shaker in ue5-main branch]

2024-03-28 12:16:40 -04:00

..

Http

Add option to bypass proxies to the derived data http client (default is no bypass). Zen cache store client uses it and defaults to bypassing proxies (but can be overridden in INI). UE Cloud DDC client uses it and defaults to NOT bypassing proxies (but can be overridden in INI).

2024-03-25 18:59:10 -04:00

Tests

…

BatchView.h

…

DerivedDataBackendInterface.h

…

DerivedDataBackends.cpp

…

DerivedDataBuild.cpp

…

DerivedDataBuildAction.cpp

…

DerivedDataBuildDefinition.cpp

…

DerivedDataBuildFunctionRegistry.cpp

…

DerivedDataBuildInputs.cpp

…

DerivedDataBuildJob.cpp

…

DerivedDataBuildJobContext.cpp

DDC: Exposed metadata more extensively in the build API

2024-01-18 14:06:50 -05:00

DerivedDataBuildJobContext.h

DDC: Exposed metadata more extensively in the build API

2024-01-18 14:06:50 -05:00

DerivedDataBuildOutput.cpp

DDC: Exposed metadata more extensively in the build API

2024-01-18 14:06:50 -05:00

DerivedDataBuildPrivate.h

…

DerivedDataBuildScheduler.cpp

…

DerivedDataBuildSession.cpp

…

DerivedDataBuildWorkerRegistry.cpp

…

DerivedDataCache.cpp

Fixes for Studio Telemetry

2024-03-25 11:32:11 -04:00

DerivedDataCacheKey.cpp

…

DerivedDataCacheKeyFilter.cpp

…

DerivedDataCacheMethod.cpp

…

DerivedDataCacheModule.cpp

…

DerivedDataCachePolicy.cpp

…

DerivedDataCachePrivate.h

…

DerivedDataCacheRecord.cpp

…

DerivedDataCacheReplay.cpp

Don't have the cook director close the worker socket before forcible worker process termination and detach because otherwise DetachFromRemoteProcess won't call OnMultiprocessWorkerDetached for the worker leading to issues like DerivedDataReplay emitting in error because a worker is not detached and it can't merge replay files. Also have the multi-process detach context inform the delegate of whether the detach was abnormal so that delegate methods can make context-appropriate choices about how to handle abnormal detach scenarios. The derived data replay mechanism will ignore replays from abnormally detached processes when doing replay merging and warn about the fact that the replay is incomplete.

2024-03-28 12:16:40 -04:00

DerivedDataCacheStats.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStats.h

…

DerivedDataCacheStore.cpp

…

DerivedDataCacheStore.h

…

DerivedDataCacheStoreAsync.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStoreHierarchy.cpp

Ignore cancelations when tracking DDC usage stats as our legacy stat tracking system doesn't represent cancellations and instead gives a false perception about how many cache misses are occurring. The cancellations do have an overhead, but in practice most cancellations are done before network traffic has begun and has very little cost, such that we aren't at a major lossby not tracking this time.

2024-03-26 15:15:39 -04:00

DerivedDataCacheStoreThrottle.cpp

…

DerivedDataCacheStoreVerify.cpp

…

DerivedDataCacheUsageStats.cpp

…

DerivedDataLegacyCacheStore.cpp

…

DerivedDataLegacyCacheStore.h

…

DerivedDataPrivate.h

…

DerivedDataRequestOwner.cpp

Replaced RemoveAt(N, 1, EAllowShrinking::*) with RemoveAt(N, EAllowShrinking::*).

2024-02-19 16:51:58 -05:00

DerivedDataRequestTypes.cpp

…

DerivedDataSharedString.cpp

…

DerivedDataThreadPoolTask.cpp

…

DerivedDataValue.cpp

…

FileSystemCacheStore.cpp

Silence PVS warnings

2024-01-17 01:34:02 -05:00

HashingArchiveProxy.h

…

HttpCacheStore.cpp

Add option to bypass proxies to the derived data http client (default is no bypass). Zen cache store client uses it and defaults to bypassing proxies (but can be overridden in INI). UE Cloud DDC client uses it and defaults to NOT bypassing proxies (but can be overridden in INI).

2024-03-25 18:59:10 -04:00

MemoryCacheStore.cpp

…

MemoryCacheStore.h

…

PakFileCacheStore.cpp

…

PakFileCacheStore.h

…

S3CacheStore.cpp

DDC: Fix race conditions on counters in the Jupiter and S3 cache stores

2024-02-07 12:51:56 -05:00

ZenCacheStore.cpp

Add option to bypass proxies to the derived data http client (default is no bypass). Zen cache store client uses it and defaults to bypassing proxies (but can be overridden in INI). UE Cloud DDC client uses it and defaults to NOT bypassing proxies (but can be overridden in INI).

2024-03-25 18:59:10 -04:00