izzy/UnrealEngineUWP
0
0
Fork 0
mirror of https://github.com/izzy2lost/UnrealEngineUWP.git synced 2026-03-26 18:15:20 -07:00
Code Issues Packages Projects Releases Wiki Activity
239,563 Commits 23 Branches 254 Tags
8d7deb00fbf64cfd88f96e9233482da3cc229d52
Commit Graph

695 Commits

Author SHA1 Message Date
mark lintott
7126d3c2ed Split up the DDC cache analytics per back end so we can more easily reason about specific abck end perf 
#rb zousar.shaker, devin.doucette
#preflight 63da8e557a39a18021722350

[CL 23984212 by mark lintott in ue5-main branch]
 2023-02-02 18:47:48 -05:00
Zousar Shaker
d907347b26 Fix build breakage from CL23917590. 
#rb none
#fyi devin.doucette
#preflight skip,BuildBreakFix

[CL 23918382 by Zousar Shaker in ue5-main branch]
 2023-01-30 18:34:40 -05:00
Devin Doucette
82621298bf DDC: Added -ExportBuildOutput to include outputs in exported builds 
#preflight 63d804445c69f453c111cfd0
#rb Zousar.Shaker

[CL 23917590 by Devin Doucette in ue5-main branch]
 2023-01-30 17:44:07 -05:00
danny couture
74782129ec Fix race in FCounters used in FileSystemCacheStore and AsyncLoading 
#rnx
#rb Devin.Doucette
#preflight 63d1d57e6a14d8406d8fc7d4

[CL 23863764 by danny couture in ue5-main branch]
 2023-01-25 21:07:51 -05:00
Devin Doucette
023e2fd5e8 DDC: Fixed a race condition in the cache hierarchy 
The hierarchy now uses a request barrier after the first synchronous request completion. Async requests could occasionally complete fast enough that DispatchRequests would be left to handle the completion. In that scenario, there would not be a barrier in place when beginning any subsequent requests, which would lead to a failed assertion in the request owner.

#preflight 63ceb5c63a03cb0bbff95362
#rb Zousar.Shaker

[CL 23848713 by Devin Doucette in ue5-main branch]
 2023-01-25 11:05:29 -05:00
zousar shaker
d52719ba40 Add support for a Zen cache store Host to be None (implying that it is disabled) and to have both commandline and environment overrides (similar to the HTTP cache store). 
#rb devin.doucette

[CL 23815887 by zousar shaker in ue5-main branch]
 2023-01-23 12:48:38 -05:00
mark lintott
72bf7a2d8c Fixed the Cloud, Local and Shared Percentages that exceed 100% when more than one backend is used. These were flawed, Root Get/Hit count cannot be used for the percentages for each backend in this way. 
#rb devin.doucette
 #preflight 63c93722ac35a0e9da754473

[CL 23773901 by mark lintott in ue5-main branch]
 2023-01-19 10:45:32 -05:00
nicholas howe
a8ee4b6253 Fix RemoveTicker Hang in HttpCacheStore. 
#jira UE-174489
#rb devin.doucette
#preflight 63c85026c246f14856661f40

[CL 23766649 by nicholas howe in ue5-main branch]
 2023-01-18 17:59:46 -05:00
zousar shaker
d78e86696f Exclude Zen from HttpCacheStore test on non-windows platforms as it is not ready for use on non-windows platforms. 
#rb trivial
[FYI] devin.doucette
[FYI] matt.peters

[CL 23658577 by zousar shaker in ue5-main branch]
 2023-01-11 20:57:41 -05:00
zousar shaker
bfbf54d4ca ZenCacheStore - ignore "None" as an override value for a local DDC path when using sandboxes (in line with past behavior for non-default local caches like Warm/Cold). 
#rb devin.doucette

[CL 23658565 by zousar shaker in ue5-main branch]
 2023-01-11 20:57:13 -05:00
mark lintott
8bad2c0365 Removed the callback system from core Analytics system. Fixed up analytics gathering in DerivedDataCache, Virtualization and HttpCacheStore 
#rb wes.hunt
#preflight 63be95bd68068a8bd6a4438e

[CL 23651011 by mark lintott in ue5-main branch]
 2023-01-11 14:28:01 -05:00
Devin Doucette
d081f5a477 DDC: Fixed the file system cache EditorOverrideSetting not handling paths with \ in them 
#jira none
#preflight 63b78d3ad862fdd347ea642b
#rb Zousar.Shaker

[CL 23595626 by Devin Doucette in ue5-main branch]
 2023-01-05 22:10:29 -05:00
zousar shaker
d1afea0f1f Allow ReadOnly mode for a DDC FileSystemCacheStore to have maintenance performed if Clean=true or DeleteUnused=true. When ReadOnly, they are now both false by default, but usable if explicitly set to true. When not ReadOnly, DeleteUnused remains true by default. 
#rb devin.doucette

[CL 23592522 by zousar shaker in ue5-main branch]
 2023-01-05 16:11:30 -05:00
Matt Peters
6f0b8a2906 HttpCacheStore: Fix backwards if statement for whether the compactbinary is valid in GetBodyAsString 
#preflight 63b70052221aab21e01200c0

[CL 23589159 by Matt Peters in ue5-main branch]
 2023-01-05 12:01:37 -05:00
matt peters
71802fb86c Analytics: Backed out 22909100 and 22951911 
#rnx

[CL 23583550 by matt peters in ue5-main branch]
 2023-01-04 18:51:41 -05:00
Zousar Shaker
624d3b7dbf Add support for Zen DDC sandboxes which are separate instances of zenserver with separate data paths and can be optionally flushed from run-to-run. It is used to implement Warm and Cold DDC graphs using Zen sandboxes for projects/platforms that use Zen for local DDC by default, and to provide new ZenColdDDC and ZenWarmDDC as new graphs that have Cold/Warm behavior for projects that don't use Zen for local DDC by default. 
#rb devin.doucette
#preflight 63b493d5202bee5e27a645ed

[CL 23569648 by Zousar Shaker in ue5-main branch]
 2023-01-03 15:58:30 -05:00
Zousar Shaker
e27b568f2e Add capability for things that depend on the Zen service to attempt to recover the service if there is an interruption. The Zen DDC cache store is using this to allow recovery and retry of a cache request that fails to connect or times out when communicating with a Zen service on the same machine. 
#rb devin.doucette
#preflight 639cc26343330e63e5db1750

[CL 23541143 by Zousar Shaker in ue5-main branch]
 2022-12-16 15:47:14 -05:00
Zousar Shaker
e7fb0b1751 Ensure that Zen as a local service can be configured to follow the same commandline overrides as a filesystem cache store. Also ensure that if the configured override mechanisms for cache store paths yield a path of "None" that we disable the Zen DDC cache. These are in support of using Zen as a drop-in replacement for an existing filesystem DDC store. 
#rb devin.doucette
#preflight 6398ea4e680483bcb1057b0a

[CL 23517045 by Zousar Shaker in ue5-main branch]
 2022-12-14 15:06:30 -05:00
Zousar Shaker
b9548ddad4 Move Zen module public headers into an "Experimental" subfolder to have them reflect the feature status. 
Fix locations that include the headers to use the "Experimental" subfolder and re-sort includes.  No functional change, purely a move, search+replace, and sort of includes.

#rb matt.peters
#preflight 63939eebc415e8dc78d35d63

[CL 23468934 by Zousar Shaker in ue5-main branch]
 2022-12-09 16:11:41 -05:00
Zousar Shaker
54d9057532 Fixes for UE Cloud DDC client: 
- Print CbObject responses to the log/console as JSON, not raw binary
- Reduce the thresholds for connect timeout and slow transfer rate time window
- Instead of one request pool of size 128*2 requests, split GET and PUT operations into their own limited request pools and have the PUT request pool (size 20) be set smaller than the GET one (size 128)
- Stop using unbounded overflow for chained sequences of HTTP requests to avoid slow/failed requests due to many upload operations happening concurrently during high upload quantity scenarios (eg: shader version bump, editor domain version bump)

Testing:
- Cook of CitySample with shader version bumped to ensure there are no failed requests due to slow transfer
- Launch of CitySample editor with no local cache to observe throughput when all DDC data has to be fetched from upstream

#rb devin.doucette
#preflight 638c2d86cb3b754183f2e574

[CL 23385459 by Zousar Shaker in ue5-main branch]
 2022-12-04 02:26:39 -05:00
Andriy Tylychko
871aabab2e renamed TDepletableMpscQueue to TDepletableMpmcQueue as it supports multiple concurrent consumers after the last change. 
Deprecated the old name.
Updated existing use cases to use the new name or to switch to `TConsumeAllMpmcQueue` if the order of consumption doesn't matter.
Added `IsEmpty()` method to `TConsumeAllMpmcQueue`
#rb devin.doucette, arne.schober
#preflight 6389f53f9242c013261fca6b

[CL 23371804 by Andriy Tylychko in ue5-main branch]
 2022-12-02 08:47:16 -05:00
Devin Doucette
110afa128b DDC: Added new build scheduler modular features to queue by type and reserve memory 
#preflight 638128f3cc307d6fa5b4ee80
#rb Zousar.Shaker

[CL 23271781 by Devin Doucette in ue5-main branch]
 2022-11-25 21:38:59 -05:00
Devin Doucette
e2483014be DDC: Added LaunchTaskInThreadPool as a replacement for the two existing thread pool task requests 
#preflight 6380f7c4170bc34a93b9104b
#rb Zousar.Shaker

[CL 23267593 by Devin Doucette in ue5-main branch]
 2022-11-25 12:35:29 -05:00
Devin Doucette
d53ba8513d DDC: Allow the build system to be created without a cache 
#preflight 637fa7e518176c67c20951a6
#rb Zousar.Shaker

[CL 23262694 by Devin Doucette in ue5-main branch]
 2022-11-24 17:23:49 -05:00
Devin Doucette
d508667187 DDC: Added a missing read lock in the cache hierarchy 
#preflight 63751a331d25fe8b93371452
#rb Matt.Peters
#rnx

[CL 23161581 by Devin Doucette in ue5-main branch]
 2022-11-16 15:43:58 -05:00