Devin Doucette
646ddce8b0
DDC: Renamed HTTP enums to match modern terminology
...
#preflight 62bdb7c21c0b7587971c9f3c
#robomerge FNMain
#rb Zousar.Shaker
#rnx
[CL 20896677 by Devin Doucette in ue5-main branch]
2022-06-30 11:53:43 -04:00
devin doucette
c2f32c0b05
DDC: Simplify FCacheBucketOwnerKeyFuncs
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20883184 via CL 20885166 via CL 20885259
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)
[CL 20887595 by devin doucette in ue5-main branch]
2022-06-29 21:31:27 -04:00
devin doucette
88a306b08d
DDC: Force SSL to start up before DDC to enforce shutdown order, since DDC may be using SSL until it finishes shutting down
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20882878 via CL 20885121 via CL 20885236
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)
[CL 20887594 by devin doucette in ue5-main branch]
2022-06-29 21:31:18 -04:00
devin doucette
2416a6e653
DDC: Fixed invalid or inconsistent whitespace in HttpCacheStore
...
#rb none
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20882871 via CL 20885111 via CL 20885229
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)
[CL 20887593 by devin doucette in ue5-main branch]
2022-06-29 21:31:09 -04:00
zousar shaker
cbf5582373
Fix checkSlow failure in Debug caused by missing KeyFuncs when using a TSet.
...
#jira UE-157861
#rb matt.peters
#ROBOMERGE-OWNER: zousar.shaker
#ROBOMERGE-AUTHOR: zousar.shaker
#ROBOMERGE-COMMAND: _robomerge[bot4] UE5-MAIN
#ROBOMERGE-SOURCE: CL 20861323 via CL 20861342 via CL 20861361
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)
[CL 20861441 by zousar shaker in ue5-main branch]
2022-06-28 13:11:13 -04:00
Devin Doucette
6339ccb310
DDC: Added detail to the User-Agent HTTP header
...
User-Agent: UnrealEngine/X.Y.Z-<CL> (<Platform>; <Config> <TargetType>; <BranchName>) <AppName> (<ProjectName>)
#rb Zousar.Shaker
#rnx
#preflight 62ba162fc2022443bf17d0d4
[CL 20839976 by Devin Doucette in ue5-main branch]
2022-06-27 17:17:55 -04:00
devin doucette
727e9a9b4a
DDC: Optimized cache key construction and shared string serialization
...
#preflight 62b4be8bbe326a8b04f4ab0c
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20833516 via CL 20835073 via CL 20835503
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)
[CL 20837863 by devin doucette in ue5-main branch]
2022-06-27 15:21:57 -04:00
mihnea balta
399e160546
Fix bad scoped locks in various places.
...
Added nodiscard on the scope lock helpers to prevent such errors in the future.
#jira none
#rnx
#preflight https://horde.devtools.epicgames.com/job/62b49fe89117e2324e187b8d
#rb Francis.Hurteau, Andriy.Tylychko, Rob.Millar
[CL 20797349 by mihnea balta in ue5-main branch]
2022-06-23 13:34:31 -04:00
Zousar Shaker
6e67702448
Add missing include.
...
#rb none
#rnx
#robomerge EngineTest
#preflight 62b3f918a02640e7ab84ea24
[CL 20790219 by Zousar Shaker in ue5-main branch]
2022-06-23 01:43:23 -04:00
devin doucette
e31239c9b3
DDC: Fixed a non-unity compile error
...
#rb none
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20770467 via CL 20770468 via CL 20770472
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v970-20704180)
[CL 20770741 by devin doucette in ue5-main branch]
2022-06-22 01:40:20 -04:00
devin doucette
fbfcde6644
DDC: Extended cache replay to read replay files async and with a more configurable console command
...
#jira UE-144410
#preflight 62b243c5de72d4f6b34d0252
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20770298 via CL 20770311 via CL 20770320
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v970-20704180)
[CL 20770736 by devin doucette in ue5-main branch]
2022-06-22 01:40:12 -04:00
devin doucette
adb41a4dbd
DDC: Added cache replay functionality
...
A cache replay can be created from any program that uses the cache, and can be replayed through any cache graph in any program that uses the cache.
Save a cache replay by adding -DDC-ReplaySave=PathToReplay.ddr to the command line, and compress when saving by adding -DDC-ReplayCompress to reduce replay size by approximately 85%.
Load a cache replay by adding -DDC-ReplayLoad=PathToReplay.ddr to the command line one or more times.
- Modify the cache priority on loaded replays with -DDC-ReplayLoadPriority=Priority.
- For example, -DDC-ReplayLoadPriority=Lowest will queue replayed requests to execute asynchronously.
- Modify the cache policy on loaded replays with -DDC-ReplayLoadAddPolicy=CachePolicy and -DDC-ReplayLoadRemovePolicy=CachePolicy.
- For example, -DDC-ReplayLoadAddPolicy=SkipData will make the replay prefetch into the cache stores earlier in the cache hierarchy.
- For example, -DDC-ReplayLoadRemovePolicy=QueryLocal will make the replay query only remote cache stores.
Filter save or load operations by combining these arguments:
-DDC-ReplayMethods=Get+GetValue+GetChunks will only process requests of the corresponding methods.
-DDC-ReplayTypes=Type1[[at]Rate1][+Type2[[at]Rate2]...] will only process requests of the corresponding types.
-DDC-ReplayRate=Rate will only process Rate% of the requests that do not match one of the type filters.
-DDC-ReplaySalt=Salt configures the salt used to filter by type and rate, which makes them match consistently between sessions instead of being random.
Load a cache replay with the console command: DDC.LoadReplay ReplayPath [Priority=PriorityName]
#jira UE-144410
#rb Zousar.Shaker
#ROBOMERGE-OWNER: devin.doucette
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20741874 via CL 20745226 via CL 20745737
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v970-20704180)
[CL 20751395 by devin doucette in ue5-main branch]
2022-06-20 23:40:37 -04:00
devin doucette
56ca40dda2
DDC: Fixed deprecation warnings in the Zen cache store
...
#jira UE-157180
#rb none
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20745126 via CL 20745729
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v970-20704180)
[CL 20751392 by devin doucette in ue5-main branch]
2022-06-20 23:40:25 -04:00
devin doucette
6366a19bda
DDC: Added functions to serialize cache types to and from compact binary, and strings where appropriate
...
#rb Zousar.Shaker
#ROBOMERGE-OWNER: devin.doucette
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20741868 via CL 20744192 via CL 20745275
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v970-20704180)
[CL 20751385 by devin doucette in ue5-main branch]
2022-06-20 23:40:01 -04:00
Zousar Shaker
def117e022
Ensure the connection pool size matches the total number of connections for the DDC HTTP implementation.
...
#rb none
#fyi devin.doucette
#rnx
#preflight 62b0c838640ffd8ee9ce8be5
[CL 20742724 by Zousar Shaker in ue5-main branch]
2022-06-20 15:32:20 -04:00
Zousar Shaker
0b361c7c46
Select maximum HTTP connections for ZenCacheStore based on logical core count (clamped between 8 and 64). Speculative solution for farm cooks using Zen experiencing "couldn't connect errors".
...
#rb trivial
#fyi devin.doucette
#rnx
#preflight 62b00bd92405dc6102315616
[CL 20734103 by Zousar Shaker in ue5-main branch]
2022-06-20 02:08:49 -04:00
devin doucette
3933b8f407
DDC: Added TryLoadFromCompactBinary for FCacheKey
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20705430 via CL 20705467 via CL 20705498
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v968-20684695)
[CL 20707645 by devin doucette in ue5-main branch]
2022-06-17 14:45:17 -04:00
steve robb
0edc9ec830
Some missing TEXT macros added.
...
#rb trivial
#jira UE-132142
#preflight none
#ROBOMERGE-AUTHOR: steve.robb
#ROBOMERGE-SOURCE: CL 20671620 via CL 20671646 via CL 20671659
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v955-20579017)
[CL 20675152 by steve robb in ue5-main branch]
2022-06-15 15:09:53 -04:00
steve robb
fd2a0b1e20
Removal of TEXT literal concatenations, which doesn't work in UTF-8 mode.
...
#rb devin.doucette
#jira UE-132142
#preflight 62a8748fa76c84377748036b
#ROBOMERGE-OWNER: steve.robb
#ROBOMERGE-AUTHOR: steve.robb
#ROBOMERGE-SOURCE: CL 20647443 via CL 20648283 via CL 20648315
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v955-20579017)
[CL 20651786 by steve robb in ue5-main branch]
2022-06-14 12:46:34 -04:00
devin doucette
a21cf2431c
DDC: Removed the legacy cache backend interface
...
#preflight 62a7a3dc0a2f58855e0af685
#rb Zousar.Shaker
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20646770 via CL 20646804 via CL 20646821
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v955-20579017)
[CL 20649216 by devin doucette in ue5-main branch]
2022-06-14 11:05:24 -04:00
devin doucette
f6f4dcd722
DDC: Added detail to the error when cache graph creation fails
...
#preflight skip
#rb Zousar.Shaker
#rnx
#ROBOMERGE-OWNER: devin.doucette
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20628288 via CL 20628340 via CL 20628354
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v955-20579017)
[CL 20636252 by devin doucette in ue5-main branch]
2022-06-13 18:36:59 -04:00
devin doucette
1d698f7814
DDC: Removed the remaining legacy cache implementations and made the default implementation non-virtual
...
#preflight 62a38afedf2d057cb2814ea4
#rb Steve.Robb
#rnx
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 20601122 via CL 20601125 via CL 20601130
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v955-20579017)
[CL 20602835 by devin doucette in ue5-main branch]
2022-06-10 17:21:00 -04:00
Zousar Shaker
ea6ad5fc8e
Change Zen cache store to issue non-blocking HTTP requests. GetChunks remains blocking because of the sequential nature of the way it consumes results. This can be changed in the future. Fixed a bug in the code for async POST operations to ensure it sets the post size appropriately.
...
This change requires a fix (in progress) to EditorDomain to avoid a deadlock.
#rb devin.doucette
#fyi stefan.boberg
#preflight 62a3619670680d6143dc5425
[CL 20598472 by Zousar Shaker in ue5-main branch]
2022-06-10 12:56:08 -04:00
Zousar Shaker
742cdfac66
Reduce HTTP connection limit from 32 to 8 for the DDC HTTP client.
...
#rb trivial
#rnx
#preflight 62a114563f1e313c6ada20c2
[CL 20565273 by Zousar Shaker in ue5-main branch]
2022-06-08 17:47:30 -04:00
devin doucette
539d11284b
DDC: Fixed the pak file cache IsWritable function to take into account whether the file is closed
...
#jira UE-156101
#preflight skip
#rb Zousar.Shaker
#rnx
#ROBOMERGE-OWNER: Devin.Doucette
#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-COMMAND: _robomerge[bot4] UE5-MAIN
#ROBOMERGE-SOURCE: CL 20558509 via CL 20558581 via CL 20558624
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v954-20466795)
[CL 20558669 by devin doucette in ue5-main branch]
2022-06-08 12:40:43 -04:00