UnrealBot
73409369c0
Branch snapshot for CL 21319338
...
[CL 21319338 in ue5-main branch]
2022-08-10 16:03:37 +00:00
carl bystrom
0329efe1ae
Horde: Improve fleet manager for ephemeral/terminating EC2 instances
...
* Specifies which pool to join for the user-data/cloud-init script to pick up
* Allows both name and ARN based instance profiles to be specified
* Properly encodes user-data as base64
* Passes in credentials in constructor for easier testing (e.g read credentials from default $HOME/.aws location)
* Upgrade of NuGet packages required to get the new InstanceMetadataOptionsRequest
#preflight 62f3cb4db43215cf6c283946
[CL 21319081 by carl bystrom in ue5-main branch]
2022-08-10 11:18:56 -04:00
Ben Marsh
8ab520d6e0
Horde: Fix build error.
...
#preflight none
[CL 21317393 by Ben Marsh in ue5-main branch]
2022-08-10 09:43:47 -04:00
Ben Marsh
689fbf269b
Horde: Perforce replication improvements.
...
* Sync state is periodically flushed, and stored with an optimized list of paths to conform a workspace back to the same state.
* Writes are automatically queued to run asynchrnously once a bundle of data is ready to be stored, rather than clients having to trigger a write.
* BundleStore supports different contexts for different reads, to prevent hashed blobs being merged together when reading from different sources.
#rb none
#preflight none
[CL 21293876 by Ben Marsh in ue5-main branch]
2022-08-09 14:07:21 -04:00
carl bystrom
86d53262a2
Horde: Use a connection pool for all Redis commands
...
Only expose ConnectionPool from RedisService to avoid using Database or ConnectionMultiplexer directly.
#preflight 62f2661d3b773d041627aad0
[CL 21286130 by carl bystrom in ue5-main branch]
2022-08-09 09:55:46 -04:00
Joakim Lindqvist
0586dcab92
Horde Storage - Handle lastAccessTime not being set when enumerating all records
...
#preflight none
[CL 21283204 by Joakim Lindqvist in ue5-main branch]
2022-08-09 07:58:09 -04:00
Joakim Lindqvist
6800070c3b
Horde Storage - Missing file when adding content id store cache
...
#preflight none
[CL 21282744 by Joakim Lindqvist in ue5-main branch]
2022-08-09 06:13:37 -04:00
carl bystrom
55b2602037
Horde: Add tracing to storage backends
...
#preflight 62f23203e60c9215b92d026d
[CL 21282739 by carl bystrom in ue5-main branch]
2022-08-09 06:12:44 -04:00
Joakim Lindqvist
9f91458674
Horde Storage - Added cached content id store and fixed issue were we were resolving content ids twice when resolving references. This should saves us between 1 and 4ms per ref GET.
...
#preflight none
[CL 21282640 by Joakim Lindqvist in ue5-main branch]
2022-08-09 05:47:29 -04:00
Josh Engebretson
b50a73bd28
Horde: Update to use TypeScript 4.7.4 (from 4.1.3)
...
#jira UE-160413
#skipci
#rnx
#preflight none
[CL 21270012 by Josh Engebretson in ue5-main branch]
2022-08-08 12:13:27 -04:00
Joakim Lindqvist
e4dba54a05
Horde Storage - Make sure to re-trigger ref cleanups on each poll (but not start new ones if one is pending). As some namespaces take much longer then others to run this makes sure they will all get triggered without having to wait for the slowest one.
...
#preflight none
[CL 21268615 by Joakim Lindqvist in ue5-main branch]
2022-08-08 10:33:54 -04:00
Ben Marsh
5689db1605
Horde: Make BundleStore writes thread safe, improving replication performance.
...
#preflight none
[CL 21235612 by Ben Marsh in ue5-main branch]
2022-07-25 08:11:39 -04:00
Ben Marsh
b7fbbfa4e7
Horde: Additional stats timers for replication.
...
#preflight none
[CL 21210257 by Ben Marsh in ue5-main branch]
2022-07-21 17:22:53 -04:00
Ben Marsh
28a21fd29f
Horde: Add stats for time spent processing sync output to log.
...
#preflight none
[CL 21209629 by Ben Marsh in ue5-main branch]
2022-07-21 16:52:39 -04:00
Ben Marsh
bc71da211b
Horde: Respect case sensitivity of server when grouping files for content syncing.
...
#preflight none
[CL 21201670 by Ben Marsh in ue5-main branch]
2022-07-21 11:38:04 -04:00
Ben Marsh
fcd6d1d5d4
Horde: Create a separate service for replicating commit content to metadata.
...
#preflight none
[CL 21201444 by Ben Marsh in ue5-main branch]
2022-07-21 11:17:17 -04:00
Ben Marsh
ec0d448fff
Horde: Fix mismatched condition for stopping replication.
...
#preflight none
[CL 21179568 by Ben Marsh in ue5-main branch]
2022-07-20 10:43:45 -04:00
Ben Marsh
4f374ff906
Horde: Increase maximum sync batch size to 10gb.
...
#preflight none
[CL 21179464 by Ben Marsh in ue5-main branch]
2022-07-20 10:37:32 -04:00
Ben Marsh
5e11d4d4c1
Horde: Additional logging to explain selection of sync filters.
...
#preflight none
[CL 21178899 by Ben Marsh in ue5-main branch]
2022-07-20 09:56:39 -04:00
Ben Marsh
5692365c61
Horde: Fix overlapping reservations for replication updates, causing multiple pods to replicate a stream at once.
...
#preflight none
[CL 21178762 by Ben Marsh in ue5-main branch]
2022-07-20 09:48:04 -04:00
Ben Marsh
d05b57e40c
Update the replication version number to force a full snapshot.
...
#preflight none
[CL 21178116 by Ben Marsh in ue5-main branch]
2022-07-20 08:57:09 -04:00
Ben Marsh
d2583e4969
Horde: Prevent partial sync data when an exception occurs during replication.
...
#preflight none
[CL 21177863 by Ben Marsh in ue5-main branch]
2022-07-20 08:36:50 -04:00
Ben Marsh
abffc54c2a
Horde: Fix incorrect deserialization of root commit nodes.
...
#preflight none
[CL 21168065 by Ben Marsh in ue5-main branch]
2022-07-19 18:09:00 -04:00
Ben Marsh
fa5364754e
Horde: Try using client name when flushing to improve performance.
...
#preflight none
[CL 21165751 by Ben Marsh in ue5-main branch]
2022-07-19 15:08:07 -04:00
Ben Marsh
4069fa108c
Horde: Include more useful stats for syncing operations.
...
#preflight none
[CL 21165074 by Ben Marsh in ue5-main branch]
2022-07-19 14:17:15 -04:00
