Commit Graph

13745 Commits

Author SHA1 Message Date
Ben Marsh
faeb37fd20 Horde: Add a basic executor that will extract data from a bundle.
Also add matching grpc wrapper types for namespace, bucket and ref identifiers.

#preflight none

[CL 19598907 by Ben Marsh in ue5-main branch]
2022-04-01 22:37:15 -04:00
Yuriy ODonnell
72e1903d39 unsync - Change the target name to use all lower-case letters
#rb none
#preflight skip

[CL 19598176 by Yuriy ODonnell in ue5-main branch]
2022-04-01 19:58:52 -04:00
Joe Kirchoff
58d330a938 UnrealBuildTool: Clean up ParallelExecutor to not require waiting manually on prereq actions by building a continuation tree of async tasks
Split logic into multiple static functions and make protected so it can be shared with an inherited class

#rnx
#rb Jonathan.Adamczewski
#preflight 62473274637925b5d3e0f1f3

[CL 19596364 by Joe Kirchoff in ue5-main branch]
2022-04-01 17:49:28 -04:00
Joe Kirchoff
d0487689bf UnrealBuildTool: Relative pathing for Mac & Linux toolchains
#rb trivial
#rnx
#preflight 62474481f4217035fa9db83d

[CL 19593260 by Joe Kirchoff in ue5-main branch]
2022-04-01 14:56:46 -04:00
Ben Marsh
a9b40be665 Horde: Retry queries that fail due to a hinted index not existing. Now that we create and update indexes asynchronously, we may fail requests while doing so.
#preflight none

[CL 19591837 by Ben Marsh in ue5-main branch]
2022-04-01 13:47:12 -04:00
Joe Kirchoff
178dbc01d2 UnrealBuildTool: Respect -NoPCH flag in mac toolchain
#rb trivial
#rnx
#preflight skipped

[CL 19591629 by Joe Kirchoff in ue5-main branch]
2022-04-01 13:37:20 -04:00
Patrick Boutot
ac1b5333fa UHT: Support enum namespace as accessor type
#preflight 624732d2c61d8a458f615f71

[CL 19591307 by Patrick Boutot in ue5-main branch]
2022-04-01 13:25:05 -04:00
Yuriy ODonnell
6a5ed1dc98 UnsyncUI - Fix slow expansion of completed job logs, bump version to 1.0.9
#preflight skip
#rb Luke.Thatcher

[CL 19590429 by Yuriy ODonnell in ue5-main branch]
2022-04-01 12:41:42 -04:00
Ben Marsh
151e320a17 C#: Add a SemVer class for parsing and comparing version strings (https://semver.org/).
#preflight none

[CL 19589975 by Ben Marsh in ue5-main branch]
2022-04-01 12:16:34 -04:00
Ben Marsh
a85b6291cf Horde: Support for declaratively specifying indexes for Horde collections, which will be created/removed asynchronously by the server.
- MongoService.GetCollection() has an overload that takes a list of indexes.
- A background task will add and remove indexes to the collection to ensure that this list of indexes is reflected in the database.
- A shared Redis lock is acquired to ensure only one server instance can upgrade collections at a time.
- The application version is now expected to be in SemVer format, and is saved into a singleton document whenever an upgrade is made. Upgrades are only performed if the current server version is greater or equal to the value stored here, in order to prevent servers of different versions trying to perform conflicting operations.

#preflight none
#fyi Carl.Bystrom, Josh.Engebretson

[CL 19589738 by Ben Marsh in ue5-main branch]
2022-04-01 12:04:32 -04:00
Yuriy ODonnell
9967857a91 UnsyncUI - Fix virtualization of the log control, fixes performance issue when processing a large number of log lines
#rb Luke.Thatcher
#preflight skip

[CL 19587529 by Yuriy ODonnell in ue5-main branch]
2022-04-01 09:41:38 -04:00
Ben Marsh
73cac3a2ee Horde: Add EpicGames.Core.Tests to Horde solution.
#preflight none

[CL 19587238 by Ben Marsh in ue5-main branch]
2022-04-01 09:28:43 -04:00
kerim borchaev
08b9a635f7 [3ds Max] DirectLink: diagnostics info
- added statistics about exported/sysced scene - nodes, materials, textures

#jira none
#preflight 6246d786dc6183e3f517c45a
#rb none
#fyi antoine.guillo

[CL 19586305 by kerim borchaev in ue5-main branch]
2022-04-01 06:56:55 -04:00
Joakim Lindqvist
c8329afaf3 Horde Storage - Fix for failing tests (null access then resolving parent dd context which didnt exist)
#preflight none

[CL 19585810 by Joakim Lindqvist in ue5-main branch]
2022-04-01 05:27:56 -04:00
Joakim Lindqvist
dad527a559 Horde Storage - Removed the remaining top level scopes for long running tasks as memory usage for datadog tracing is still to large.
#preflight none

[CL 19585678 by Joakim Lindqvist in ue5-main branch]
2022-04-01 05:01:11 -04:00
Joakim Lindqvist
b4cf671d76 Horde Storage - Made the random start offset for polling service optional and removed it for most services (it doesnt add much for them and makes it harder to reason about when they should start).
Kept it for leader election and replication as these will hit external services and thus all starting at the same time causes unhealth spikes.

#preflight none

[CL 19585648 by Joakim Lindqvist in ue5-main branch]
2022-04-01 04:59:48 -04:00
Joakim Lindqvist
ec70146444 Horde Storage - Improved name for the blob store consistency scope in datadog
#preflight none

[CL 19585647 by Joakim Lindqvist in ue5-main branch]
2022-04-01 04:59:34 -04:00
Ryan Hummer
e4945b7f53 Clarify error message when scanning temp storage for cleanup
#rnx
#jira none
#rb none
#preflight skip

[CL 19579046 by Ryan Hummer in ue5-main branch]
2022-03-31 17:23:08 -04:00
Ben Marsh
6d7c768fd5 Horde: Rename DatabaseService to MongoService for clarity, and symmetry with RedisService.
#preflight none

[CL 19579021 by Ben Marsh in ue5-main branch]
2022-03-31 17:22:28 -04:00
Tim Smith
26ea2c1d51 Updated the exporter system in UHT to simplify it.
Added some basic support for UBT plugins.

#rb trivial
#rnx
#preflight 6245f7123a5a4c1622d2b55a

[CL 19576500 by Tim Smith in ue5-main branch]
2022-03-31 15:01:31 -04:00
jonathan adamczewski
38fae5272b UnrealBuildTool: Use module's ShortName for code generation directory to help avoid overly long paths
Before:
Intermediate/Build/Win64/UnrealEditor/Inc/MaterialShaderQualitySettings/

After:
Intermediate/Build/Win64/UnrealEditor/Inc/MSQS/

#jira none
#rb tim.smith
#rb markus.breyer
#rb joe.kirchoff
#rb ben.marsh
#rnx
#preflight 6244f495dc6183e3f5fc1bfe

[CL 19576163 by jonathan adamczewski in ue5-main branch]
2022-03-31 14:39:37 -04:00
Jerome Delattre
93a0f48bd8 Using System.Text.Json for Device reservation instead of fastJSON and making the deserialization not case sensitive
#rb Josh.Engebretson, Chris.Constantinescu
#preflight 62434b28292f228e09e53f10
#rnx
#jira none

[CL 19575272 by Jerome Delattre in ue5-main branch]
2022-03-31 13:43:17 -04:00
vincent robert
4d17f6a306 Fix Vectorized Raycast unit test
#preflight https://horde.devtools.epicgames.com/job/6245df43927e60e341683d72

[CL 19574972 by vincent robert in ue5-main branch]
2022-03-31 13:22:45 -04:00
Ben Marsh
9257fcadfe Horde: Fix incorrect field being indexed for audit log queries.
#preflight none

[CL 19571847 by Ben Marsh in ue5-main branch]
2022-03-31 09:32:19 -04:00
Joakim Lindqvist
1a6126b32c Horde Storage - Fixed issue were consistency checks were only being run on legacy namespaces (that doesnt need consistency checks).
Also added some more tags to the DD scopes to better filter out operations that are of intrest

#preflight none

[CL 19571808 by Joakim Lindqvist in ue5-main branch]
2022-03-31 09:26:18 -04:00