Commit Graph

13738 Commits

Author SHA1 Message Date
Yuriy ODonnell
6a5ed1dc98 UnsyncUI - Fix slow expansion of completed job logs, bump version to 1.0.9
#preflight skip
#rb Luke.Thatcher

[CL 19590429 by Yuriy ODonnell in ue5-main branch]
2022-04-01 12:41:42 -04:00
Ben Marsh
151e320a17 C#: Add a SemVer class for parsing and comparing version strings (https://semver.org/).
#preflight none

[CL 19589975 by Ben Marsh in ue5-main branch]
2022-04-01 12:16:34 -04:00
Ben Marsh
a85b6291cf Horde: Support for declaratively specifying indexes for Horde collections, which will be created/removed asynchronously by the server.
- MongoService.GetCollection() has an overload that takes a list of indexes.
- A background task will add and remove indexes to the collection to ensure that this list of indexes is reflected in the database.
- A shared Redis lock is acquired to ensure only one server instance can upgrade collections at a time.
- The application version is now expected to be in SemVer format, and is saved into a singleton document whenever an upgrade is made. Upgrades are only performed if the current server version is greater or equal to the value stored here, in order to prevent servers of different versions trying to perform conflicting operations.

#preflight none
#fyi Carl.Bystrom, Josh.Engebretson

[CL 19589738 by Ben Marsh in ue5-main branch]
2022-04-01 12:04:32 -04:00
Yuriy ODonnell
9967857a91 UnsyncUI - Fix virtualization of the log control, fixes performance issue when processing a large number of log lines
#rb Luke.Thatcher
#preflight skip

[CL 19587529 by Yuriy ODonnell in ue5-main branch]
2022-04-01 09:41:38 -04:00
Ben Marsh
73cac3a2ee Horde: Add EpicGames.Core.Tests to Horde solution.
#preflight none

[CL 19587238 by Ben Marsh in ue5-main branch]
2022-04-01 09:28:43 -04:00
kerim borchaev
08b9a635f7 [3ds Max] DirectLink: diagnostics info
- added statistics about exported/sysced scene - nodes, materials, textures

#jira none
#preflight 6246d786dc6183e3f517c45a
#rb none
#fyi antoine.guillo

[CL 19586305 by kerim borchaev in ue5-main branch]
2022-04-01 06:56:55 -04:00
Joakim Lindqvist
c8329afaf3 Horde Storage - Fix for failing tests (null access then resolving parent dd context which didnt exist)
#preflight none

[CL 19585810 by Joakim Lindqvist in ue5-main branch]
2022-04-01 05:27:56 -04:00
Joakim Lindqvist
dad527a559 Horde Storage - Removed the remaining top level scopes for long running tasks as memory usage for datadog tracing is still to large.
#preflight none

[CL 19585678 by Joakim Lindqvist in ue5-main branch]
2022-04-01 05:01:11 -04:00
Joakim Lindqvist
b4cf671d76 Horde Storage - Made the random start offset for polling service optional and removed it for most services (it doesnt add much for them and makes it harder to reason about when they should start).
Kept it for leader election and replication as these will hit external services and thus all starting at the same time causes unhealth spikes.

#preflight none

[CL 19585648 by Joakim Lindqvist in ue5-main branch]
2022-04-01 04:59:48 -04:00
Joakim Lindqvist
ec70146444 Horde Storage - Improved name for the blob store consistency scope in datadog
#preflight none

[CL 19585647 by Joakim Lindqvist in ue5-main branch]
2022-04-01 04:59:34 -04:00
Ryan Hummer
e4945b7f53 Clarify error message when scanning temp storage for cleanup
#rnx
#jira none
#rb none
#preflight skip

[CL 19579046 by Ryan Hummer in ue5-main branch]
2022-03-31 17:23:08 -04:00
Ben Marsh
6d7c768fd5 Horde: Rename DatabaseService to MongoService for clarity, and symmetry with RedisService.
#preflight none

[CL 19579021 by Ben Marsh in ue5-main branch]
2022-03-31 17:22:28 -04:00
Tim Smith
26ea2c1d51 Updated the exporter system in UHT to simplify it.
Added some basic support for UBT plugins.

#rb trivial
#rnx
#preflight 6245f7123a5a4c1622d2b55a

[CL 19576500 by Tim Smith in ue5-main branch]
2022-03-31 15:01:31 -04:00
jonathan adamczewski
38fae5272b UnrealBuildTool: Use module's ShortName for code generation directory to help avoid overly long paths
Before:
Intermediate/Build/Win64/UnrealEditor/Inc/MaterialShaderQualitySettings/

After:
Intermediate/Build/Win64/UnrealEditor/Inc/MSQS/

#jira none
#rb tim.smith
#rb markus.breyer
#rb joe.kirchoff
#rb ben.marsh
#rnx
#preflight 6244f495dc6183e3f5fc1bfe

[CL 19576163 by jonathan adamczewski in ue5-main branch]
2022-03-31 14:39:37 -04:00
Jerome Delattre
93a0f48bd8 Using System.Text.Json for Device reservation instead of fastJSON and making the deserialization not case sensitive
#rb Josh.Engebretson, Chris.Constantinescu
#preflight 62434b28292f228e09e53f10
#rnx
#jira none

[CL 19575272 by Jerome Delattre in ue5-main branch]
2022-03-31 13:43:17 -04:00
vincent robert
4d17f6a306 Fix Vectorized Raycast unit test
#preflight https://horde.devtools.epicgames.com/job/6245df43927e60e341683d72

[CL 19574972 by vincent robert in ue5-main branch]
2022-03-31 13:22:45 -04:00
Ben Marsh
9257fcadfe Horde: Fix incorrect field being indexed for audit log queries.
#preflight none

[CL 19571847 by Ben Marsh in ue5-main branch]
2022-03-31 09:32:19 -04:00
Joakim Lindqvist
1a6126b32c Horde Storage - Fixed issue were consistency checks were only being run on legacy namespaces (that doesnt need consistency checks).
Also added some more tags to the DD scopes to better filter out operations that are of intrest

#preflight none

[CL 19571808 by Joakim Lindqvist in ue5-main branch]
2022-03-31 09:26:18 -04:00
Joakim Lindqvist
0b42edefbe Horde Storage - Removed top level datadog scopes for long running tasks, this causes a fairly signficant build up of scopes that are not flushed until this long running task is completed. That both uses a lot of memory and makes the monitoring a bit useless as you dont really get the results until its finished. It is useful to be able to group all operations together on when they were triggered though, but not useful enough for the cost.
I did keep the top level scope for replication as we do use that quite frequently to understand what the replicators are doing.

#preflight none

[CL 19571388 by Joakim Lindqvist in ue5-main branch]
2022-03-31 08:19:13 -04:00
mark lintott
bc9b168688 Add new Unit Tests
#rb Chris.Constantinescu
#preflight 62458f77292f228e09013681

[CL 19571202 by mark lintott in ue5-main branch]
2022-03-31 07:45:37 -04:00
Joakim Lindqvist
f9e99a0d06 Horde Storage - Do not track all refs that got deleted as we do not really use that anyway, avoids unnesscary memory build up in prod.
#preflight none

[CL 19570680 by Joakim Lindqvist in ue5-main branch]
2022-03-31 05:28:18 -04:00
Joakim Lindqvist
995b4a2090 Horde Storage - Exists checks for the compressed blobs endpoints now always returns a needs list if anything is missing, this avoids exposing internal implementation details in how the blobs are stored inside Horde Storage.
#preflight none

[CL 19570543 by Joakim Lindqvist in ue5-main branch]
2022-03-31 04:48:29 -04:00
PJ Kack
640a176fd5 UAT: Ctrl-c exit fixes.
In ProcessManager.KillAll() make a local copy of global ActiveProcesses and to avoid calling any external code while iterating the internal global list.
In ProcessResult.StopProcess() make sure to set the ExitCode member from the killed process, else the information is lost forever since the member Proc has already been nulled out.
In CommandUtils.Run() check Result.ProcessObject for null for the case when WaitForExit() returns after StopProcess() has been called from another thread (ctrl-c handler).

#jira none
#rb carlmagnus.nordin
#rnx
#preflight 62441c4dc667881bf4e70722

[CL 19570185 by PJ Kack in ue5-main branch]
2022-03-31 03:25:13 -04:00
jonathan adamczewski
e4e24758f8 IncludeTool: add UE_INCLUDETOOL_IGNORE_INCONSISTENT_STATE as a way to turn off warnings about inconsistent state, from code, in IncludeTool
#define UE_INCLUDETOOL_IGNORE_INCONSISTENT_STATE

... warning is ignored

#undef UE_INCLUDETOOL_IGNORE_INCONSISTENT_STATE

#jira none
#rb steve.robb
#rnx
#preflight 6244e0ac927e60e3415bf13f

[CL 19566668 by jonathan adamczewski in ue5-main branch]
2022-03-30 19:34:21 -04:00
cedric caillaud
a3bd67e2d1 Chaos : Fix edge case where sweeping elements in the hashed grid can lead to an infinite loop
- also provided an optimized path for mostly vertical sweeps

#rb vincent.robert
#jira none
#p4v-cherrypick 19559782
#preflight 6244bdd2c51908059ab103ea

[CL 19564626 by cedric caillaud in ue5-main branch]
2022-03-30 17:17:06 -04:00