Commit Graph

15324 Commits

Author SHA1 Message Date
Josh Engebretson
3a85dbd033 Horde: Also make stream devices nullable for responses
#jira none
#rnx
#preflight none

[CL 21482837 by Josh Engebretson in ue5-main branch]
2022-08-22 09:56:59 -04:00
Josh Engebretson
e2ad264825 Horde: Optimize device pool telemetry storage and responses, added paging index/counts to controller/collection
#jira none
#rnx
#preflight none

[CL 21482702 by Josh Engebretson in ue5-main branch]
2022-08-22 09:45:33 -04:00
Joakim Lindqvist
891311c49e Horde Storage - Handle clients with limited bandwidth a bit better - essentially we detect cases caused by limited bandwidth when receiving data and throwing a custom exception (resulting in 408 request timed out) as to avoid a 500 issues. Users should just retry this when they have enough bandwidth available.
#preflight none

[CL 21482687 by Joakim Lindqvist in ue5-main branch]
2022-08-22 09:38:57 -04:00
Joakim Lindqvist
48ee94ee0b Horde Storage - Error endpoint will no longer produce errors for aborted health checks (as this is handled case within the health checks themselves).
This can happen if you've configured multiple things to probe the same health checks (or the system doing health checks simply overlaps two of them as can happen in kubernetes)

#preflight none

[CL 21482569 by Joakim Lindqvist in ue5-main branch]
2022-08-22 09:29:38 -04:00
carl bystrom
a450e5379d Horde: Add missing start/stop trigger for new high-frequency ticking of auto-scaling
#preflight none

[CL 21482068 by carl bystrom in ue5-main branch]
2022-08-22 08:19:44 -04:00
carl bystrom
aff27f8425 Horde: Run certain pool sizing strategies more frequently
Some strategies, such as the one for auto-scaling compute tasks need to be much more reactive.
#preflight 63036f7ca45b007ea23bad98

[CL 21481960 by carl bystrom in ue5-main branch]
2022-08-22 08:01:17 -04:00
carl bystrom
cf05eee08e Horde: Fix warnings in EpicGames.Slack
Also changed to run analyzers during build. When referencing this library from a project that does run analyzers, it failed.
Likely is for the better to enforce that here as well.

#preflight none

[CL 21481937 by carl bystrom in ue5-main branch]
2022-08-22 07:58:13 -04:00
Joakim Lindqvist
674c375883 Horde Storage - Remove blob from blob index when the last region it existed in is being removed.
#preflight none

[CL 21481380 by Joakim Lindqvist in ue5-main branch]
2022-08-22 06:36:20 -04:00
Joakim Lindqvist
1cf49a6f02 Horde Storage - Made missing fields a warning rather then a error, its a safe issue when it happens (which is due to a race condition between update the last access time of a reference and deleting it)
#preflight none

[CL 21481363 by Joakim Lindqvist in ue5-main branch]
2022-08-22 06:34:42 -04:00
Joakim Lindqvist
20f1544549 Horde Storage - Finalize errors now return 400 rather then 500s. Its still a error caused by bad cache keys from the cooker - but as its so tricky to fix properly in the cooker we will have these arounds for a long time and such its better to use 400 to indicate its a known type of error
#preflight none

[CL 21481358 by Joakim Lindqvist in ue5-main branch]
2022-08-22 06:34:04 -04:00
Joakim Lindqvist
198039ae8e Horde Storage - Improved error handling when blobs are missing when attempting to replicate them during blob index consistency checks.
#preflight none

[CL 21481350 by Joakim Lindqvist in ue5-main branch]
2022-08-22 06:33:16 -04:00
Joakim Lindqvist
1ae50756cf Horde Storage - Fixed issue were orphan blob cleanup would extend life time of refs by updating their last access time
#preflight none

[CL 21481345 by Joakim Lindqvist in ue5-main branch]
2022-08-22 06:32:48 -04:00
dmytro vovk
872d58122a Removed Android NDK25 AGDE debugger workaround as AGDE canary v69 resolved this issue
#jira none
#rb trivial
#preflight 63021421c85b7fef2223cab2

[CL 21476879 by dmytro vovk in ue5-main branch]
2022-08-21 08:57:38 -04:00
Ben Marsh
a1e75aba32 Horde: Allow marking issues as fixed/acknowledged directly from Slack. Uses modal API to prompt for confirmation. Also includes refactored Slack library.
#preflight none

[CL 21468956 by Ben Marsh in ue5-main branch]
2022-08-19 20:03:39 -04:00
dmytro vovk
90538d6cd6 Fixed compilation
#rb trivial

[CL 21467662 by dmytro vovk in ue5-main branch]
2022-08-19 19:19:00 -04:00
dmytro vovk
5bad8f37b7 Removed legacy Android Project Settings
#rb Chris.Babcock

[CL 21467626 by dmytro vovk in ue5-main branch]
2022-08-19 19:18:13 -04:00
dmytro vovk
a24bd82b4c Cleaned up dublicated compiler flag in Android Toolchain
#rb Chris.Babcock

[CL 21467523 by dmytro vovk in ue5-main branch]
2022-08-19 19:16:00 -04:00
paul chipchase
fc827406e2 Add a number of ways for the VA system to be changed to lazy initialize on first use.
#rb Per.Larsson
#jira UE-161296
#rnx
#preflight 62fe3ce73d3fb466b229bcc0

- There are some usecases that require the VA system to initialize the first time it is accessed (usually the first time we attempt to pull a virtualized payload) rather than be initialized in the program start up. This change provides three different methods to achieve this:
-- Setting the define 'UE_VIRTUALIZATION_SYSTEM_LAZY_INIT' to 1 in a programs .target.cs
-- Setting [Core.ContentVirtualization]LazyInit=true in the Engine ini file
-- Running with the commandline option -VA-LazyInit

- If we detect that the source control backend is being initialized on a background thread we do not try to run the FConnect operation. The backend will still work but this does reduce the potential error checking on initialization. This is done because the FConnect operation currently only works on the main thread and to change this would be a bigger work item than we can schedule at the moment.
- UE::Virtualization::Initialize functions now take a EInitializationFlags enum as a parameter. This enum allows the call to ignore all lazy init settings and force the initialization immediately. This is useful for programs like the Virtualization standalone tool which just needs to start the system when needed.
-- The call to ::Initialize in LaunchEngineLoop passes in None and does not ignore lazy initialization.
-- Calls to ::Initialize in the UnrealVirtualizationTool however all use EInitializationFlags::ForceInitialize and ignore lazy initialization settings.
- Fixed an odd bug in UE::Virtualization::Initialize where the error path (if the config file cannot be found) was using a different start up code path.
- Add asserts when assigning to GVirtualizationSystem to make sure that it is null. This is not 100% safe but should catch some potential threading issues, if any.
- Add an assert after lazy initialization (IVirtualizationSystem::Get) to make sure that GVirtualizationSystem was assigned a valid object.
- Improve how we check for legacy values in [Core.ContentVirtualization]. We now support multiple allowed values.
- Added a way to poll if a VA system has been initialize yet or not, this allows us to avoid initializing a VA system if one has not yet been created and we try to:
-- Dump VA profiling stats after cooking
-- Send VA stats to studio analytics
- Note that currently using lazy init loading will probably cause the VA statistics panel not to work, this will be fixed in future work where we will allow the panel to register for a callback when the system is initialized.

[CL 21467510 by paul chipchase in ue5-main branch]
2022-08-19 19:15:42 -04:00
Zousar Shaker
fa14a019ff 2nd submit:
Remove special case handling of engine plugins in UHT for ObjectPtr behavior.

#rb none
#preflight 62ffc2690f7187ef8112f23f

[CL 21466661 by Zousar Shaker in ue5-main branch]
2022-08-19 18:04:34 -04:00
vincent robert
036ecefa3d Add unit test for Height Field
#preflight 62ffe0c6d92373e7a62656d4

[CL 21462588 by vincent robert in ue5-main branch]
2022-08-19 15:18:29 -04:00
Zousar Shaker
7b3840b9b2 [Backout] - CL21460034
#fyi Zousar.Shaker
Original CL Desc
-----------------------------------------------------------------
Remove special case handling of engine plugins in UHT for ObjectPtr behavior.

#rb none
#preflight 62ffc2690f7187ef8112f23f

[CL 21461028 by Zousar Shaker in ue5-main branch]
2022-08-19 13:57:01 -04:00
bryan sefcik
9feb0e9764 Added a mode that prints out useful build graph info.
#jira
#rb tim.smith
#preflight 62ffc2b8fa1ac183e590874b

[CL 21460072 by bryan sefcik in ue5-main branch]
2022-08-19 13:11:54 -04:00
Zousar Shaker
20bdfad92d Remove special case handling of engine plugins in UHT for ObjectPtr behavior.
#rb none
#preflight 62ffc2690f7187ef8112f23f

[CL 21460034 by Zousar Shaker in ue5-main branch]
2022-08-19 13:10:17 -04:00
Josh Engebretson
f91248bd7b Horde: Fix stream device telemetry as mongo doesn't supported dotted names in keys
#rnx
#preflight none

[CL 21459546 by Josh Engebretson in ue5-main branch]
2022-08-19 12:46:42 -04:00
Josh Engebretson
ee92cb2463 Horde: Add span tracking to device service tick and some additional logging
#jira none
#rnx
#preflight none

[CL 21457976 by Josh Engebretson in ue5-main branch]
2022-08-19 11:21:05 -04:00