Commit Graph

20164 Commits

Author SHA1 Message Date
carl bystrom
524cd70dbb Horde: Implement termination signal file for agent workloads
Once an impending termination of the agent machine is detected, this file is written to disk to let any workload get an early warning of what is about to happen.
A workload can detect and read this file supplied via an environment variable and take action.

[CL 27556893 by carl bystrom in ue5-main branch]
2023-09-01 11:41:02 -04:00
lorry li
a73b702986 Fix the warning in new test case when validate retry manager thread safety;
Fix the warning when the request didn't get removed from http manager when test.

#jira UE-182678
[REVIEW] [at]stephen.ma [at]michael.kirzinger
#rb [at]stephen.ma

[CL 27554811 by lorry li in ue5-main branch]
2023-09-01 10:24:00 -04:00
andrew phillips
5beb8632d7 Excluding syms dir from IncludeTools inspection.
#jira UE-194233

[CL 27553065 by andrew phillips in ue5-main branch]
2023-09-01 08:39:39 -04:00
carl bystrom
1da410920e Horde: Create a PerforceLogger when ManagedWorkspace is used in WorkspaceExecutor
[CL 27552883 by carl bystrom in ue5-main branch]
2023-09-01 08:23:04 -04:00
johan berg
60cb57a6e8 Fix directory listening for Linux
The file notification api was not told to listen to renames.

#jira UE-187620
#rb martin.ridgers

[CL 27550742 by johan berg in ue5-main branch]
2023-09-01 05:05:16 -04:00
zousar shaker
8c75ff393b ZenDashboard refresh to add project stats and clean up reporting of disk size.
#rb dan.engelbrecht

[CL 27546624 by zousar shaker in ue5-main branch]
2023-08-31 22:30:53 -04:00
Josh Adams
a5cb0c6321 - Disallow BaseSourceControlSettings.ini from being staged
#rb trivial

[CL 27546375 by Josh Adams in ue5-main branch]
2023-08-31 22:14:27 -04:00
Ben Marsh
d1c21a3c96 Horde: Fix duplicate "issue not resolved" notifications. Using the first failure time can cause inconsistencies when issues are merged, causing the base time for notifications to change. Always use the issue creation time instead.
#jira UE-173887

[CL 27544049 by Ben Marsh in ue5-main branch]
2023-08-31 19:25:39 -04:00
Ben Marsh
ac30c8879f Horde: Reduce memory usage when reading bundles.
[CL 27543073 by Ben Marsh in ue5-main branch]
2023-08-31 18:56:13 -04:00
yuriy odonnell
7a75fdfe69 unsync - Trim old cached manifest files during sync
#rb none

[CL 27541251 by yuriy odonnell in ue5-main branch]
2023-08-31 18:07:30 -04:00
yuriy odonnell
01b2df4dba unsync - Add quick login option
* Skip remote token validation in --quick mode, just check expiry locally

#rb none

[CL 27538554 by yuriy odonnell in ue5-main branch]
2023-08-31 17:15:46 -04:00
joe pribele
63997289e7 fix for UHT allowing TObjectPtr<SomeInterface>
the dectection of using Native Pointer for member instead of TObjecPtr was swalling the error for interface
#rb zousar.shaker

[CL 27536768 by joe pribele in ue5-main branch]
2023-08-31 16:39:19 -04:00
yuriy odonnell
8c7bdecb04 unsync - Add support for direct manifest download from proxy server (bypassing SMB)
* Add --login flag to sync command
* Add in-process token cache
* Add auth token when quering server features
* Use direct download path when supported by server

#jira UE-192913
#rb none

[CL 27535921 by yuriy odonnell in ue5-main branch]
2023-08-31 16:20:09 -04:00
Ben Marsh
1c3799d321 Horde: Increase coherency between tasks spawned for extracting bundles; now partitions the files to extract along window boundaries.
[CL 27535383 by Ben Marsh in ue5-main branch]
2023-08-31 16:03:38 -04:00
Ben Marsh
ba352e05af Horde: Add a custom StorageCache implementation rather than using IMemoryCache.
This creates separate arenas for different types of content, improving read performance due to header data being discarded, and also allows cache instances to be globally configured and injected via DI.

[CL 27528676 by Ben Marsh in ue5-main branch]
2023-08-31 13:35:03 -04:00
Ben Marsh
b56713f8e9 Horde: Add a stats option to bundle extract command, showing the number of headers and packets read. Also add strongly typed cache methods.
[CL 27524894 by Ben Marsh in ue5-main branch]
2023-08-31 11:44:52 -04:00
david harvey
f303e13746 Fix for TargetRules.ToolChainName instantiation failure
#jira UE-179187
#rnx
#rb Francis.Hurteau, Josh Adams

[CL 27524803 by david harvey in ue5-main branch]
2023-08-31 11:42:55 -04:00
carl bystrom
644a8789db Horde: Only enable EC2 lifecycle monitoring if metadata server is available
[CL 27520762 by carl bystrom in ue5-main branch]
2023-08-31 09:43:08 -04:00
carl bystrom
68389a3677 Horde: Only shut down agent if it's a spot instance
[CL 27520066 by carl bystrom in ue5-main branch]
2023-08-31 09:18:07 -04:00
carl bystrom
691f6efdfe Horde: Check for AWS EC2 interruptions and terminate the agent appropriately
In case of a spot interruption, there's a hard deadline of 2 minutes that must be adhered.

[CL 27519909 by carl bystrom in ue5-main branch]
2023-08-31 09:12:29 -04:00
Ben Marsh
71ee593230 Horde: Fix warning in CI.
[CL 27518903 by Ben Marsh in ue5-main branch]
2023-08-31 08:27:10 -04:00
lorry li
8dfb049f4c Fix the warnings in WebTests project:
- Set http log level to error if the warning logs are expected for specified tests;
- There is a warning about failing to delete file downloaded, because the file is still in use, close the file reader which verifies the file;
- There is a warning about failing to delete file uploaded, because the file is still in use. Now http upload request closes the file reader when complete.

#jira UE-182678
[REVIEW] [at]michael.kirzinger [at]stephen.ma [at]rafa.lecina
#rb [at]rafa.lecina

[CL 27510921 by lorry li in ue5-main branch]
2023-08-30 21:20:37 -04:00
saam barati
7157db4ca9 Don't allocate tuples unnecessarily for calls with multiple arguments
#rb markus.breyer

This patch makes it so calls with multiple arguments don't require a tuple allocation. We just allow functions to have multiple arguments and be called normally. However, when such functions are invoked with a tuple, we'll unbox the tuple into the argument slots.

We also allow functions with single-param-as-tuple to be invoked with multiple arguments. And such functions will box the arguments into a tuple when being called.

A function with N arguments now take up the first N register slots in the frame.

This patch also fills out some more of the bytecode generator to make some tests I wrote work.

[CL 27510491 by saam barati in ue5-main branch]
2023-08-30 20:56:02 -04:00
lorry li
3fc1d2becf Make sure progress callback can be called on http thread;
Make sure HttpManagerRequestAdded and HttpManagerRequestCompleted callback can be called on http thread.

From now on the delegates bind to http manager through SetRequestAddedDelegate and SetRequestCompletedDelegate have to be changed to be thread-safe.

#jira UE-182677
[REVIEW] [at]michael.atchison [at]michael.kirzinger [at]rafa.lecina [at]justin.marcus

[CL 27506980 by lorry li in ue5-main branch]
2023-08-30 18:56:04 -04:00
lorry li
b756c03676 Make http retry system thread safe.
[REVIEW] [at]michael.kirzinger [at]michael.atchison

[CL 27501211 by lorry li in ue5-main branch]
2023-08-30 17:27:56 -04:00