Commit Graph

348 Commits

Author SHA1 Message Date
joe kirchoff
bbf594f464 UnrealBuildTool: Fix bad merge in Log.cs
#rnx
#rb trivial

[CL 25398723 by joe kirchoff in ue5-main branch]
2023-05-09 20:42:16 -04:00
joe kirchoff
e1fc2e2872 Epicgames.Core: Move log backup to separate function
#rnx
#rb trivial

[CL 25398719 by joe kirchoff in ue5-main branch]
2023-05-09 20:42:01 -04:00
Ben Marsh
5c06f15dba Fix warning about public type without documentation.
#preflight none

[CL 25260322 by Ben Marsh in ue5-main branch]
2023-04-29 08:25:20 -04:00
Ben Marsh
06da47f8a3 EpicGames.Core: Add support for more expression types into the csproj parser to fix build error.
#preflight none

[CL 25249933 by Ben Marsh in ue5-main branch]
2023-04-28 21:50:11 -04:00
Tim Smith
1a617c5133 1) Added generic double buffer async file reader with the ability to specify buffer sizes.
2) Added the ability to directly set the IoHash in the file hasher
3) Modified the ComputeAsync hash method to provide a file size hint so it can default to a larger buffer size to improve performance.
4) Modified the ComputeAsync hash method to use the double buffer reader above.

#rb ben.marsh
#preflight 6438493a5a07ef375761ee35

[CL 25030313 by Tim Smith in ue5-main branch]
2023-04-13 15:02:03 -04:00
Ben Marsh
54a8275181 EpicGames.Core: Add a more descriptive error if unable to parse .csproj files.
#preflight none

[CL 25023824 by Ben Marsh in ue5-main branch]
2023-04-13 09:08:11 -04:00
bryan sefcik
badffe3f69 Reverted back to using the AsyncLocalScopeManager to manage the active span. This appears to be passing the tests I added.
Added another test for Parallel.ForEachAsync.

#preflight 6435ac93d03b1c87dd42103c

[CL 24996101 by bryan sefcik in ue5-main branch]
2023-04-11 15:15:56 -04:00
bryan sefcik
ec5c024a38 Removed test code.
#preflight none

[CL 24935115 by bryan sefcik in ue5-main branch]
2023-04-05 15:51:33 -04:00
bryan sefcik
602a5e2670 Added an unique GUID to the ID to make it unique between processes/runs. This is for Horde.
#preflight 642dc760ce01db47ace09efb

[CL 24934367 by bryan sefcik in ue5-main branch]
2023-04-05 15:21:38 -04:00
bryan sefcik
88d01bc6bb Sealed JsonTracer to fix static analysis issue.
#preflight 642d719889339023eb7845e9

[CL 24929388 by bryan sefcik in ue5-main branch]
2023-04-05 11:50:23 -04:00
bryan sefcik
4a6e69a369 Added more tests to the JsonTracer unit tests.
Fixed some potential issues where the parent or span id wasn't what was expected.

#preflight 642ce19c6a37fb35e963b474

[CL 24926420 by bryan sefcik in ue5-main branch]
2023-04-05 08:54:27 -04:00
bryan sefcik
e396637ca2 Updated JsonTracer to derive from IDisposable.
#preflight 642cbffcda7f958370a54c96

[CL 24923041 by bryan sefcik in ue5-main branch]
2023-04-04 21:16:36 -04:00
bryan sefcik
7a09851e59 Updated JsonTracer to be thread safe and support creating spans from multiple threads at once.
#rb joe.kirchoff
#preflight 642b8fee6a37fb35e9f0630b

[CL 24913389 by bryan sefcik in ue5-main branch]
2023-04-04 13:10:01 -04:00
Ben Marsh
2bf228fc61 Horde: Add a default logger implementation which formats output similar to Serilog's VSCode output format.
#preflight none

[CL 24835474 by Ben Marsh in ue5-main branch]
2023-03-29 10:08:01 -04:00
Ben Marsh
114c44cc15 Horde: Allow compute buffers to be reset back to empty once the reader catches up to the writer.
#preflight none

[CL 24796791 by Ben Marsh in ue5-main branch]
2023-03-25 15:16:15 -04:00
Joe Kirchoff
2a261c113d EpicGames.Core: Obsolete ReadOnlyHashSet in favor of IReadOnlySet
#rb Ben.Marsh
#preflight 641e1145a86ae7cbcc86bc53

[CL 24789316 by Joe Kirchoff in ue5-main branch]
2023-03-24 17:59:47 -04:00
bryan sefcik
3eaa022618 Updated several places in UBT to be thread safe.
#fyi joe.kirchoff
#preflight 641de24b7703a8de3ddb63a7

[CL 24785255 by bryan sefcik in ue5-main branch]
2023-03-24 15:42:24 -04:00
Ben Marsh
e96e9a14f8 EpicGames.Core: Allow adding arbitrary processes to ManagedProcessGroup objects (eg. processes created with regular C# Process constructs).
#preflight none

[CL 24751669 by Ben Marsh in ue5-main branch]
2023-03-22 14:34:06 -04:00
Ben Marsh
a1f62388b7 Horde: Tweaks to compute layer.
* Added trace level debug output for sockets and channels, which display the contents of messages sent and received.
* Merged reader functionality with IComputeMessage.
* Separated the lease and socket classes. Sockets are now constructed for each end of the connection, whereas leases only exist at the initiating end.
* Added an exception message type, for reporting errors back to the initiator.
* Separated commands into more fundamental building blocks; upload files, execute process, delete files, etc...
* Added support for attaching buffers from child processes.
* Removed cpp compute node types.

#preflight none

[CL 24738133 by Ben Marsh in ue5-main branch]
2023-03-21 15:49:14 -04:00
Ben Marsh
070eef4eef Horde: Fix Serilog configuration.
* Previous code was adding a Serilog provider to the Microsoft logger, causing settings for both Microsoft's logging framework and Serilogs settings to apply. This was problematic for filtering, because each system imposes it's own minimum output level.
* Now constructs a single Serilog logger factory using settings read from config files.
* Moved all channel verbosity overrides into config files.

#preflight none

[CL 24733223 by Ben Marsh in ue5-main branch]
2023-03-21 12:04:17 -04:00
joe kirchoff
2d43854469 LogParser: Continue if a matcher can not be loaded
[CL 24724525 by joe kirchoff in ue5-main branch]
2023-03-20 17:36:31 -04:00
Ben Marsh
ca838df10b Horde: Add a compute buffer type that uses shared memory and OS events to communicate between processes.
#preflight none

[CL 24720640 by Ben Marsh in ue5-main branch]
2023-03-20 14:24:44 -04:00
Tim Smith
6b5bcf8cf7 Add the ability to compute a hash from a slice of an array.
#rb ben.marsh, josh.engebretson
#preflight 64184acdca2afe3ee687d2ea

[CL 24714409 by Tim Smith in ue5-main branch]
2023-03-20 08:25:25 -04:00
Ben Marsh
0366d7924f Horde: Forcibly terminate child process groups after 60 seconds if the stdout pipe isn't closed.
#preflight one
#fyi Ryan.Hummer

[CL 24691714 by Ben Marsh in ue5-main branch]
2023-03-17 13:10:59 -04:00
Ben Marsh
dacb9be8c4 Set the file mode on any zip entries extracted that have anything set in the top 16 bits, regardless of the platform that claims to have produced the zip file.
#preflight none

[CL 24616704 by Ben Marsh in ue5-main branch]
2023-03-13 13:45:43 -04:00