Commit Graph

147 Commits

Author SHA1 Message Date
zack neyland
718701a101 UBA: Remove Touch test from Mac running.
[CL 30699426 by zack neyland in ue5-main branch]
2024-01-18 17:53:11 -05:00
zack neyland
9e9de19454 UBA: Add Mac Menubar App for UbaAgent
[CL 30675557 by zack neyland in ue5-main branch]
2024-01-17 19:09:51 -05:00
zack neyland
e35aaea9ec UBA: Fix up tests on Mac.
* Need to grab the actual clang binary location and the SDK path.

[CL 30670808 by zack neyland in ue5-main branch]
2024-01-17 17:20:04 -05:00
henrik karlsson
11ed67aeed [UBA]
* Added log entries to trace file

[CL 30669670 by henrik karlsson in ue5-main branch]
2024-01-17 16:49:50 -05:00
henrik karlsson
fa2772e27d [UBA]
* Added so in-process proxy can use storage of client
* Fixed reset of trace reader
* Fixed annoying warnings when closing invalid sockets

[CL 30667316 by henrik karlsson in ue5-main branch]
2024-01-17 15:28:30 -05:00
zack neyland
c91ba1805b UBA: Fixes various small bugs.
[CL 30662921 by zack neyland in ue5-main branch]
2024-01-17 13:07:52 -05:00
henrik karlsson
cdfbe93014 [UBA]
* Fixed so -replay works again when viewing files

[CL 30643275 by henrik karlsson in ue5-main branch]
2024-01-16 15:35:42 -05:00
henrik karlsson
1b8f85cd3a [UBA]
* Fixed static analysis compile error

[CL 30638670 by henrik karlsson in ue5-main branch]
2024-01-16 13:42:41 -05:00
henrik karlsson
ade0725e14 [UBA]
* Fixed so imagehlp.dll and dbghelp.dll are detoured when loaded. Detour ImageGetDigestStream and SymLoadModuleExW because both of them cause trouble on wine
* Fixed so reuse of processes also honor log files so a new log file is created when reuse happen
* Improved log file naming so host can set name and log files are sent back properly with the right name

[CL 30638193 by henrik karlsson in ue5-main branch]
2024-01-16 13:24:28 -05:00
henrik karlsson
460bdb7637 [UBA/Shader]
* Changed Scheduler_GetStats to separate active into activeLocal and activeRemote
* Added Storage_DeleteFile that can be used to delete cas entries if we know a file will never be used again (no point taking up space)
* Fixed so ubaagents spawned through horde has a idle timeout of 15 seconds (also made them quiet)
* Changed so UbaJobProcessor shutdown uba after 100 seconds instead of 10 seconds of idling without tasks
* Added so .uba.in and .uba.out is deleted from cas storage after used.. no point storing them there since they will never be used again
* Fixed so number of local SCW instances are decreased when more remote helpers are running
* Fixed race condition where tasks could be added when uba was shutting down causing tasks to be cancelled

[CL 30607957 by henrik karlsson in ue5-main branch]
2024-01-12 18:46:59 -05:00
henrik karlsson
c635451c61 [UBA]
* Fixed so sendfile stats is correct for reuse process entries

[CL 30588393 by henrik karlsson in ue5-main branch]
2024-01-12 02:35:20 -05:00
henrik karlsson
4b1c00af7d [UBA]
* Fixed stats reporting bug for process reuse

[CL 30588189 by henrik karlsson in ue5-main branch]
2024-01-12 01:51:57 -05:00
henrik karlsson
22cf61f84b [UBA]
* Added GetNextProcess as a real message type (not using Custom) to be able to stop fetching work if helper is being terminated by aws or if we want to scale down number of workers
* Did some cleanup in the Tcp backend code and made sure not to call close socket multiple times (since it can cause the code to close a different socket than what is owned)

[CL 30584707 by henrik karlsson in ue5-main branch]
2024-01-11 21:01:56 -05:00
henrik karlsson
350ca0b6b4 [UBA]
* Fixed so two traces can't be writing to the same shared memory at the same time
* Added commented out code to track number of active file mappings

[CL 30576568 by henrik karlsson in ue5-main branch]
2024-01-11 15:49:37 -05:00
henrik karlsson
9f12e202b4 [UBA]
* Added ProcessStartInfo::writeOutputFilesOnFail that can be set to true if we want the output files to be written/sent back even though process exited with errors
* Changed so session client use ProcessStartInfoHolder and moved serialization code to that class

[CL 30576299 by henrik karlsson in ue5-main branch]
2024-01-11 15:42:50 -05:00
henrik karlsson
ae997cd583 [UBA]
* Enabled overlap write and bottleneck max to 16 when writing files to disk... this seems to give best results on both machines with ntfs compression and non-compression

[CL 30575881 by henrik karlsson in ue5-main branch]
2024-01-11 15:29:03 -05:00
henrik karlsson
24864b248d [UBA]
* Downgraded tcp bind error to info since it could happen if ppl are running compile and cook at the same time.

[CL 30574550 by henrik karlsson in ue5-main branch]
2024-01-11 14:35:13 -05:00
henrik karlsson
70c75ab3cd [UBA]
* Added Bottleneck type that can be used in combination with BottleneckScope to prevent more than x threads to pass through at the same time

[CL 30574267 by henrik karlsson in ue5-main branch]
2024-01-11 14:30:02 -05:00
henrik karlsson
8400320d41 [UBA]
* Removed assert in detouring code for GetFileAttributesA since we have verfied it is forwarded to GetFileAttributesW on both windows and wine
* Added code to fixup path sent in when creating storage server through export functions
* Added path separator fix in session setup code

[CL 30547691 by henrik karlsson in ue5-main branch]
2024-01-10 15:43:04 -05:00
henrik karlsson
4fc49e9e97 [UBA]
* Fixed visualizer drawing lines between two sessions started from the same client
* Removed the "- Disconnected" entries where client was disconnected super early before any information was available

[CL 30526213 by henrik karlsson in ue5-main branch]
2024-01-10 03:05:23 -05:00
henrik karlsson
9b81535da2 [UBA]
* Added unit test for scheduler

[CL 30523388 by henrik karlsson in ue5-main branch]
2024-01-09 20:29:17 -05:00
henrik karlsson
2242d42396 [UBA]
* Fixed so scheduler can take in 0 as max local processors and use 0. Default is now ~0u which becomes max logical processors

[CL 30519168 by henrik karlsson in ue5-main branch]
2024-01-09 18:03:55 -05:00
henrik karlsson
8f01012c74 [UBA]
* Added code fix in posix detour for bug that happens when reusing shadercompileworker on remotes. Don't know if this will be used on mac/linux but just in case

[CL 30513257 by henrik karlsson in ue5-main branch]
2024-01-09 14:38:35 -05:00
henrik karlsson
8827665b22 [UBA]
* Beeeautiful hack to try to get around ETXTBSY error when spawning ispc processes on linux. Our theory is that with perfectly bad timing the symlink creation of ispc could happen at the exact same time as a posix_spawn happening and inside symlink there is a temporarily open file descriptor that gets cloned into the child and kept open. and this causes ETXTBSY when trying to open that binary.

Solution is simply to have a writelock around the symlink creation and a readlock around posix_spawn

[CL 30513020 by henrik karlsson in ue5-main branch]
2024-01-09 14:26:32 -05:00
henrik karlsson
e30e9214aa [UBA]
* Added popup menu on right mouse click
* Added so it is possible to save active visualizing session

[CL 30509401 by henrik karlsson in ue5-main branch]
2024-01-09 12:43:47 -05:00