148 Commits

Author SHA1 Message Date
Zousar Shaker
5d7bbb4790 Ensure that if we fail to launch zenserver with the CREATE_BREAKAWAY_FROM_JOB flag on Windows that we try again without that flag.
#rb Matt.Peters
#jira UE-211574

[CL 32767924 by Zousar Shaker in 5.4 branch]
2024-04-05 14:39:30 -04:00
zousar shaker
541df7e069 Ensure that zenserver http requests from the zen server interface (not the DDC layer) bypass proxies when communicating with zenserver.
[FYI] dan.engelbrecht, Devin.Doucette
#jira UE-210567

[CL 32528749 by zousar shaker in 5.4 branch]
2024-03-26 19:01:30 -04:00
dan engelbrecht
350d9f3ea9 Add support of partial zen DDC GetChunks requests
#ushell-cherrypick of 32395474 by dan.engelbrecht
#rb Devin.Doucette
#jira UE-210439
[FYI] tim.doerries, Zousar.Shaker, Stefan.Boberg

[CL 32513108 by dan engelbrecht in 5.4 branch]
2024-03-26 12:34:33 -04:00
zousar shaker
2677dea380 Ensure that if zenserver AutoLaunch fails that we have at least one more attempt launch, even if the first attempt exceeded our wait timeout. This can occur if the first attempt spent a while waiting for the lock to free up.
[FYI] dan.engelbrecht
#jira UE-207039

[CL 32509787 by zousar shaker in 5.4 branch]
2024-03-26 11:16:53 -04:00
zousar shaker
2aa132cd9d Further hardening of zen launch sequence.
#rb dan.engelbrecht
#jira UE-207039

[CL 32499839 by zousar shaker in 5.4 branch]
2024-03-26 02:39:31 -04:00
zousar shaker
f844207559 Remove one line edit added in my previous changelist because it isn't necessary.
#rb dan.engelbrecht
#jira UE-207039

[CL 32498170 by zousar shaker in 5.4 branch]
2024-03-26 01:47:28 -04:00
zousar shaker
4a8b09d959 Address zenserver autolaunch/lifecycle issues identified on Windows, Mac, and Linux using lifecycle stress test.
#rb dan.engelbrecht
#jira UE-207039

[CL 32498098 by zousar shaker in 5.4 branch]
2024-03-26 01:44:32 -04:00
Zousar Shaker
1e8b7e4b86 Address missing file descriptor close on Mac/Linux that is related to the lock file handling when launching zenserver. Also fix an incorrect return value from the Mac/Linux implementation of IsLockFileLocked in the case of an orphaned lock file.
#rb stefan.boberg
#jira UE-207039

[CL 32231945 by Zousar Shaker in 5.4 branch]
2024-03-13 18:27:59 -04:00
Zousar Shaker
7a3e8b6aa6 Address zenserver autolaunch/lifecycle issues identified on Windows, Mac, and Linux using lifecycle stress test.
Remove one line edit added in my previous changelist because it isn't necessary.

#rb dan.engelbrecht
#jira UE-207039

[CL 32182340 by Zousar Shaker in 5.4 branch]
2024-03-12 12:09:51 -04:00
zousar shaker
469f4d33a6 Attempt shut down of running zenserver process if we find a locked lock file but the pid registered in the lock file can't be found.
If a pid can not be found when finding a matching desired/effective port, keep looking if any other state has a matching port.
Hardened and added logging to NativeIsProcessRunning.

Run of Low Level Tests in Main  here: https://horde.devtools.epicgames.com/job/65e81c5d156d6df40d304906

#jira UE-207039
#rb Zousar.Shaker

#ushell-cherrypick of 31938454 by swarm

[CL 32066220 by zousar shaker in 5.4 branch]
2024-03-06 16:06:12 -05:00
Zousar Shaker
9d8c20ceee Identify zenserver as Unreal Zen Storage Server in messagebox dialogs and accompanying logs for high priority messages. Ensure google drive warning follows the same messagebox/log logic as other prompts. Eliminate the use of RequestExit from within ZenServerInterface, failure should not force process shutdown.
Add NoZenLocalFallback and InstalledNoZenLocalFallback DDC graphs for use in scenarios where users are unable to run a local zenserver for any reason.  Also fix a mis-labeling of a local cache store as being remote if it is deactivated.

#ushell-cherrypick of 32021579 by Zousar.Shaker
#ushell-cherrypick of 32021609 by Zousar.Shaker

#rb devin.doucette
#jira UE-208878

[CL 32032787 by Zousar Shaker in 5.4 branch]
2024-03-05 15:14:50 -05:00
dan engelbrecht
92edf13510 Use process-unique name for zen data directory validity test
Fixes warning "Warning: [CookWorker 2]: Skipping subprocess environment variable UE-ZenSubprocessDataPath=d:/build/++Fortnite/Sync/ZenData due to an invalid path" caused by a race condition between multiple cook workers.
See https://horde.devtools.epicgames.com/log/65dc47bbdd128eaa49c6cc13?lineindex=90207
#jira UE-208562

#rb Zousar.Shaker

[CL 31941334 by dan engelbrecht in 5.4 branch]
2024-03-01 08:41:30 -05:00
zousar shaker
9698f0b957 Change default zen data and install directories to be per-user, and clean up old default directories when migrating to a new one.
#rb dan.engelbrecht
#jira UE-205982

[CL 31566985 by zousar shaker in 5.4 branch]
2024-02-16 11:12:11 -05:00
zousar shaker
c0baae15cf Fix a bug where ZenServer data path would not update if you initiated an editor restart after changing the Global Local Data Cache Path. This was due to environment variable inheritance of UE-ZenSubprocessDataPath. This change ensures that environment variable is cleared as part of shutdown before the editor spawns a new instance of itself. Also fixed some whitespace issues in passing.
#rb dan.engelbrecht
#jira UE-204051

[CL 31520917 by zousar shaker in 5.4 branch]
2024-02-15 11:04:14 -05:00
zousar shaker
5158f74d32 Partial backout (test only) while failure on Linux is investigated.
[Backout] - CL31365105
[FYI] Zousar.Shaker
Original CL Desc
-----------------------------------------------------------------
Fix issue where zenserver fails to launch when DDC path differs between two workspaces.

[FYI] dan.engelbrecht

[CL 31365173 by zousar shaker in 5.4 branch]
2024-02-10 02:45:51 -05:00
zousar shaker
05d3b5f083 Fix issue where zenserver fails to launch when DDC path differs between two workspaces.
[FYI] dan.engelbrecht

[CL 31365120 by zousar shaker in 5.4 branch]
2024-02-10 01:47:21 -05:00
zousar shaker
c619a9c3e3 Zenserver autolaunch and shutdown unit tests.
#rb dan.engelbrecht

[CL 31340026 by zousar shaker in 5.4 branch]
2024-02-09 10:27:53 -05:00
dan engelbrecht
7ad9c8050b Further hardening of zen service shut down
#jira UE-205143
#rb Stefan.Boberg, Zousar.Shaker

[CL 31331405 by dan engelbrecht in 5.4 branch]
2024-02-09 04:43:19 -05:00
zousar shaker
f55e68edcd Fix non-editor (program) use cases of Zen AutoLaunch to ensure that they load the editor settings config before accessing it.
#rb dan.engelbrecht

[CL 31292444 by zousar shaker in 5.4 branch]
2024-02-08 10:33:16 -05:00
zousar shaker
ca26e6b94e Fix for zenserver shutdown and start logic bug. The "return" within the while NativeIsProcessRunning || IsZenProcessUsingEffectivePort loop creates a situation where we can exit the loop before the process is completely gone, meaning the lockfile could still be present.
#jira UE-205971
[FYI] dan.engelbrecht

[CL 31200455 by zousar shaker in 5.4 branch]
2024-02-05 19:45:45 -05:00
dan engelbrecht
ab85dcb707 Validate running processes for zenserver by using native functions directly.
We need to control how the process handle is opened.
#jira UE-205151
#rb stefan.boberg, Zousar.Shaker

[CL 31125479 by dan engelbrecht in 5.4 branch]
2024-02-02 10:32:52 -05:00
dan engelbrecht
ecf82d7b58 Add logging when signalling zenserver event for shutdown fails
#jira UE-205143
#rb Zousar.Shaker

[CL 31084633 by dan engelbrecht in 5.4 branch]
2024-02-01 08:37:40 -05:00
dan engelbrecht
16410bec3e Remove launch zenserver as admin fallback
#rb Stefan.Boberg, Zousar.Shaker

[CL 31084468 by dan engelbrecht in 5.4 branch]
2024-02-01 08:28:05 -05:00
zousar shaker
662d9b1d71 Adjusting logs related to zen usage to:
- Remove repeated log related to fetching cache stats
- Ensure that the Zen cache usage has log lines explaining the status of the caches it attempts to connect to (success or failure)

#rb Matt.Peters

[CL 30710842 by zousar shaker in ue5-main branch]
2024-01-18 22:43:41 -05:00
dan engelbrecht
f4e800d5f8 Add missing changes for CL 30501142 (and 30501566)
For local Zen DDC connections show the path where data is store in the Cache Statistics tab for DDC instead of local ip address
For Zen DDC connection show the storage size
#jira UE-199929
#rb Devin.Doucette

[CL 30504523 by dan engelbrecht in ue5-main branch]
2024-01-09 10:20:00 -05:00