Ben Marsh
ab142f400f
Horde: Use a parsable format for localization errors, allowing us to link files for build health issues.
...
#fyi leon.huang
#preflight 62912405f6625a3541a0b1ea
[CL 20400528 by Ben Marsh in ue5-main branch]
2022-05-27 18:27:52 -04:00
Ben Marsh
da4a5bc82b
Registers matchers from UBT into log event parser in UAT, for times where we build inside UAT.
...
#preflight 629112c1a962938dff13b2ad
[CL 20396261 by Ben Marsh in ue5-main branch]
2022-05-27 14:14:28 -04:00
Ryan Durand
8f713106cc
Add failure to check in a RoboMerge gate file due to gate being locked to systemic errors.
...
#rnx
#jira UE-127714
#rb ben.marsh
#preflight
[CL 20380405 by Ryan Durand in ue5-main branch]
2022-05-26 12:09:20 -04:00
Ben Marsh
cf7582e557
UAT: Fix exception when creating dummy targets in UAT.
...
#preflight none
[CL 20374333 by Ben Marsh in ue5-main branch]
2022-05-25 20:48:43 -04:00
Ben Marsh
cbb950c578
UBT: Use ILogger throughout UBT, rather than legacy EpicGames.Core.Log methods. All output going forwards should use structured logging rather than String.Format style logging.
...
#preflight 628e9dc6e746de4961f60032
[CL 20373777 by Ben Marsh in ue5-main branch]
2022-05-25 19:55:37 -04:00
David Harvey
5c7f266d12
Remove HoloLens platform references from AutomationTool.
...
#jira UE-149794
#rnx
#preflight 628cdf035665463c210630fb
#rb Jeff.Fisher
[CL 20362413 by David Harvey in ue5-main branch]
2022-05-25 07:19:52 -04:00
Per Larsson
e0fa4b3b40
Added UAT parameter -NoZenAutoLaunch for easier debugging of Zen server
...
#rb trivial
#jira none
#preflight none
[CL 20325946 by Per Larsson in ue5-main branch]
2022-05-23 09:24:09 -04:00
josh adams
381fbb5b95
- Fixed up the EditorOptional directories to have a different save vs input, since the save dir needs to be cleaned, but the input one cannot get cleaned
...
#rb francis.hurteau
#preflight 6286c9041e478b95c7ccaa2a
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 20289363 via CL 20289803 via CL 20289816 via CL 20289832
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)
[CL 20304893 by josh adams in ue5-main branch]
2022-05-20 18:49:22 -04:00
mitchell fisher
83dcb95bd5
[FORT-474170] Add support for extracting zip files with hierarchical contents (ignores zip directory entries and otherwise conditionally creates parent dirs as needed)
...
#preflight 6285738d614041edb7af2929
#ROBOMERGE-AUTHOR: mitchell.fisher
#ROBOMERGE-SOURCE: CL 20288288 via CL 20288867 via CL 20288871 via CL 20288878
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)
[CL 20304859 by mitchell fisher in ue5-main branch]
2022-05-20 18:48:46 -04:00
Ben Marsh
06673f202c
UAT: Move logger matcher initialization into AutomationUtils, since it's not a hard dependency of AutomationTool.
...
#jira UE-153354
#preflight 6287e8208828ea88c87c54cd
[CL 20301330 by Ben Marsh in ue5-main branch]
2022-05-20 15:27:15 -04:00
Ben Marsh
7514d30d9b
Move the remaining log matchers into AutomationUtils.
...
#preflight 6286a7049016c6dd899f2fb8
[CL 20286961 by Ben Marsh in ue5-main branch]
2022-05-19 16:29:37 -04:00
jack porter
63ef117561
Perform restricted staged folder name checking before doing platform filename remapping
...
Back out incorrect fix from CL 20056908
#jira UE-147094
#preflight 62790b2fea2a9db9dc560710
#rb Adam.Kinge
#lockdown Mitchell.Wilson
#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 20110639 in //UE5/Release-5.0/... via CL 20111734
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)
[CL 20114350 by jack porter in ue5-main branch]
2022-05-09 19:52:57 -04:00
Dan Thompson
3a6321167b
Packaging Reference Chunk Database - "Lossless Patch Preventer"
...
Can now provide reference iostore containers to reuse compressed chunks from. If a match is found on *the decompressed data*, instead of recompressing the blocks, they are read off of disk. This allows tweaks of the compressor algorithm without introducing changes as the runtime still sees the exact same data. Additionally this allows for fairly dramatic staging speedups as nvme speeds are significantly faster than high effort compressions. This is distinct from the DDC compression because:
1) DDC compression ties in the compressor version/method
2) We are explicitly interested in chunks that are deployed to end users, not merely cached for speed.
To facilitate this, several changes were made to IoStore:
FIoStoreReader now directly reads from IFileHandles* instead of routing through the GenericPlatformFile async read system, as that system is sensitive to build #defines and can result in constant file opens under load (indeed, for anything not a .pak file, every read is an open/close).
Cold file cache read speed improvements from ~140MB/s to ~1 GB/s. Hot is more.
Additionally:
FIoStoreReader switched to UE::Tasks from taskgraph for tasks in order to facilitate task retraction during waits as the previous ReadAsync call was trivial to deadlock when called from worker threads due to its use of TFuture<>.
FIoStoreReader::ReadCompressed now returns the compressed blocks as they were on disk - padded to AES encryption block size.
#rb fabian.giesen
#rb jeff.roberts
#preflight 627586dcf77c9c2b543d4d8b
[CL 20086673 by Dan Thompson in ue5-main branch]
2022-05-06 18:22:44 -04:00
Josh Adams
f18143aa8b
- Added missing commandline option for the optional file staging directory (-optionalfilestagingdirectory=)
...
#rb trivial
#preflight 627423bafd59d6606e0162f0
[CL 20063141 by Josh Adams in ue5-main branch]
2022-05-05 15:36:34 -04:00
jack porter
a5d55f3660
Use platform-remapped staging path when checking for restricted folder names
...
#jira UE-147094
#rb Ben Zeigler
#preflight 6273b716c04406dfea7e49b2
#lockdown Rolando.Caloca
#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 20056908 in //UE5/Release-5.0/... via CL 20057485
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)
[CL 20061168 by jack porter in ue5-main branch]
2022-05-05 14:09:36 -04:00
Josh Adams
defdfa230a
- Added option for IoStore to write optional files (.o.ucas) to a different directory. This is used when making a a cooked editor as DLC against a client build (the client build has to make the optional editor data, but we do not want to ship the optional data with the client). The MakeCookedEditor script will then copy the files from that location into the editor's Stage directory (under Content/Paks)
...
#rb carl-magnus.nordin,francis.hurteau
#preflight 6273f8fd8d32cd80d8a8ecdb
[CL 20059504 by Josh Adams in ue5-main branch]
2022-05-05 12:28:59 -04:00
PJ Kack
6b6bc48fc5
UAT: Add additional startup and BuildCookRun logging and timings
...
#jira none
#rb trivial
#rnx
#preflight 627379dda56dd762120e6e2e
[CL 20055418 by PJ Kack in ue5-main branch]
2022-05-05 03:40:01 -04:00
PJ Kack
65391545db
UAT: Restrict the COTF -filehostip list to ip v4 host addresses and only include 127.0.0.1 on host platforms or platforms that support port redirection.
...
Makes connecting to cotf faster on some platforms.
Removes warnings like: LogSockets: Warning: Could not serialize fe80::edc3:3284:5b1b:1f32%7, got error code SE_NO_ERROR [0]
Makes the string shorter and more readable.
Test:
RunUAT.bat BuildCookRun -project=Samples\Games\ShooterGame\ShooterGame.uproject -platform=XYZ -config=development -build -cookonthefly -stage -run
FileHostIp example on PC & android:
Before: -filehostip=127.0.0.1+fe80::edc3:3284:5b1b:1f32%7+10.24.101.44+::1+127.0.0.1+fe80::58d4:b8b3:ff7a:4974%9+172.18.240.1
After : -filehostip=127.0.0.1+10.24.101.44+172.18.240.1
FileHostIp example on console:
Before: -filehostip=127.0.0.1+fe80::edc3:3284:5b1b:1f32%7+10.24.101.44+::1+127.0.0.1+fe80::58d4:b8b3:ff7a:4974%9+172.18.240.1
After : -filehostip=10.24.101.44+172.18.240.1
#jira none
#rb carlmagnus.nordin, per.larsson
#rnx
#preflight 62722ddafe45c124493258a8
[CL 20038819 by PJ Kack in ue5-main branch]
2022-05-04 04:18:17 -04:00
Francis Hurteau
c719a4680a
Add commandline boilerplate to support optional cooking through UAT
...
#rb Matt.Peters
#jira UE-142231
#preflight none
[CL 19929815 by Francis Hurteau in ue5-main branch]
2022-04-26 17:52:04 -04:00
jonathan adamczewski
d4f03243e3
Remove various obsolete (deprecated) items in C# code
...
#jira none
#trivial
#rnx
#preflight 625a32bbde3638cefa4106cb
[CL 19786027 by jonathan adamczewski in ue5-main branch]
2022-04-18 11:27:53 -04:00
jonathan adamczewski
b6ac2aa225
BuildGraph: RunUAT via dotnet & AutomationTool.dll
...
#jira none
#rnx
#preflight 6259f6a7016074c111fa3d39
[CL 19778495 by jonathan adamczewski in ue5-main branch]
2022-04-15 19:03:08 -04:00
jonathan adamczewski
c12d99d854
.net6.0 is not supported in VS2019. Suppress warnings about that when using that IDE (with this change, when building UnrealBuildTool & AutomationTool)
...
#jira none
#rnx
#rb joe.kirchoff
#preflight 624f2c163c2aff69c54ff9eb
[CL 19675097 by jonathan adamczewski in ue5-main branch]
2022-04-07 15:06:02 -04:00
mitchell fisher
f039ee7b30
[FORT-465286] McpConfigHelper::Find() surfaces nested exception details if instance activation throws
...
#rb trivial
#preflight skip
#ROBOMERGE-OWNER: mitchell.fisher
#ROBOMERGE-AUTHOR: mitchell.fisher
#ROBOMERGE-SOURCE: CL 19653682 via CL 19654984 via CL 19655731 via CL 19655738
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v938-19570697)
[CL 19657590 by mitchell fisher in ue5-main branch]
2022-04-06 18:24:32 -04:00
jonathan adamczewski
c1bb6901bf
Upgrade to .NET 6.0
...
#jira UE-119846
#preflight 624cbb2ecc0872e96b0d5181
[CL 19652696 by jonathan adamczewski in ue5-main branch]
2022-04-06 14:46:50 -04:00
PJ Kack
5f6c6d5beb
UAT: Add BuildCookRun support for running both a dedicated server and cotf server.
...
Merge RunClientWithServer() and RunStandAloneClient() functions into one RunClient() function to resolve numerous inconsistencies between them and between unattended/non-unattended mode.
Always use SC.StageTargetPlatform.RunClient() to launch clients so that the logic works on all platforms.
When either the client, dedicated server or cook server exits, then all other processes exits too.
Hitting Ctrl-c in UAT kills all processes.
ShooterGame testing on Win64, consoles and android:
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cook -stage -pak -deploy -run
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -skipcook -skipstage -skipdeploy -run
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -skipcook -skipstage -skipdeploy -run -unattended
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -stage -deploy -run
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -stage -deploy -run -unattended
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -zenstore -stage -deploy -run
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -zenstore -stage -deploy -run -unattended
ShooterGame Win64 Desktop specific testing with lan server and multiple clients:
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -zenstore -server -stage -run -map=Highrise -numclients=3
BuildCookRun -project=ShooterGame -platform=Win64 -config=development -skipbuild -cookonthefly -zenstore -server -stage -run -map=Highrise -numclients=3 -unattended
EngineTest testing on Win64 and console:
BuildCookRun -project=EngineTest -platform=Win64 -config=development -skipbuild -cook -stage -pak -deploy -run -runautomationtest=Project.System
BuildCookRun -project=EngineTest -platform=Win64 -config=development -skipbuild -cookonthefly -stage -deploy -run -runautomationtest=Project.System
BuildCookRun -project=EngineTest -platform=Win64 -config=development -skipbuild -cookonthefly -zenstore -stage -deploy -run -runautomationtest=Project.System
#jira none
#rb carlmagnus.nordin
#rnx
#preflight 624d79fdbf5b974989964f4c
[CL 19645492 by PJ Kack in ue5-main branch]
2022-04-06 08:03:43 -04:00