Commit Graph

1364 Commits

Author SHA1 Message Date
Ben Marsh
59a6168284 Horde: Add a matcher for inconsistent Perforce case events.
#preflight none

[CL 20439896 by Ben Marsh in ue5-main branch]
2022-05-31 14:25:56 -04:00
David Harvey
1f9999d20c fix platform name lookup.
#rb trivial
#rnx
#preflight skip
#fyi Joe.Conley

[CL 20395090 by David Harvey in ue5-main branch]
2022-05-27 12:58:13 -04:00
Ben Marsh
cbb950c578 UBT: Use ILogger throughout UBT, rather than legacy EpicGames.Core.Log methods. All output going forwards should use structured logging rather than String.Format style logging.
#preflight 628e9dc6e746de4961f60032

[CL 20373777 by Ben Marsh in ue5-main branch]
2022-05-25 19:55:37 -04:00
lauren barnes
53488dc718 Updating CrashReportClient style to only use images from certain folders, and moving developer tool style setup to individual style classes.
#jira UE-152623
#rb Josh.Adams, Patrick.Boutot, Patrick.Laflamme, Louise.Rasmussen
#preflight 628d6c5faf7a2e956b8de990

#ROBOMERGE-OWNER: lauren.barnes
#ROBOMERGE-AUTHOR: lauren.barnes
#ROBOMERGE-SOURCE: CL 20366551 via CL 20368551 via CL 20369147 via CL 20369164
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v949-20362246)

[CL 20370889 by lauren barnes in ue5-main branch]
2022-05-25 16:27:45 -04:00
carlmagnus nordin
4fb14fcf65 UAT: Fix .o files not being staged to the correct pakchunk
#preflight 628e13cb841e8395c64ff8d3
#rb pj.kack

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 20362915 via CL 20363784 via CL 20363794 via CL 20363800
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v949-20362246)

[CL 20366259 by carlmagnus nordin in ue5-main branch]
2022-05-25 12:08:53 -04:00
David Harvey
5c7f266d12 Remove HoloLens platform references from AutomationTool.
#jira UE-149794
#rnx
#preflight 628cdf035665463c210630fb
#rb Jeff.Fisher

[CL 20362413 by David Harvey in ue5-main branch]
2022-05-25 07:19:52 -04:00
David Harvey
f9ec9654e7 UAT: Update changelist comment to reflect latest checkin requirements.
#rnx
#rb trivial
#preflight skip

[CL 20345112 by David Harvey in ue5-main branch]
2022-05-24 03:53:02 -04:00
josh adams
381fbb5b95 - Fixed up the EditorOptional directories to have a different save vs input, since the save dir needs to be cleaned, but the input one cannot get cleaned
#rb francis.hurteau
#preflight 6286c9041e478b95c7ccaa2a

#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 20289363 via CL 20289803 via CL 20289816 via CL 20289832
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)

[CL 20304893 by josh adams in ue5-main branch]
2022-05-20 18:49:22 -04:00
Robert Millar
9c4b3bfe7d Stage Base.ini into crash reporter pak files.
#jira UE-153141
#rb none
#preflight https://horde.devtools.epicgames.com/job/6286d7159016c6dd89a4dd6d

[CL 20296816 by Robert Millar in ue5-main branch]
2022-05-20 12:26:45 -04:00
chris constantinescu
b258362e47 Catch2 3.0 preview source code integration with on-demand static library build for all platforms.
Other preflights: Catch2 Build Library 6283d1c14316db80d194f6c8, Nightly Low Level Tests 6283d1c9114e08fa2f237e6b
#preflight 6283d1b5114e08fa2f237db3

[CL 20248814 by chris constantinescu in ue5-main branch]
2022-05-17 15:06:28 -04:00
jack porter
63ef117561 Perform restricted staged folder name checking before doing platform filename remapping
Back out incorrect fix from CL 20056908
#jira UE-147094
#preflight 62790b2fea2a9db9dc560710
#rb Adam.Kinge
#lockdown Mitchell.Wilson

#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 20110639 in //UE5/Release-5.0/... via CL 20111734
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20114350 by jack porter in ue5-main branch]
2022-05-09 19:52:57 -04:00
Devin Doucette
bd6866bfe9 BuildCMakeLib: Added support for targeting arm64 on Win64 with VS2019
This allows a library to use a Win64+arm64 build for HoloLens without providing a separate set of libs for HoloLens.

#preflight 62791db7066ebb49109d692f
#rb Zousar.Shaker

[CL 20106529 by Devin Doucette in ue5-main branch]
2022-05-09 13:57:58 -04:00
Dan Thompson
3a6321167b Packaging Reference Chunk Database - "Lossless Patch Preventer"
Can now provide reference iostore containers to reuse compressed chunks from. If a match is found on *the decompressed data*, instead of recompressing the blocks, they are read off of disk. This allows tweaks of the compressor algorithm without introducing changes as the runtime still sees the exact same data. Additionally this allows for fairly dramatic staging speedups as nvme speeds are significantly faster than high effort compressions. This is distinct from the DDC compression because:
1) DDC compression ties in the compressor version/method
2) We are explicitly interested in chunks that are deployed to end users, not merely cached for speed.

To facilitate this, several changes were made to IoStore:

FIoStoreReader now directly reads from IFileHandles* instead of routing through the GenericPlatformFile async read system, as that system is sensitive to build #defines and can result in constant file opens under load (indeed, for anything not a .pak file, every read is an open/close).

Cold file cache read speed improvements from ~140MB/s to ~1 GB/s. Hot is more.

Additionally:
    FIoStoreReader switched to UE::Tasks from taskgraph for tasks in order to facilitate task retraction during waits as the previous ReadAsync call was trivial to deadlock when called from worker threads due to its use of TFuture<>.
    FIoStoreReader::ReadCompressed now returns the compressed blocks as they were on disk - padded to AES encryption block size.

#rb fabian.giesen
#rb jeff.roberts
#preflight 627586dcf77c9c2b543d4d8b

[CL 20086673 by Dan Thompson in ue5-main branch]
2022-05-06 18:22:44 -04:00
jack porter
a5d55f3660 Use platform-remapped staging path when checking for restricted folder names
#jira UE-147094
#rb Ben Zeigler
#preflight 6273b716c04406dfea7e49b2
#lockdown Rolando.Caloca

#ROBOMERGE-AUTHOR: jack.porter
#ROBOMERGE-SOURCE: CL 20056908 in //UE5/Release-5.0/... via CL 20057485
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20061168 by jack porter in ue5-main branch]
2022-05-05 14:09:36 -04:00
Josh Adams
c756b51630 - FIxed an exception when NOT not using oiptional stage dir
#rb trivial
#preflight skip

[CL 20060045 by Josh Adams in ue5-main branch]
2022-05-05 13:13:18 -04:00
Josh Adams
defdfa230a - Added option for IoStore to write optional files (.o.ucas) to a different directory. This is used when making a a cooked editor as DLC against a client build (the client build has to make the optional editor data, but we do not want to ship the optional data with the client). The MakeCookedEditor script will then copy the files from that location into the editor's Stage directory (under Content/Paks)
#rb carl-magnus.nordin,francis.hurteau
#preflight 6273f8fd8d32cd80d8a8ecdb

[CL 20059504 by Josh Adams in ue5-main branch]
2022-05-05 12:28:59 -04:00
PJ Kack
5d0ce32acd UAT: For editor quick launch and packaging, only pass -iostore and -compressed when using -pak, and never pass -compressed to the cook commandlet (that feature has been removed).
#jira none
#rb carlmagnus.nordin
#rnx
#preflight 6273b3d45b05fb4f60112bbe

[CL 20056179 by PJ Kack in ue5-main branch]
2022-05-05 07:41:13 -04:00
PJ Kack
6b6bc48fc5 UAT: Add additional startup and BuildCookRun logging and timings
#jira none
#rb trivial
#rnx
#preflight 627379dda56dd762120e6e2e

[CL 20055418 by PJ Kack in ue5-main branch]
2022-05-05 03:40:01 -04:00
carlmagnus nordin
172ee292ee UAT: Fixed issue with not finding packagestore.manifest when staging plugins from project folders not directly under the workspace root.
#jira UE-150990
#rb pk.kack
#preflight 6272315e4c664a1624631afc
#lockdown simon.tourangeau

#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 20040973 in //UE5/Release-5.0/... via CL 20045721
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20047963 by carlmagnus nordin in ue5-main branch]
2022-05-04 16:14:10 -04:00
PJ Kack
65391545db UAT: Restrict the COTF -filehostip list to ip v4 host addresses and only include 127.0.0.1 on host platforms or platforms that support port redirection.
Makes connecting to cotf faster on some platforms.
Removes warnings like: LogSockets: Warning: Could not serialize fe80::edc3:3284:5b1b:1f32%7, got error code SE_NO_ERROR [0]
Makes the string shorter and more readable.

Test:
RunUAT.bat BuildCookRun -project=Samples\Games\ShooterGame\ShooterGame.uproject -platform=XYZ -config=development -build -cookonthefly -stage -run

FileHostIp example on PC & android:
Before: -filehostip=127.0.0.1+fe80::edc3:3284:5b1b:1f32%7+10.24.101.44+::1+127.0.0.1+fe80::58d4:b8b3:ff7a:4974%9+172.18.240.1
After : -filehostip=127.0.0.1+10.24.101.44+172.18.240.1

FileHostIp example on console:
Before: -filehostip=127.0.0.1+fe80::edc3:3284:5b1b:1f32%7+10.24.101.44+::1+127.0.0.1+fe80::58d4:b8b3:ff7a:4974%9+172.18.240.1
After : -filehostip=10.24.101.44+172.18.240.1

#jira none
#rb carlmagnus.nordin, per.larsson
#rnx
#preflight 62722ddafe45c124493258a8

[CL 20038819 by PJ Kack in ue5-main branch]
2022-05-04 04:18:17 -04:00
Catalin Dragoiu
72cb56da0b Allow programs to be built using the BuildTarget command.
#rb Andrew.Grant
#preflight 6270e09c5e6ce673f42e063c
#jira UE-149689

[CL 20026154 by Catalin Dragoiu in ue5-main branch]
2022-05-03 11:16:52 -04:00
Francis Hurteau
c719a4680a Add commandline boilerplate to support optional cooking through UAT
#rb Matt.Peters
#jira UE-142231
#preflight none

[CL 19929815 by Francis Hurteau in ue5-main branch]
2022-04-26 17:52:04 -04:00
Devin Doucette
565a2935c6 BuildCMakeLib: Added support for targeting the Unix platform group
#preflight 6261c9676119a1a496c533d6
#rb Zousar.Shaker

[CL 19863796 by Devin Doucette in ue5-main branch]
2022-04-22 08:56:28 -04:00
jonathan adamczewski
06aab1ddc7 BuildCommonTools: Don't try to build a non-existent library
#jira UE-149138
#trival
#preflight none
#rnx

[CL 19821497 by jonathan adamczewski in ue5-main branch]
2022-04-19 19:15:47 -04:00
axel riffard
6ab54619ca Add Harfbuzz / ICU support for tvOS
#jira UE-113408
#rb jack.porter
#preflight 19783834

[CL 19801919 by axel riffard in ue5-main branch]
2022-04-18 23:27:10 -04:00