Commit Graph

987 Commits

Author SHA1 Message Date
josh adams
1ef3087292 - Ability to override Xcodebuild settings when staging and packaging with BuildCookRun, it is not used when building
#rb josh.adams

[CL 33128829 by josh adams in ue5-main branch]
2024-04-20 11:08:10 -04:00
zousar shaker
67fe4b2afe Fix stage/deploy functionality so that if you're using fileserver/projectstore functionality, it doesn't write a layout file that expects loose files (INIs, etc) to be on the filesystem. This required moving some pieces of functionality onto ProjectParams so that they are accessible by a platform automation layer.
#rb dan.engelbrecht, PJ.Kack

[CL 33041507 by zousar shaker in ue5-main branch]
2024-04-17 13:30:25 -04:00
ben marsh
2dd301febe Create an AutomationTools.Tests project, and move tests from Horde.Agent into it. Included in UE5 default solution for better visibility.
[FYI] carl.bystrom, kevin.macaulayvacher

[CL 33036388 by ben marsh in ue5-main branch]
2024-04-17 10:39:36 -04:00
kevin macaulayvacher
1c564f5450 - Adds a ThreadSanitizer Structured Logging Matcher so we may contextualize TSAN output in Horde logs. It specifically will attempt to annotate files, symbols, and symbol addresses in callstacks, warning on TSAN "WARNING" messages and "SUMMARY" message.
-- The "SUMMARY" message is the only log line treated as an error since it is information (description of problem, and file+line to address) but also not overly specific such that we should be able to make JIRA issues from these log lines without generating duplicate issues for the same race from different callsites.
- Changes EditorPerf TSAN job to use -VeryVerbose in UAT so that stdout and stderr are redirected for logging. TSAN emits logs to stderr/stdout (depends on environement variable, stderr by default). The logs can be redirected to a log file via envvar TSAN_OPTIONS and specifying a path, however, Horde will only use whatever is written to stdout/stderr for generating issues, so unless a post process is added to forward the TSAN log output after the application has terminated, having stdout redirected stderr/stdout by default for TSAN jobs is simplest approach.
- Added two new KnownLogEvents `Sanitizer_Thread` and `Sanitizer`. `Sanitizer_Thread` is used by the added matcher, but `Sanitizer` was also added so that we may follow the pattern of letting the first id represent the broader category of events

#rb Bryan.Johnson, Ben.Marsh
#jira UE-207074
[FYI] Francis.Hurteau

[CL 33007156 by kevin macaulayvacher in ue5-main branch]
2024-04-16 13:44:37 -04:00
bob tellez
1eac2aebe2 Merging CL#32865058
[preflight] Move UpdatePackagingParameters into it's own file.

#rb brendan.lienau

[CL 32872909 by bob tellez in ue5-main branch]
2024-04-11 02:05:38 -04:00
james singer
bcadb03ee6 Fix CombinePaths dereferencing null
#jira none

[CL 32524530 by james singer in ue5-main branch]
2024-03-26 17:48:05 -04:00
james singer
51c592e2f1 Fix problem making chunked builds due to CombinePaths combining quoted and unquoted paths together
#jira UE-206734

#rb zack.neyland

[CL 32521622 by james singer in ue5-main branch]
2024-03-26 16:19:45 -04:00
jim casale
adb8947e6c Adding systemic matcher to "There is not enough space on the disk." errors during LogChannelEvents
#rnx

[CL 32511520 by jim casale in ue5-main branch]
2024-03-26 12:04:33 -04:00
jim casale
b3a2dea4b0 Fixing error matcher for locked robomerge gates. Adding a cursor function to look ahead a limited number of times.
#rnx
#jira  UE-127714

#rb Ryan.Hummer

[CL 32508207 by jim casale in ue5-main branch]
2024-03-26 10:13:20 -04:00
eric knapik
9425c94f8a Adding skip build as an option for the compile task in buildgraph.
Skip build flag is passed to UBT so that only target files can be generated without performing a full build operation.

Fixing an issue in the CompileTask where AllowAllCores would always be false

[REVIEW] [at]Joe.Kirchoff [at]Ben.Marsh [at]Ryan.Hummer [at]Gary.Yuan [at]Philip.Cosgrave

#rb Ben.Marsh

[CL 32489167 by eric knapik in ue5-main branch]
2024-03-25 18:31:19 -04:00
ben marsh
777487df11 Horde: Only enable code signing by default when running on an Epic build machine. The IsBuildMachine flag is true for any Horde deployment, but UAT hard-codes the signing certificate name for Epic. Check for the EpicInternal.txt flag to indicate whether we're running on Epic's farm.
#jira UE-210179

[CL 32376723 by ben marsh in ue5-main branch]
2024-03-20 14:56:15 -04:00
will brown
2f6c5f922d Calling the CustomCopyHandler during CreatePakResponseFileFromStagingManifest so that the copy output file can be correctly added to the PakResponse
#rb Josh.Adams, Zousar.Shaker

[CL 32346844 by will brown in ue5-main branch]
2024-03-19 21:57:14 -04:00
joe kirchoff
66b29ea81d UAT: Fix log file name for UBT
#rnx

[CL 32253761 by joe kirchoff in ue5-main branch]
2024-03-14 14:51:02 -04:00
matt peters
427a405c5b AutomationTools: Normalize whitespace in DeploymentContext.cs.
#rnx
#rb matt.peters
#rbself Trivial

[CL 32091291 by matt peters in ue5-main branch]
2024-03-07 12:36:09 -05:00
david harvey
82f0db6bb0 Add GetCodeSpecifiedDeviceSoftwareUpdateVersions() function for Turnkey, mirroring GetCodeSpecifiedSdkVersions()
#rb Josh.Adams
#rnx

[CL 32080984 by david harvey in ue5-main branch]
2024-03-07 05:04:28 -05:00
justin peterson
784548ebe0 [Backout] - CL32069881 - CIS Compile Error
[FYI] joe.barnes
Original CL Desc
-----------------------------------------------------------------
Make UpdatePackagingParameters non-platform specific (even though it is) and mov it into it's own file. Keep implementation in platform specific file. This keeps from breaking the build script for those that don't have Switch support synced.

#rb brendan.lienau

[CL 32073962 by justin peterson in ue5-main branch]
2024-03-06 19:13:47 -05:00
joe barnes
26687e181e Make UpdatePackagingParameters non-platform specific (even though it is) and mov it into it's own file. Keep implementation in platform specific file. This keeps from breaking the build script for those that don't have Switch support synced.
#rb brendan.lienau

[CL 32070035 by joe barnes in ue5-main branch]
2024-03-06 17:29:02 -05:00
ben marsh
f1cff2b71b Remove P4 syncing from updating version files on buildmachines. Builders can track their own workspace without having to sync files manually.
[CL 31948098 by ben marsh in ue5-main branch]
2024-03-01 12:51:37 -05:00
calvin zheng
d21ba7eabb clean up comments
#jira UE-206565
#rb calvin.zheng

[CL 31816257 by calvin zheng in ue5-main branch]
2024-02-26 16:12:56 -05:00
josh adams
2b258842b5 - Cleaned up remaining UnrealEditor-Cmd.exe hardcodes, and using the recently checked in GetEditorForProject function
- Renamed some "FileReference ProjectName" to "FileReference ProjectFile"
- Passing in "null" for a lot of UnrealExe params, instead of "UnrealEditor-Cmd", so allow GetEditorForProject to be called (we must still allow for a true override, so we can't get rid of the param)
- Added FileSystemReference.Exists
#rb David.Harvey

[CL 31660211 by josh adams in ue5-main branch]
2024-02-20 18:03:33 -05:00
josh adams
610ad3e065 - Added a shared GetEditorForProject() function which should be used in UAT to get the path to the binary to run, becasue UnrealEditor-Cmd.exe is not always correct (if the editor is a Unique build environment, the editor to use to cook etc is the project editor. not UnrealEditor)
#rb david.harvey

[CL 31621119 by josh adams in ue5-main branch]
2024-02-19 15:10:30 -05:00
dan thompson
15fd28a21e Reference Chunk Database:
* Optionally output a CSV of changed/new packages.
* Add an additional directory input if containers get separated off during a build process
* Catch optional segment containers and patch up the container id per the id fix in a separate CL.
bunch of different preflights due to CIS issues.
#rb fabian.giesen
#jira UE-172130

[CL 31576665 by dan thompson in ue5-main branch]
2024-02-16 15:10:30 -05:00
lorry li
dc1f66105c Suppress the warning message in WebTests.
#jira UE-206338
[REVIEW] [at]michael.atchison [at]stephen.ma [at]rafa.lecina [at]michael.kirzinger
#rb michael.atchison, Rafa.Lecina, stephen.ma

[CL 31348674 by lorry li in ue5-main branch]
2024-02-09 13:41:36 -05:00
Ryan Hummer
340e32fbf9 Adding an option to run code signing via signtool.exe in parallel, up to 16 concurrent instances.
* Exposing the option to the InstalledEngineBuild.xml, off by default
* Moving to a signing service requires parallel calls for performance
* Some clean up of log printing to improved structured logging output

#rnx
#jira UE-204728
#rb Chad.Garyet

#changelist validated
#virtualized

[CL 31228478 by Ryan Hummer in ue5-main branch]
2024-02-06 15:39:04 -05:00
ben marsh
5468687551 Horde: Add Meziantou.Analyzer to Horde.Agent and Horde.Server. Many rules currently disabled; will re-enable and fix up some in subsequent commits.
[CL 31186356 by ben marsh in ue5-main branch]
2024-02-05 15:12:50 -05:00