Commit Graph

994 Commits

Author SHA1 Message Date
jerome delattre
144e69090a Substitute properties from Sanitizer report in Log format + fix Context and SourceFile properties in UE.Automation test report summary.
#rnx
#rb sebastian.lewicki

[CL 33940535 by jerome delattre in ue5-main branch]
2024-05-28 10:27:20 -04:00
ben marsh
c40502ed0f Horde: Fix some static analyzer warnings.
#rnx

[CL 33939753 by ben marsh in ue5-main branch]
2024-05-28 10:00:17 -04:00
jerome delattre
06c54447db [Gauntlet] Log Sanitizer report using KnownLogEvents.Sanitizer_Address so that it gets caught by Horde Event matcher
#jira UE-215443
#rnx

#rb kevin.macaulayvacher, sean.sweeney

[CL 33904471 by jerome delattre in ue5-main branch]
2024-05-24 16:09:27 -04:00
kevin macaulayvacher
5a23733d8b Makes the ThreadSanitizer LogEventMatcher and IssueHandler generic to Sanitizers in general and adds support for TSAN and ASAN. Updates the existing TSAN job to use the renamed commandlet and makes the job name clearer that a sanitizer report is being generated.
#jira UE-213117
#rb Ben.Marsh

[CL 33370008 by kevin macaulayvacher in ue5-main branch]
2024-05-01 07:12:59 -04:00
kevin macaulayvacher
bdc5b59de7 Fix two issues in ThreadSanitizerEventMatcher:
- We could match on irrelevant log line and then be forced to return a partial TSAN report depite not finding our report end delimiter
- We could potentially move the LogCursor one more line than available in the buffer if we end parsing on a line that matches our stack trace pattern since we would call MoveNext() on potentially a null line. This would result in exceptions being thrown while generating events.

[CL 33313709 by kevin macaulayvacher in ue5-main branch]
2024-04-29 16:47:38 -04:00
kevin macaulayvacher
8b887d6c5c Adds a new step to TSAN error process to allow a report of only the unique TSAN errors to be displayed. This step parses the output log from the test run and displays the unique errors and removes any interwoven log lines that are irrelevant.
Doing so the TSAN log matcher can now generate logs that contain the full TSAN error context in a single log. An TSAN IssueHandler has been added which looks for the summary log event and generates an issue keyed off the summary error reason and the file in error. The goal being to generate an issue per unique TSAN error

The TSANLogMatcher has had a test added to ensure we properly log only TSAN errors, and the file was renamed to fix warnings regarding file name and class name must matching.

EditorPerf timeouts have been reduced as we were waiting for 8 hours in cases when no tests were running due to errors in the config

#jira UE-212560
#rb Ben.Marsh
[FYI] Francis.Hurteau

[CL 33261211 by kevin macaulayvacher in ue5-main branch]
2024-04-26 08:42:40 -04:00
ben marsh
ecdefa9459 Horde: Match MSTest errors which contain parameter lists.
#rnx

[CL 33229271 by ben marsh in ue5-main branch]
2024-04-25 09:23:28 -04:00
josh adams
1ef3087292 - Ability to override Xcodebuild settings when staging and packaging with BuildCookRun, it is not used when building
#rb josh.adams

[CL 33128829 by josh adams in ue5-main branch]
2024-04-20 11:08:10 -04:00
zousar shaker
67fe4b2afe Fix stage/deploy functionality so that if you're using fileserver/projectstore functionality, it doesn't write a layout file that expects loose files (INIs, etc) to be on the filesystem. This required moving some pieces of functionality onto ProjectParams so that they are accessible by a platform automation layer.
#rb dan.engelbrecht, PJ.Kack

[CL 33041507 by zousar shaker in ue5-main branch]
2024-04-17 13:30:25 -04:00
ben marsh
2dd301febe Create an AutomationTools.Tests project, and move tests from Horde.Agent into it. Included in UE5 default solution for better visibility.
[FYI] carl.bystrom, kevin.macaulayvacher

[CL 33036388 by ben marsh in ue5-main branch]
2024-04-17 10:39:36 -04:00
kevin macaulayvacher
1c564f5450 - Adds a ThreadSanitizer Structured Logging Matcher so we may contextualize TSAN output in Horde logs. It specifically will attempt to annotate files, symbols, and symbol addresses in callstacks, warning on TSAN "WARNING" messages and "SUMMARY" message.
-- The "SUMMARY" message is the only log line treated as an error since it is information (description of problem, and file+line to address) but also not overly specific such that we should be able to make JIRA issues from these log lines without generating duplicate issues for the same race from different callsites.
- Changes EditorPerf TSAN job to use -VeryVerbose in UAT so that stdout and stderr are redirected for logging. TSAN emits logs to stderr/stdout (depends on environement variable, stderr by default). The logs can be redirected to a log file via envvar TSAN_OPTIONS and specifying a path, however, Horde will only use whatever is written to stdout/stderr for generating issues, so unless a post process is added to forward the TSAN log output after the application has terminated, having stdout redirected stderr/stdout by default for TSAN jobs is simplest approach.
- Added two new KnownLogEvents `Sanitizer_Thread` and `Sanitizer`. `Sanitizer_Thread` is used by the added matcher, but `Sanitizer` was also added so that we may follow the pattern of letting the first id represent the broader category of events

#rb Bryan.Johnson, Ben.Marsh
#jira UE-207074
[FYI] Francis.Hurteau

[CL 33007156 by kevin macaulayvacher in ue5-main branch]
2024-04-16 13:44:37 -04:00
bob tellez
1eac2aebe2 Merging CL#32865058
[preflight] Move UpdatePackagingParameters into it's own file.

#rb brendan.lienau

[CL 32872909 by bob tellez in ue5-main branch]
2024-04-11 02:05:38 -04:00
james singer
bcadb03ee6 Fix CombinePaths dereferencing null
#jira none

[CL 32524530 by james singer in ue5-main branch]
2024-03-26 17:48:05 -04:00
james singer
51c592e2f1 Fix problem making chunked builds due to CombinePaths combining quoted and unquoted paths together
#jira UE-206734

#rb zack.neyland

[CL 32521622 by james singer in ue5-main branch]
2024-03-26 16:19:45 -04:00
jim casale
adb8947e6c Adding systemic matcher to "There is not enough space on the disk." errors during LogChannelEvents
#rnx

[CL 32511520 by jim casale in ue5-main branch]
2024-03-26 12:04:33 -04:00
jim casale
b3a2dea4b0 Fixing error matcher for locked robomerge gates. Adding a cursor function to look ahead a limited number of times.
#rnx
#jira  UE-127714

#rb Ryan.Hummer

[CL 32508207 by jim casale in ue5-main branch]
2024-03-26 10:13:20 -04:00
eric knapik
9425c94f8a Adding skip build as an option for the compile task in buildgraph.
Skip build flag is passed to UBT so that only target files can be generated without performing a full build operation.

Fixing an issue in the CompileTask where AllowAllCores would always be false

[REVIEW] [at]Joe.Kirchoff [at]Ben.Marsh [at]Ryan.Hummer [at]Gary.Yuan [at]Philip.Cosgrave

#rb Ben.Marsh

[CL 32489167 by eric knapik in ue5-main branch]
2024-03-25 18:31:19 -04:00
ben marsh
777487df11 Horde: Only enable code signing by default when running on an Epic build machine. The IsBuildMachine flag is true for any Horde deployment, but UAT hard-codes the signing certificate name for Epic. Check for the EpicInternal.txt flag to indicate whether we're running on Epic's farm.
#jira UE-210179

[CL 32376723 by ben marsh in ue5-main branch]
2024-03-20 14:56:15 -04:00
will brown
2f6c5f922d Calling the CustomCopyHandler during CreatePakResponseFileFromStagingManifest so that the copy output file can be correctly added to the PakResponse
#rb Josh.Adams, Zousar.Shaker

[CL 32346844 by will brown in ue5-main branch]
2024-03-19 21:57:14 -04:00
joe kirchoff
66b29ea81d UAT: Fix log file name for UBT
#rnx

[CL 32253761 by joe kirchoff in ue5-main branch]
2024-03-14 14:51:02 -04:00
matt peters
427a405c5b AutomationTools: Normalize whitespace in DeploymentContext.cs.
#rnx
#rb matt.peters
#rbself Trivial

[CL 32091291 by matt peters in ue5-main branch]
2024-03-07 12:36:09 -05:00
david harvey
82f0db6bb0 Add GetCodeSpecifiedDeviceSoftwareUpdateVersions() function for Turnkey, mirroring GetCodeSpecifiedSdkVersions()
#rb Josh.Adams
#rnx

[CL 32080984 by david harvey in ue5-main branch]
2024-03-07 05:04:28 -05:00
justin peterson
784548ebe0 [Backout] - CL32069881 - CIS Compile Error
[FYI] joe.barnes
Original CL Desc
-----------------------------------------------------------------
Make UpdatePackagingParameters non-platform specific (even though it is) and mov it into it's own file. Keep implementation in platform specific file. This keeps from breaking the build script for those that don't have Switch support synced.

#rb brendan.lienau

[CL 32073962 by justin peterson in ue5-main branch]
2024-03-06 19:13:47 -05:00
joe barnes
26687e181e Make UpdatePackagingParameters non-platform specific (even though it is) and mov it into it's own file. Keep implementation in platform specific file. This keeps from breaking the build script for those that don't have Switch support synced.
#rb brendan.lienau

[CL 32070035 by joe barnes in ue5-main branch]
2024-03-06 17:29:02 -05:00
ben marsh
f1cff2b71b Remove P4 syncing from updating version files on buildmachines. Builders can track their own workspace without having to sync files manually.
[CL 31948098 by ben marsh in ue5-main branch]
2024-03-01 12:51:37 -05:00