Commit Graph

4350 Commits

Author SHA1 Message Date
gary yuan
5b2c084606 [Gauntlet] Fix Android device match regex to match emulated devices
#rb jerome.delattre
[REVIEW]

[CL 27031218 by gary yuan in ue5-main branch]
2023-08-11 12:05:33 -04:00
chris babcock
9bd1cb5b98 Archive additional APK products from Gradle
#android
[REVIEW] [at]Ben.Temple
#rb Ben.Temple

[CL 27022400 by chris babcock in ue5-main branch]
2023-08-11 00:52:06 -04:00
stephen ma
d77fb2793c Apply fixes to OnlineTests to allow correct staging with BuildCookRun on Windows
- LowLevelTests.xml Builds tests under BuildCookRun with -NoBootstrapExe
- TestModuleRules no longer generates arguments -BaseFromWorkingDir to generated .xml files
- Fixes bug in RunLowLevelTests that puts tags in the wrong position in command line arguments

#jira UE-188819

[CL 26994753 by stephen ma in ue5-main branch]
2023-08-10 11:53:46 -04:00
zousar shaker
d85d138034 Increase maximum return code tolerated from the zen.exe command when performing oplog export in a ZenExportSnapshotTask so that we don't have build steps failing because of it while issues are debugged in its operation.
#rb none
[FYI] joakim.lindqvist
[FYI] dan.engelbrecht

[CL 26978731 by zousar shaker in ue5-main branch]
2023-08-09 19:24:13 -04:00
zousar shaker
92332699c6 Suppress output from the zen.exe command when performing oplog export in a ZenExportSnapshotTask so that we don't have builds failing because of a server error logged to output being parsed as an error.
#rb none
[FYI] joakim.lindqvist
[FYI] dan.engelbrecht

[CL 26973405 by zousar shaker in ue5-main branch]
2023-08-09 17:13:20 -04:00
per larsson
d3456a5503 UAT - extended PakFileRules with list of allowed chunk names when generating on demand chunks
#rb PJ.Kack
#rnx

[CL 26950389 by per larsson in ue5-main branch]
2023-08-09 03:46:09 -04:00
sebastien lussier
fc658d89a3 WorldPartition - WorldPartitionBuilder.Automation.cs: Test if SubmitTags is null before accessing
#rb trivial

[CL 26909917 by sebastien lussier in ue5-main branch]
2023-08-07 22:38:45 -04:00
dmytro ivanov
2536e616e1 Update cmake to 3.22.1
#jira UE-192126
#rb Chris.Babcock

[CL 26894364 by dmytro ivanov in ue5-main branch]
2023-08-07 14:56:20 -04:00
andrew grant
725db830a1 Fixes regression where BenchmarkBuild script would not reliably measure build performance.
The fix is to restore the <= 5.1 behavior of UBT where the MaxParallelActions argument specifies the maximum number of actions to execute in parallel, not a cap on UBTs heuristic-based selection.

This change also modifies BenchmarkBuild so it will default to the available processor count if no -cores argument is specified. This ensures the behavior of repeated runs will be deterministic as UBT may select different values if the system free memory changes

#jira UE-192236
#rb swarm
[REVIEW] [at]Joe.Kirchoff
#tests Ran UBT / BenchmarkBuild with arguments that forces the number of actions higher than the locally available core count

[CL 26889927 by andrew grant in ue5-main branch]
2023-08-07 13:35:03 -04:00
justin marcus
557b02454e Add UseDetailedInstallSizes to generate size metadata even if UseChunkDBs is false. UseDetailedInstallSizes defaults to true.
[REVIEW] [at]Eric.Knapik [at]Thomas.Ross

[CL 26856550 by justin marcus in ue5-main branch]
2023-08-04 15:11:18 -04:00
brendan lienau
299c0598be [Gauntlet] Adds UnrealRoleConfiguration feature
IUnrealRoleConfigurations are a type that let you modularize functionality for any role in a gauntlet test. It's primarily designed to generate command line arguments, but can do anything that's desired to the target Role.
IUnrealRoleConfigurations supply two interface functions

-ApplyConfigToRole - Core implementation of the configuration, this is the "doing"
-VerifyRoleConfig - Verification implementation. This gives you a chance to verify the "Apply" step had the desired result.

#rb Clayton.Langford

[CL 26855812 by brendan lienau in ue5-main branch]
2023-08-04 14:57:58 -04:00
brendan lienau
b843f634bb [Automation] Improve csv build version validation checks to catch all build label suffixes.
#rb Clayton.Langford

[CL 26845960 by brendan lienau in ue5-main branch]
2023-08-04 10:42:36 -04:00
Jerome Delattre
ada4a631df Gauntlet - Fix a crash when no UnrealDeviceReservation instance was initiated
#rnx
#rb trivial

[CL 26828246 by Jerome Delattre in ue5-main branch]
2023-08-03 17:18:43 -04:00
zousar shaker
2e699f26d6 Fix bug where the "silent" mode for project cooking could still emit an exception if the return code from the commandlet was outside the positive signed integer range.
#rb graeme.thornton

[CL 26824508 by zousar shaker in ue5-main branch]
2023-08-03 16:00:54 -04:00
josh adams
28ad742f75 - Added an interface to StagedBuildSource to let a platform determine if a found Staged binary is valid
- This fixes Gauntlet finding a partial .app in Mac staged directories that modern makes that is not a full .app
#jira UE-189368,UE-189819
#rb zack.neyland

[CL 26823632 by josh adams in ue5-main branch]
2023-08-03 15:43:18 -04:00
ryan hummer
b8460946bc Change UnrealBuildException to print as errors
* Give it a unique exit code
* And introduce a new output format MinimalError to give minimal info output, but as an error

#rnx
#jira UE-191956
#rb joe.kirchoff, marc.audy, bryan.johnson

[CL 26823591 by ryan hummer in ue5-main branch]
2023-08-03 15:42:02 -04:00
heather howell
6de00b7c99 [Gauntlet] BugFix: Fix the ability for people to jump directly to the gauntlet log on the network.
#rb [at]adolf.stary
[REVIEW] [at]FN-Tech-Automation

[CL 26819768 by heather howell in ue5-main branch]
2023-08-03 14:22:05 -04:00
jerome delattre
d3d2ecc902 Avoid reverting to simple report if no json report was found
#rnx
#rb Josh.Engebretson

[CL 26819539 by jerome delattre in ue5-main branch]
2023-08-03 14:19:07 -04:00
jerome delattre
e6f6d8b5f5 Gauntlet - Move MaxEventsDisplayPerTest from test config to test node class
#rb trivial
#rnx

[CL 26781202 by jerome delattre in ue5-main branch]
2023-08-02 14:26:06 -04:00
Jerome Delattre
2c4a10a3d2 Gauntlet - Use Suite name for simple report name in UE.Automation test
#rnx
#rb trivial
#jira none

[CL 26774988 by Jerome Delattre in ue5-main branch]
2023-08-02 11:53:52 -04:00
jerome delattre
4a2160cac1 Gauntlet - Introduce MaxEventsDisplayPerTest argument to UE.Automation to adjust how much errors are reported per test
#rnx
#rb Sean.Sweeney, Rob.Huyett

[CL 26771118 by jerome delattre in ue5-main branch]
2023-08-02 10:16:29 -04:00
Jerome Delattre
594cfbccc6 Gauntlet - Fix horde test name for simple report in EditorTests and UE.Automation
#rb trivial
#jira none
#rnx

[CL 26762571 by Jerome Delattre in ue5-main branch]
2023-08-01 20:22:49 -04:00
lorry li
c2c48c3fd1 Add automation flow for WebTests.
#jira UE-182678
[REVIEW] [at]stephen.ma [at]chad.garyet [at]ryan.hummer [at]rafa.lecina [at]michael.kirzinger
#rb [at]chris.constantinescu

[CL 26739672 by lorry li in ue5-main branch]
2023-08-01 11:06:27 -04:00
Ryan Hummer
3ebc0e1bcf Removing mono/xbuild part 1
* Updating references to use dotnet
* Add new RunDotnet scripts
* Removing Mono sh scripts and references to them

#rnx
#jira UE-153293
#rb josh.adams, zack.neyland, brandon.schaefer

[CL 26737744 by Ryan Hummer in ue5-main branch]
2023-08-01 10:02:58 -04:00
Jerome Delattre
510d22c0f0 Rebase Gauntlet EditorTests to UE.AutomationTestNode
#jira none
#rb logan.buchy, han.chu
#rnx

[CL 26704404 by Jerome Delattre in ue5-main branch]
2023-07-31 09:29:53 -04:00