Jerome Delattre
ed09a0800a
Don't dereference ReservationStates on successful reservation
...
#jira UE-185763
#rnx
#preflight 6462300baa3c584c0bf14798
#rb trivial
[CL 25472748 by Jerome Delattre in ue5-main branch]
2023-05-15 09:47:04 -04:00
Jerome Delattre
0cb33a3dc4
Improve Gauntlet warning message during Device resource starvation
...
#jira UE-177435
#preflight 64357e454c0cdaea09db2859
#rnx
#rb Clayton.Langford, Chris.Constantinescu, Josh.Engebretson
[CL 25342255 by Jerome Delattre in ue5-main branch]
2023-05-04 16:48:26 -04:00
brendan lienau
1ce61dd21e
[Automation] Passthrough BUILDMACHINE to relevant processes when running on a buildmachine.
...
#rb clayton.langford
#preflight skip
[CL 25339767 by brendan lienau in ue5-main branch]
2023-05-04 14:51:53 -04:00
chris constantinescu
e003cfd4a1
Use Gauntlet to run low level tests instead of BG's Spawn, move LowLevelTests.xml to public folder and remove all restricted platform names
...
#rb Jerome.Delattre
#preflight 6452abfd4d593c0b422b5d9e
[CL 25335483 by chris constantinescu in ue5-main branch]
2023-05-04 11:05:46 -04:00
matt peters
8441ee518b
Change PerfEditorPIETest to use an isolated warming pass and to use a cached asset registry.
...
#rb Zousar.Shaker
#rnx
#preflight 645173590722d4f6a2aa494d
[CL 25310352 by matt peters in ue5-main branch]
2023-05-02 19:02:34 -04:00
joe barnes
6d239b4ff5
* Ensure any processes (TM2, NintendoSDKDaemon, RunOnTarget) started by Switch SDK utilities (ControlTarget, RunOnTarget) are shut down when we're done.
...
* Create UsedPlatform HashSet as we add target devices in case their unregistered before we get to dispose().
#rb michael.wanderson
[FYI] [at]brian.white, [at]michael.wanderson
[CL 25241522 by joe barnes in ue5-main branch]
2023-04-28 17:10:52 -04:00
gary yuan
b8ed6fcd22
Gauntlet fix Regex in GetTestExitCode for RequestExitWithStatus
...
#rb
[REVIEW] eric.knapik
#preflight 644acd52877716c8787bfabd
[CL 25238032 by gary yuan in ue5-main branch]
2023-04-28 15:34:37 -04:00
Jerome Delattre
352db4f4b5
Gauntlet - Use the most appropriate Role to represent UnrealTestNode context
...
#preflight 64493b2a1150e908d0812ebc
#rnx
#jira none
#rb trivial
[CL 25199447 by Jerome Delattre in ue5-main branch]
2023-04-26 11:39:00 -04:00
tyler staples
07fc50fbb8
Gauntlet - Fix missing copyright notice.
...
#rnx
[CL 25192036 by tyler staples in ue5-main branch]
2023-04-25 19:21:09 -04:00
tyler staples
eb05db870e
Move ReportGenUtils and the CsvImporter interface into the Gauntlet project.
...
#rnx
#rb brendan.lienau
[CL 25186917 by tyler staples in ue5-main branch]
2023-04-25 15:17:30 -04:00
Jerome Delattre
f38b6d4278
Log UE critical failure as Gauntlet_FatalEvent
...
+ limit the number of reported not run tests
+ clean up some part of summary report
#jira UE-176042
#preflight 63f661449129b42b256eef3d
#rb Chris.Constantinescu
#rnx
[CL 25024749 by Jerome Delattre in ue5-main branch]
2023-04-13 10:10:21 -04:00
nicolas mercier
f7a1503920
Added support for Build Flavor to Gauntlet, which allows to use different variants of a same configuration (i.e Test vanilla, Test Asan, etc...) for any role (client, server, etc)
...
Defaults to empty (vanilla)
If the specified role-configuration-flavor cannot be found, Gauntlet returns an error and does not use another flavor as a fallback.
Flavor can be specified on the command line (-<role>flavor=<flavor>, e.g. -clientflavor=clang -serverflavor=asan)
#rb mickael.gilabert
#tests on multiple combination of builds/platforms/tests, including ReplayRun, EditorTests, EngineTests, ASan PS5.
[CL 24924648 by nicolas mercier in ue5-main branch]
2023-04-05 04:08:23 -04:00
Jerome Delattre
2d0503dd81
Gauntlet - UE.AutomationTestConfig - Expose Log Idle timeout to command line argument
...
#jira none
#preflight 6425b097486e7cce7d51f862
#rnx
#rb Kieran.Uttley
[CL 24855695 by Jerome Delattre in ue5-main branch]
2023-03-30 12:22:48 -04:00
heather howell
8677088ddd
[Automation] Build discovery platforms: Searches for PS4 also finds PS5 builds
...
# rb [at]Brendan.Lienau
#tests -test=BootTest -platform=ps4 -configuration=Test
#preflight 641cf8a47a393e211abdbebb
[CL 24831825 by heather howell in ue5-main branch]
2023-03-29 02:25:33 -04:00
brendan lienau
622ef1b9bd
[Automation] Add devkit login verification to Mcp automation tests
...
#jira UE-175456
#rb Clayton.Langford
#preflight 6421d9ada86ae7cbcc525271
[CL 24820912 by brendan lienau in ue5-main branch]
2023-03-28 12:23:48 -04:00
eric knapik
a2ffe30ea2
#jira: none
...
Adding p4 as a paramHelp for tests that might need p4v access
[CL 24724527 by eric knapik in ue5-main branch]
2023-03-20 17:36:38 -04:00
mikalai sukhikh
1ddf586476
Provide a UAT command to deploy an archived build
...
#jira UE-170262
#rb adam.miezianko, chris.constantinescu, jerome.delattre
#preflight 641072b7bd6894c4351cf04d
#preflight 64107260290c6e5d77e5ad30
[CL 24653717 by mikalai sukhikh in ue5-main branch]
2023-03-15 09:52:24 -04:00
Ben Marsh
e141cb6196
More UAT structured logging fixes.
...
#preflight 6408dee3b0544ef0b4bca696
[CL 24564590 by Ben Marsh in ue5-main branch]
2023-03-08 14:32:15 -05:00
brendan lienau
76fe0a3090
[Automation] Provides Gauntlet the ability to more robustly secure dev kit account logins for relevant platforms.
...
Implements the feature on ps5 and xbox
#rb ben.salem
[CL 24564471 by brendan lienau in ue5-main branch]
2023-03-08 14:25:48 -05:00
Ben Marsh
235eb77726
Change to structured logging in other AutomationTool projects.
...
#preflight 6408c4478c0039bbf750e861
[CL 24562553 by Ben Marsh in ue5-main branch]
2023-03-08 12:43:35 -05:00
jerome delattre
0cca92c6c9
Gauntlet - Use space instead of coma when parsing extra engine arguments
...
Follow up to 24507995
#preflight 6407638d5515f4f57b431116
#rb Ben.Salem
[CL 24546974 by jerome delattre in ue5-main branch]
2023-03-07 15:37:47 -05:00
david harvey
be77fd4212
Gauntlet roles can be marked as 'Deferred Launch' so they must be launched manually from TickTest.
...
- this can be used to update the command line for a particular role based on output from another role, for example.
- add new interface to Windows app install to allow the command line to be updated before launch.
#rnx
#rb Andrew.Grant, Jerome.Delattre, Eric.Knapik
#preflight 640700988c0039bbf793298d
[CL 24537804 by david harvey in ue5-main branch]
2023-03-07 06:02:39 -05:00
ben salem
3af41fdfb0
Fix issues with commas within quotes in -clientargs. -clientargs="-testvalues=\"a,b,c\" " will now work.
...
#rb clayton.langford
[CL 24507995 by ben salem in ue5-main branch]
2023-03-03 17:08:16 -05:00
mikalai sukhikh
db77409e87
Improve Gauntlet behavior, promote errors to the output in case if 'InitializationFailure' is happening
...
#jira UE-168641
#rb adam.miezianko, chris.constantinescu, jerome.delattre
#preflight 63fe30f0e32cdb7d9a544e04
#preflight 63fe30a6ef1b24bf94141784
[CL 24477686 by mikalai sukhikh in ue5-main branch]
2023-03-02 01:11:03 -05:00
william ewen
d9ea36780f
TargetDeviceAndroid: Adding extra checks so that the Timeout flow doesn't start extra adb instances we don't need after the device has already been disposed of
...
#rb j.baumgartner
[CL 24472107 by william ewen in ue5-main branch]
2023-03-01 17:21:27 -05:00
