Commit Graph

132 Commits

Author SHA1 Message Date
brendan lienau
81e8311e7e [Gauntlet] Resubmit CL 28155910
Rename TestInstallAndRunBase::TestCopyFilesToCopy to TestInstallAndRunBase::TestCopyAppConfigurationFiles
#rb trivial
#rnx

[CL 28166043 by brendan lienau in ue5-main branch]
2023-09-22 20:14:10 -04:00
alex kahn
9c408924a2 [Backout] - CL28155910 - CIS Setup Error
[FYI] brendan.lienau
Original CL Desc
-----------------------------------------------------------------
[Gauntlet] Rename TestInstallAndRunBase::TestCopyFilesToCopy to TestInstallAndRunBase::TestCopyAppConfigFiles
#rb trivial
#rnx

[CL 28161138 by alex kahn in ue5-main branch]
2023-09-22 18:26:19 -04:00
brendan lienau
3e60eff506 [Gauntlet] Rename TestInstallAndRunBase::TestCopyFilesToCopy to TestInstallAndRunBase::TestCopyAppConfigFiles
#rb trivial
#rnx

[CL 28159372 by brendan lienau in ue5-main branch]
2023-09-22 17:54:53 -04:00
brendan lienau
0f542f09d3 [Gauntlet Self-Test] Adds stubbed self-tests for the new gauntlet installation flow
Per-platform implementation will be gradually added as implementations for stubbed flows from CL 27999737 are completed
#rb adolf.stary

[CL 28007901 by brendan lienau in ue5-main branch]
2023-09-19 15:24:17 -04:00
brendan lienau
b026015910 [Gauntlet] Stubs out installation flow changes to enable gradual platform changes
- Adds ITargetDevice.ClearSavedDirectory
- Adds ITargetDevice.CopyAppConfigFiles

Platforms that have these functions implemented change per pass implementation:

Adjusts per pass from FROM
Pass 1
 - InstallApplication (including clearing device cache and copying additional files)
 - Run the app

Pass 2 and beyond
- Run the app

TO
Pass 1
- ClearSavedDirectory
- InstallApplication
- CopyAppConfigFiles
- Run the app

Pass 2 and beyond
- ClearSavedDirectory
- CopyAppConfigFiles
- Run the app

#rb andrew.grant, adolf.stary

[CL 28005887 by brendan lienau in ue5-main branch]
2023-09-19 14:51:53 -04:00
chris constantinescu
9aa914f01c LinuxArm64 support for Low Level Tests through emulator, running in docker container
- Catch2 built for LinuxArm64
- new option to run apps in containerized mode
- builds docker image, setup and cleanup
- StringOp BuildGraph element for string operations (replace, to lower etc)
#jira UE-193565
#rb ue-qa-sdets

[CL 27758925 by chris constantinescu in ue5-main branch]
2023-09-11 12:55:31 -04:00
Josh Adams
67327bf60a - Allow Gauntlet to run a .app, but running the exe inside of it
#jira UE-194222
#rb robert.seiver

[CL 27728666 by Josh Adams in ue5-main branch]
2023-09-08 17:10:29 -04:00
joe barnes
12054b6b88 [Mac] Invert Preference order for packaged and staged build so automation works.
#rb trivial
#jira ue-194222

[CL 27710716 by joe barnes in ue5-main branch]
2023-09-08 10:21:48 -04:00
david harvey
17bf4150a3 Add support for self-installing Windows Gauntlet builds, such as packages for specific game stores.
#jira UE-179187
#rnx
#rb Eric.McDaniel

[CL 27371185 by david harvey in ue5-main branch]
2023-08-25 05:01:44 -04:00
joe barnes
caddcf8527 Add PreferenceOrder for IBuild. Give preference to packaged builds.
#rb heather.howell

[CL 27361356 by joe barnes in ue5-main branch]
2023-08-24 18:15:03 -04:00
Jerome Delattre
ad4a3bc3fd Gauntlet - Make sure to kill child process when closing Unreal app
#jira none
#rnx
#rb Chris.Constantinescu, Sean.Sweeney, Sebatian.Lewicki

[CL 27118746 by Jerome Delattre in ue5-main branch]
2023-08-15 16:25:11 -04:00
gary yuan
5b2c084606 [Gauntlet] Fix Android device match regex to match emulated devices
#rb jerome.delattre
[REVIEW]

[CL 27031218 by gary yuan in ue5-main branch]
2023-08-11 12:05:33 -04:00
josh adams
28ad742f75 - Added an interface to StagedBuildSource to let a platform determine if a found Staged binary is valid
- This fixes Gauntlet finding a partial .app in Mac staged directories that modern makes that is not a full .app
#jira UE-189368,UE-189819
#rb zack.neyland

[CL 26823632 by josh adams in ue5-main branch]
2023-08-03 15:43:18 -04:00
jerome delattre
51f6f270aa Force process output to be logged as verbose log level so it does not trigger the event parser
#rnx
#rb Eric.McDaniel

[CL 26217902 by jerome delattre in ue5-main branch]
2023-06-23 16:24:18 -04:00
chris constantinescu
e003cfd4a1 Use Gauntlet to run low level tests instead of BG's Spawn, move LowLevelTests.xml to public folder and remove all restricted platform names
#rb Jerome.Delattre
#preflight 6452abfd4d593c0b422b5d9e

[CL 25335483 by chris constantinescu in ue5-main branch]
2023-05-04 11:05:46 -04:00
nicolas mercier
f7a1503920 Added support for Build Flavor to Gauntlet, which allows to use different variants of a same configuration (i.e Test vanilla, Test Asan, etc...) for any role (client, server, etc)
Defaults to empty (vanilla)
If the specified role-configuration-flavor cannot be found, Gauntlet returns an error and does not use another flavor as a fallback.
Flavor can be specified on the command line (-<role>flavor=<flavor>, e.g. -clientflavor=clang -serverflavor=asan)

#rb mickael.gilabert
#tests on multiple combination of builds/platforms/tests, including ReplayRun, EditorTests, EngineTests, ASan PS5.

[CL 24924648 by nicolas mercier in ue5-main branch]
2023-04-05 04:08:23 -04:00
david harvey
be77fd4212 Gauntlet roles can be marked as 'Deferred Launch' so they must be launched manually from TickTest.
- this can be used to update the command line for a particular role based on output from another role, for example.
 - add new interface to Windows app install to allow the command line to be updated before launch.


#rnx
#rb Andrew.Grant, Jerome.Delattre, Eric.Knapik
#preflight 640700988c0039bbf793298d

[CL 24537804 by david harvey in ue5-main branch]
2023-03-07 06:02:39 -05:00
william ewen
d9ea36780f TargetDeviceAndroid: Adding extra checks so that the Timeout flow doesn't start extra adb instances we don't need after the device has already been disposed of
#rb j.baumgartner

[CL 24472107 by william ewen in ue5-main branch]
2023-03-01 17:21:27 -05:00
william ewen
8dd9116c04 Adding a force-close for ADB to ensure we don't leave processes running and unintentionally clog up system resources
#rb j.baumgartner

[CL 24412861 by william ewen in ue5-main branch]
2023-02-24 19:04:24 -05:00
Jerome Delattre
ecd49d9d5c Add mkdir for DeviceExternalFilesSavedPath before deploying on Android
#jira none
#preflight 63ea99a1e92f139c5159813e
#rb Chris.Babcock

[CL 24187360 by Jerome Delattre in ue5-main branch]
2023-02-13 15:38:18 -05:00
william ewen
aff1a9899b Device Cleanup
#rb Brendan.Lineau

[CL 23961031 by william ewen in ue5-main branch]
2023-02-01 19:26:55 -05:00
Jerome Delattre
4555fe9325 Gauntlet - fix inconsistent failure between desktop platforms
+ Add support for AddressSanitizer callstack capture in Unreal log parser

#jira UE-167962
#preflight 63cb119c976daa618cef7a35
#rb Brandon.Schaefer,Johnstone.Baumgartner
#rnx

[CL 23832468 by Jerome Delattre in ue5-main branch]
2023-01-24 12:06:09 -05:00
anna fukutome
fcdd6ae3fb If cleaning up test artifacts fails, set each test artifact to have "normal" attributes.
Some artifacts are read-only, and so they fail to get cleaned up by gauntlet.
This was previously fixed for the Gauntlet Device pool, but should be fixed here as well.

#rb Ben.Salem John.Wilson
#preflight 63cf2555ef20a5272dd7a1ee

[CL 23826248 by anna fukutome in ue5-main branch]
2023-01-23 21:21:51 -05:00
David Harvey
b328094315 Gauntlet PGO Profiling support on Windows platforms.
- also includes -PGOFastGen to enable /FASTGENPROFILE for a better framerate during PGO Profiling.
 - also favoring the PGC file that matches the executable when building PGO Optimize builds rather than failing.

#jira UE-159562
#rb Wojciech.Krywult, Eric.McDaniel
#preflight 638db5c00e4613faed110db5

[CL 23387994 by David Harvey in ue5-main branch]
2022-12-05 04:23:14 -05:00
dorgonman
d4cf965846 PR #8047: Fix missing quotes when Gauntlet run on iOS with automation test command (Contributed by dorgonman)
#jira
#rb trivial
#preflight none
#jira UE-116048

[CL 23387512 by dorgonman in ue5-main branch]
2022-12-05 01:22:43 -05:00