Commit Graph

67 Commits

Author SHA1 Message Date
joe barnes
12054b6b88 [Mac] Invert Preference order for packaged and staged build so automation works.
#rb trivial
#jira ue-194222

[CL 27710716 by joe barnes in ue5-main branch]
2023-09-08 10:21:48 -04:00
Jerome Delattre
c6a844877d Use Project Target to find editor even when -build point to a staged build
When -editordir is specified trim the editor path to be relative
Add support for -target command line argument to Gauntlet

#jira UE-193609
#rnx
#rb Chris.Constantinescu

[CL 27485635 by Jerome Delattre in ue5-main branch]
2023-08-30 11:27:14 -04:00
joe barnes
caddcf8527 Add PreferenceOrder for IBuild. Give preference to packaged builds.
#rb heather.howell

[CL 27361356 by joe barnes in ue5-main branch]
2023-08-24 18:15:03 -04:00
josh adams
28ad742f75 - Added an interface to StagedBuildSource to let a platform determine if a found Staged binary is valid
- This fixes Gauntlet finding a partial .app in Mac staged directories that modern makes that is not a full .app
#jira UE-189368,UE-189819
#rb zack.neyland

[CL 26823632 by josh adams in ue5-main branch]
2023-08-03 15:43:18 -04:00
Jerome Delattre
b47d6a8799 Gauntlet - Add extra context when failing on finding build target
#rnx
#rb trivial

[CL 26013396 by Jerome Delattre in ue5-main branch]
2023-06-15 10:14:22 -04:00
chris constantinescu
e003cfd4a1 Use Gauntlet to run low level tests instead of BG's Spawn, move LowLevelTests.xml to public folder and remove all restricted platform names
#rb Jerome.Delattre
#preflight 6452abfd4d593c0b422b5d9e

[CL 25335483 by chris constantinescu in ue5-main branch]
2023-05-04 11:05:46 -04:00
nicolas mercier
f7a1503920 Added support for Build Flavor to Gauntlet, which allows to use different variants of a same configuration (i.e Test vanilla, Test Asan, etc...) for any role (client, server, etc)
Defaults to empty (vanilla)
If the specified role-configuration-flavor cannot be found, Gauntlet returns an error and does not use another flavor as a fallback.
Flavor can be specified on the command line (-<role>flavor=<flavor>, e.g. -clientflavor=clang -serverflavor=asan)

#rb mickael.gilabert
#tests on multiple combination of builds/platforms/tests, including ReplayRun, EditorTests, EngineTests, ASan PS5.

[CL 24924648 by nicolas mercier in ue5-main branch]
2023-04-05 04:08:23 -04:00
heather howell
8677088ddd [Automation] Build discovery platforms: Searches for PS4 also finds PS5 builds
# rb [at]Brendan.Lienau
#tests -test=BootTest -platform=ps4 -configuration=Test
#preflight 641cf8a47a393e211abdbebb

[CL 24831825 by heather howell in ue5-main branch]
2023-03-29 02:25:33 -04:00
Jerome Delattre
5d99cd522f Fix Gauntlet issue matching Unreal Linux executable
#preflight 63c032422879a5b230b9bcb6
#jira UE-173003
#rb Brandon.Schaefer, Chirs.Constantinescu

[CL 23677641 by Jerome Delattre in ue5-main branch]
2023-01-13 10:32:11 -05:00
jerome delattre
b5c380a532 Allow running Unreal tests from installed build
* Introduced the command line argument -editordir to specify the alternate location of the editor build.

#preflight 63876934766a2aeed27bc298
#jira UE-171414

[CL 23332243 by jerome delattre in ue5-main branch]
2022-11-30 11:38:19 -05:00
dmitrii ubirailo
069e2d1532 Supported defining alternative folder for UEFN by setting environemt variable UE_BUILDS_PATH.
[REVIEW] Anna.Fukutome, Eric.Knapik
#preflight skip

[CL 22619920 by dmitrii ubirailo in ue5-main branch]
2022-10-19 03:05:28 -04:00
Jerome Delattre
546cbcbcdb Gauntlet - Support different build target configuration for editor with RunUnreal command.
#jira UE-150433
#rnx
#rb Chris.Constantinescu, Eric.Knapik
#preflight skip,NotTestedByPreflight

[CL 19968765 by Jerome Delattre in ue5-main branch]
2022-04-28 16:58:19 -04:00
jonathan adamczewski
0a6164bbd3 nullability annotations, rethrow fixes, net6.0 warning suppression
#jira none
#trivial
#rnx
#preflight 62425155c61d8a458f230657

[CL 19536049 by jonathan adamczewski in ue5-main branch]
2022-03-28 20:50:06 -04:00
jonathan adamczewski
5c68d1d9ef Revert //UE5/Main/... changelist 19531725 - return to NET Core 3.1
#preflight 62422fd0470aff98e946bfce
#jira UE-119846

[CL 19534572 by jonathan adamczewski in ue5-main branch]
2022-03-28 18:25:19 -04:00
jonathan adamczewski
18ac15cbb1 Upgrade to .NET 6.0
#jira UE-119846
#preflight 6241fc06470aff98e943c035

[CL 19531725 by jonathan adamczewski in ue5-main branch]
2022-03-28 15:30:56 -04:00
Brandon Schaefer
772691f946 Undo the -asan changes added to Gauntlet.
The Engine currently no longer spits out a binary for Editor (it does for game) with -ASan appended. Something to resolve at a later date
We can still run ASan tests, but now the binary will be UnrealEditor vs UnrealEditor-ASan

#jira none
#rb none
#fyi Jerome.Delattre
#preflight none

[CL 19113559 by Brandon Schaefer in ue5-main branch]
2022-02-24 10:06:54 -05:00
eric knapik
1ee860257e #jira: FORT-429595
Allow cooked editor to run in cooked for in gauntlet and uncooked form.
Switch to using the -cookedEditor commandline argument for game specific cooked editor.
Adjusted parameters to allow the game to override exes to look for and name their module type

#preflight: 620df1e0f44e27e076620baf
[REVIEW] [at]Andrew.Grant [at]Jerome.Delattre [at]Chris.Constantinescu

#ROBOMERGE-AUTHOR: eric.knapik
#ROBOMERGE-SOURCE: CL 19035750 via CL 19037678 via CL 19038828 via CL 19039124 via CL 19039805
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v918-19018356)

[CL 19040295 by eric knapik in ue5-main branch]
2022-02-17 15:08:03 -05:00
Brandon Schaefer
e01b073259 Add support for ASan automation in Gauntlet and EngineTest
#jira UE-133314
#rb Jerome.Delattre
#preflight 620c1d9f475fb819ddcfd467

[CL 19017239 by Brandon Schaefer in ue5-main branch]
2022-02-16 12:43:49 -05:00
andrew grant
04af8afc7f Added a debug statement and exception handler to try and track down a periodic exception in logging from tests
#preflight skip

#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 18468195 via CL 18469208 via CL 18469217 via CL 18469242 via CL 18469457 via CL 18469496
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v899-18417669)

[CL 18469512 by andrew grant in ue5-release-engine-test branch]
2021-12-15 14:16:00 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
geoff evans
949fabfe64 AutomationTool
Fix GetRelativeExecutablePath for usages when specific builds are specified

#rnx
#rb ryan.hummer
#preflight 6153842375fae60001fc794e

#ROBOMERGE-AUTHOR: geoff.evans
#ROBOMERGE-SOURCE: CL 17657370 via CL 17657371 via CL 17657372 via CL 17657373 via CL 17657375
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v875-17642767)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17657378 by geoff evans in ue5-release-engine-test branch]
2021-09-29 00:01:46 -04:00
jonathan adamczewski
b334e50489 Gauntlet: fix project path when launching on Mac
#jira UE-127192
#rb geoff.evans

#ROBOMERGE-AUTHOR: jonathan.adamczewski
#ROBOMERGE-SOURCE: CL 17590867 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)

[CL 17590877 by jonathan adamczewski in ue5-release-engine-test branch]
2021-09-21 21:15:35 -04:00
geoff evans
3e0b0fbc35 AutomationTool: Support for Editor in Project BuildEnvironments
This adds support for running Editor in BuildGraph Command and Commandlet tasks where the Project at hand has it's own BuildEnvironment.

#jira none
#rb ben.marsh
#preflight 6143be8d9bba9a0001dfc9ee

#ROBOMERGE-AUTHOR: geoff.evans
#ROBOMERGE-SOURCE: CL 17546102 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17546103 by geoff evans in ue5-release-engine-test branch]
2021-09-16 19:20:37 -04:00
aurel cordonnier
dc4bf61540 Merge from Release-Engine-Staging @ 17030559 to Release-Engine-Test
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17030553

[CL 17031509 by aurel cordonnier in ue5-release-engine-test branch]
2021-08-03 11:56:47 -04:00