Commit Graph

481 Commits

Author SHA1 Message Date
jerome delattre
403868839c Fix unable to find an explicitly requested Gauntlet test not part of the preferred namespaces
#jira UE-169002
#preflight 63629fe76000216d2e119520
#rb Brendan.Lienau

[CL 22931852 by jerome delattre in ue5-main branch]
2022-11-02 19:37:40 -04:00
jerome delattre
bbedaaaaf7 Gauntlet - Fix UE error parsing from log
#preflight 63627c4faf536047f4e2c501
#rb trivial

[CL 22919822 by jerome delattre in ue5-main branch]
2022-11-02 12:52:54 -04:00
brendan lienau
b57dd1b2a0 [Automation] Adjusts Gauntlet's test discovery to prioritize tests containing targeted namespaces
#rb j.baumgartner

[CL 22890154 by brendan lienau in ue5-main branch]
2022-11-01 16:02:11 -04:00
eric knapik
b095d01d71 #jira: none
Undo CL: 22849610
This caused issues with replay testing as null artifacts were not correctly being saved.
Adjusting the FunctionalTest so it runs then generates a blank artifact.
overriding the GetTestSummary header when we know no test will be ran.

#preflight 6361464763608aee36f71c87

[CL 22890128 by eric knapik in ue5-main branch]
2022-11-01 16:01:26 -04:00
brendan lienau
c4f555898b [Automation] Gives the ability to specify a "-staged" param which will append a Loose BuildFlag requirement if valid
#rb j.baumgartner

[CL 22888727 by brendan lienau in ue5-main branch]
2022-11-01 15:11:51 -04:00
eric knapik
eb7ece625e #jira: UE-168744
Add null check on InLog

[REVIEW] Jerome.Delattre
#preflight 636012cc561635187863caf4

[CL 22875474 by eric knapik in ue5-main branch]
2022-10-31 20:03:11 -04:00
eric knapik
79662b0c11 #jira: FORT-507969
Disabling many creative tests that don't work
Adding new ContextFunctionalTest to look at all of the previous files that have been modified and find the tests that best match the modified files

Added additional core function for getting the referencers for a set of assets up to a specified search depth.

Added the ContextFunctionalTest gauntlet job so we can run this in horde
example launching method:

[REVIEW] [at]Gary.Yuan [at]Tim.Kennedy [at]Cory.Kolek
#preflight 635c7dc41803be35c7886bbe

[CL 22850798 by eric knapik in ue5-main branch]
2022-10-29 03:01:13 -04:00
jerome delattre
53590855ec Gauntlet - Clear RolesToInstalls only if it was initialized
#jira UE-166161
#rnx
#rb Willian.Ewen
#preflight 6356f53d3d41a4455a640c80

[CL 22787022 by jerome delattre in ue5-main branch]
2022-10-26 15:29:16 -04:00
jerome delattre
d25695567d Get Editor role based on Config setting (unify Editor and CookedEditor)
#rnx
#rb Eric.Knapik
#preflight 6352ad010313c249742d11ae

[CL 22711554 by jerome delattre in ue5-main branch]
2022-10-22 14:43:21 -04:00
eric knapik
0ffc2e54b8 #jira: none
Adding quotes as some tests can have a . in them

[CL 22634733 by eric knapik in ue5-main branch]
2022-10-19 15:11:50 -04:00
dmitrii ubirailo
069e2d1532 Supported defining alternative folder for UEFN by setting environemt variable UE_BUILDS_PATH.
[REVIEW] Anna.Fukutome, Eric.Knapik
#preflight skip

[CL 22619920 by dmitrii ubirailo in ue5-main branch]
2022-10-19 03:05:28 -04:00
eric knapik
c1544b1a9c #jira: FORT-526894
Add missing -test= to how to run locally text

[CL 22606078 by eric knapik in ue5-main branch]
2022-10-18 13:59:37 -04:00
j baumgartner
bd4ac13fc4 [Automation] Add missing logic to handle the new -perfmodel= commandline to gauntlet.
#rb josh.engebretson, ben.salem
#tests tested running a few tests with perfmodel and perfspec to make sure both functionalities worked
#rnx

[CL 22546730 by j baumgartner in ue5-main branch]
2022-10-14 22:19:53 -04:00
eric knapik
26df6dea74 #jira: FORT-477143, FORT-448935
Have gauntlet display the command a test was ran with
Add server output to the horde log so errors can be easier identified from a webpage.
Fixing a typo with Text which should have been Test

#preflight 63408864587d6afac86da474
#rb: Gary.Yuan
https://p4-swarm.epicgames.net/reviews/22408413/

[CL 22451857 by eric knapik in ue5-main branch]
2022-10-11 02:54:50 -04:00
gary yuan
3ddd4e57c7 Marking up more parameter help attributes on Gauntlet commands
#rb eric.knapik
#preflight 633cc7f3393e657831cef406

[CL 22366405 by gary yuan in ue5-main branch]
2022-10-05 19:16:50 -04:00
gary yuan
676c1e7db2 Marking up Gauntlet classes with parameter help attributes
#rb Tim.Kennedy
#preflight 633711f15c2225fe5f78f7b7

[CL 22286636 by gary yuan in ue5-main branch]
2022-09-30 23:10:15 -04:00
jerome delattre
6e8068c544 Add argument to setup Module Role
+ Enforce using a the CustomModuleRoles argument with CookedEditor in BuildAndTestProject buildgraph

#jira UE-165358
#rnx
#preflight 6335ed6ed165c45137b2eaf6
#rb Chris.Constinescu

[CL 22284248 by jerome delattre in ue5-main branch]
2022-09-30 19:25:03 -04:00
william ewen
f9530b1ad3 Gauntlet: Make sure we don't erroneously try to reuse an install on a previous device if we had trouble launching on that device, or if we released devices at any point
#rb josh.engebretson

[CL 22264062 by william ewen in ue5-main branch]
2022-09-30 01:36:51 -04:00
william ewen
19b11fcb3e Gauntlet: Make DeviceReservations forget problem devices between passes, so that the DeviceService is authoritative
#rb josh.engebretson

[CL 22203062 by william ewen in ue5-main branch]
2022-09-27 06:57:20 -04:00
j baumgartner
df850050eb Compilation fix
#rb william.ewen

[CL 22148167 by j baumgartner in ue5-main branch]
2022-09-22 18:50:21 -04:00
william ewen
fa6b069775 Gauntlet: Make it so multi-pass tests will retain devices between each run
#rb Josh.Engebretson
[FYI] Andrew.Grant

[CL 22147439 by william ewen in ue5-main branch]
2022-09-22 18:17:10 -04:00
brandon schaefer
e08d29da57 Disable splash screen when running unattended
EngineTest simply does not have a splash screen and we warn on Linux. Lets just disable it for these tests

#jira UE-153920
#rb Josh.Adams
#preflight N/A
[FYI] Robert.Seiver

[CL 22042330 by brandon schaefer in ue5-main branch]
2022-09-15 20:02:08 -04:00
chris constantinescu
ddf55c6ac2 Retry save role artifacts once with device reboot on exception containing message "A retry should be performed"
#jira UE-161735
#rb Jerome.Delattre
#preflight skip

[CL 21896605 by chris constantinescu in ue5-main branch]
2022-09-08 12:50:25 -04:00
ben salem
4a662bbbac Fix Gauntlet throwing an InitializationFailed error when a process fails to log in.
#rb brendan.lienau, j.baumgartner

[CL 21864920 by ben salem in ue5-main branch]
2022-09-07 18:12:06 -04:00
Jerome Delattre
040633abd1 Fix Cooked Editor exported path in Windows
+ set CookedEditor role in Gauntlet UE tests when -cookededitor switch is used

#jira none
#rb Nick.bullard
#preflight 631269c6a20b67673b862af4
#rnx

[CL 21849523 by Jerome Delattre in ue5-main branch]
2022-09-07 09:51:36 -04:00