Commit Graph

489 Commits

Author SHA1 Message Date
jerome delattre
74fe918da9 Log Suspend/Resume log parsing through the legacy logger
#preflight 6376a41e33774509002dd8f7
#rb Josh.Engebretson

[CL 23191016 by jerome delattre in ue5-main branch]
2022-11-18 03:12:45 -05:00
Jerome Delattre
590093ed9b Always take the last member of the string for build command
+ add more arguments to filter out

#preflight 6373abd81c114bec05ac2458
#rnx
#jira none
#rb Chris.Constantinescu

[CL 23159710 by Jerome Delattre in ue5-main branch]
2022-11-16 14:47:44 -05:00
jerome delattre
3c4ffdb8f4 Use Structured Logging in Gauntlet
#jira UE-163471
#preflight 63700c1e0c74adb48bb9a5c9
#rb J.Baumgartner, Erik.Knapik, Chris.Constantinescu, Josh.Engebretson

[CL 23112357 by jerome delattre in ue5-main branch]
2022-11-12 18:42:11 -05:00
eric knapik
6daa77dced #jira: none
Typo fixup

[CL 23091032 by eric knapik in ue5-main branch]
2022-11-10 19:58:12 -05:00
Jerome Delattre
f712b703cf Avoid using a time based query when validating log
#jira UE-166899
#preflight 636d190bee08c7634fc45b59
#rnx
#rb Chris.Constantinescu

[CL 23083713 by Jerome Delattre in ue5-main branch]
2022-11-10 13:18:38 -05:00
Josh Engebretson
85b49aca06 Horde: Add version to Gauntlet horde reports, add some basic test information to simple reports for new backend
#jira none
#rnx
#rb Jerome.Delattre
#preflight 636a640af56cab38c7242313

[CL 23053411 by Josh Engebretson in ue5-main branch]
2022-11-09 08:55:04 -05:00
danny couture
7c53cc6c77 Add missing Insight events during EditorPerf tests
#rnx
#rb Francis.Hurteau
#preflight 63691167450be1d9f8cfe5b8

[CL 23012742 by danny couture in ue5-main branch]
2022-11-07 12:14:07 -05:00
brian white
15be63a8d2 Modify Callstack matching regex to elide module address if present.
#jira UE-158038
#rb Andrew.Grant
#preflight https://horde.devtools.epicgames.com/job/634f293f864d9be2364e95ea

[CL 22988386 by brian white in ue5-main branch]
2022-11-04 11:55:41 -04:00
jerome delattre
403868839c Fix unable to find an explicitly requested Gauntlet test not part of the preferred namespaces
#jira UE-169002
#preflight 63629fe76000216d2e119520
#rb Brendan.Lienau

[CL 22931852 by jerome delattre in ue5-main branch]
2022-11-02 19:37:40 -04:00
jerome delattre
bbedaaaaf7 Gauntlet - Fix UE error parsing from log
#preflight 63627c4faf536047f4e2c501
#rb trivial

[CL 22919822 by jerome delattre in ue5-main branch]
2022-11-02 12:52:54 -04:00
brendan lienau
b57dd1b2a0 [Automation] Adjusts Gauntlet's test discovery to prioritize tests containing targeted namespaces
#rb j.baumgartner

[CL 22890154 by brendan lienau in ue5-main branch]
2022-11-01 16:02:11 -04:00
eric knapik
b095d01d71 #jira: none
Undo CL: 22849610
This caused issues with replay testing as null artifacts were not correctly being saved.
Adjusting the FunctionalTest so it runs then generates a blank artifact.
overriding the GetTestSummary header when we know no test will be ran.

#preflight 6361464763608aee36f71c87

[CL 22890128 by eric knapik in ue5-main branch]
2022-11-01 16:01:26 -04:00
brendan lienau
c4f555898b [Automation] Gives the ability to specify a "-staged" param which will append a Loose BuildFlag requirement if valid
#rb j.baumgartner

[CL 22888727 by brendan lienau in ue5-main branch]
2022-11-01 15:11:51 -04:00
eric knapik
eb7ece625e #jira: UE-168744
Add null check on InLog

[REVIEW] Jerome.Delattre
#preflight 636012cc561635187863caf4

[CL 22875474 by eric knapik in ue5-main branch]
2022-10-31 20:03:11 -04:00
eric knapik
79662b0c11 #jira: FORT-507969
Disabling many creative tests that don't work
Adding new ContextFunctionalTest to look at all of the previous files that have been modified and find the tests that best match the modified files

Added additional core function for getting the referencers for a set of assets up to a specified search depth.

Added the ContextFunctionalTest gauntlet job so we can run this in horde
example launching method:

[REVIEW] [at]Gary.Yuan [at]Tim.Kennedy [at]Cory.Kolek
#preflight 635c7dc41803be35c7886bbe

[CL 22850798 by eric knapik in ue5-main branch]
2022-10-29 03:01:13 -04:00
jerome delattre
53590855ec Gauntlet - Clear RolesToInstalls only if it was initialized
#jira UE-166161
#rnx
#rb Willian.Ewen
#preflight 6356f53d3d41a4455a640c80

[CL 22787022 by jerome delattre in ue5-main branch]
2022-10-26 15:29:16 -04:00
jerome delattre
d25695567d Get Editor role based on Config setting (unify Editor and CookedEditor)
#rnx
#rb Eric.Knapik
#preflight 6352ad010313c249742d11ae

[CL 22711554 by jerome delattre in ue5-main branch]
2022-10-22 14:43:21 -04:00
eric knapik
0ffc2e54b8 #jira: none
Adding quotes as some tests can have a . in them

[CL 22634733 by eric knapik in ue5-main branch]
2022-10-19 15:11:50 -04:00
dmitrii ubirailo
069e2d1532 Supported defining alternative folder for UEFN by setting environemt variable UE_BUILDS_PATH.
[REVIEW] Anna.Fukutome, Eric.Knapik
#preflight skip

[CL 22619920 by dmitrii ubirailo in ue5-main branch]
2022-10-19 03:05:28 -04:00
eric knapik
c1544b1a9c #jira: FORT-526894
Add missing -test= to how to run locally text

[CL 22606078 by eric knapik in ue5-main branch]
2022-10-18 13:59:37 -04:00
j baumgartner
bd4ac13fc4 [Automation] Add missing logic to handle the new -perfmodel= commandline to gauntlet.
#rb josh.engebretson, ben.salem
#tests tested running a few tests with perfmodel and perfspec to make sure both functionalities worked
#rnx

[CL 22546730 by j baumgartner in ue5-main branch]
2022-10-14 22:19:53 -04:00
eric knapik
26df6dea74 #jira: FORT-477143, FORT-448935
Have gauntlet display the command a test was ran with
Add server output to the horde log so errors can be easier identified from a webpage.
Fixing a typo with Text which should have been Test

#preflight 63408864587d6afac86da474
#rb: Gary.Yuan
https://p4-swarm.epicgames.net/reviews/22408413/

[CL 22451857 by eric knapik in ue5-main branch]
2022-10-11 02:54:50 -04:00
gary yuan
3ddd4e57c7 Marking up more parameter help attributes on Gauntlet commands
#rb eric.knapik
#preflight 633cc7f3393e657831cef406

[CL 22366405 by gary yuan in ue5-main branch]
2022-10-05 19:16:50 -04:00
gary yuan
676c1e7db2 Marking up Gauntlet classes with parameter help attributes
#rb Tim.Kennedy
#preflight 633711f15c2225fe5f78f7b7

[CL 22286636 by gary yuan in ue5-main branch]
2022-09-30 23:10:15 -04:00
jerome delattre
6e8068c544 Add argument to setup Module Role
+ Enforce using a the CustomModuleRoles argument with CookedEditor in BuildAndTestProject buildgraph

#jira UE-165358
#rnx
#preflight 6335ed6ed165c45137b2eaf6
#rb Chris.Constinescu

[CL 22284248 by jerome delattre in ue5-main branch]
2022-09-30 19:25:03 -04:00