Commit Graph

6 Commits

Author SHA1 Message Date
Jerome Delattre
52972e9898 Fix exclusion list not working when test name is input in the code with extra spaces.
#rb trivial

#ROBOMERGE-OWNER: Jerome.Delattre
#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17944768 via CL 17944954 via CL 17944979 via CL 17945043 via CL 17945064
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v885-17909292)
#ROBOMERGE-CONFLICT from-shelf
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17945181 by Jerome Delattre in ue5-release-engine-test branch]
2021-10-27 11:26:51 -04:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
yoan stamant
58890e5275 misc non-unity compilation fixes
#rb Jerome.Delattre, Rob.Krajcarski, Stu.McKenna

#ROBOMERGE-AUTHOR: yoan.stamant
#ROBOMERGE-SOURCE: CL 17708503 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v879-17706426)

[CL 17708574 by yoan stamant in ue5-release-engine-test branch]
2021-10-04 11:32:01 -04:00
jerome delattre
ed191cd44b Checkout config file before updating test exclude list.
#jira UE-127876
#rb Chris.Constantinescu, Eric Knapik
#rnx

#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17644979 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v875-17642767)

[CL 17644985 by jerome delattre in ue5-release-engine-test branch]
2021-09-28 09:18:11 -04:00
jerome delattre
5bf77ce84e Fix a crash when provided test exclusion Reason string is larger than 1024 characters.
#jira UE-127875
#rb trivial
#rnx

#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17629918 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)

[CL 17629929 by jerome delattre in ue5-release-engine-test branch]
2021-09-27 09:43:27 -04:00
jerome delattre
ef7a418217 Improve test exclusion list mechanic
* Rename blacklist to excludelist (requested by high management)
* Support section exclusion rule to be able to exclude entire section of tests (ie PathTracing is only supported on Win64 for now)
* Mark excluded test as skipped in the report instead of entirely removed for test list. Check for exclusion just before running the test.
* Remove NotEnoughParticipant state in favor of Skipped (same conditions lead to Skipped state with appropriate messaging)
* Add support for exclusion management from the Test Automation window. (added a column at the end of each row)
* Expose device information to UE test report
* Add support for metadata in Gauntlet test report for Horde

Limitations:
* Management through the UI is limited to which test is available through in the active worker node. That's mean Runtime only tests are not listed from a worker that is Editor(the default) and platform specific are not clearly identified.
* For platforms, the mechanic to access their config and save it will remain to be done. In the meantime, it needs to be done manually through the target platform config file.

#jira UE-125960
#jira UE-125974

#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17607554 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257)

[CL 17607557 by jerome delattre in ue5-release-engine-test branch]
2021-09-23 09:35:30 -04:00