Commit Graph

5 Commits

Author SHA1 Message Date
aurel cordonnier
34f55d3a4a Merge from Release-Engine-Test @ 17946149 to UE5/Main
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17949667 by aurel cordonnier in ue5-main branch]
2021-10-27 15:14:40 -04:00
Jerome Delattre
4625465c40 Fix exclusion list not working when test name is input in the code with extra spaces.
#rb trivial

#ROBOMERGE-OWNER: Jerome.Delattre
#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17944768 via CL 17944954 via CL 17944979 via CL 17945043 via CL 17945064 via CL 17945181
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v885-17909292)
#ROBOMERGE-CONFLICT from-shelf

[CL 17945245 by Jerome Delattre in ue5-main branch]
2021-10-27 11:31:29 -04:00
Yoan StAmant
489db6b562 misc non-unity compilation fixes
#rb Jerome.Delattre, Rob.Krajcarski, Stu.McKenna

[CL 17708503 by Yoan StAmant in ue5-main branch]
2021-10-04 11:29:10 -04:00
Jerome Delattre
667dc535e7 Checkout config file before updating test exclude list.
#jira UE-127876
#rb Chris.Constantinescu, Eric Knapik
#rnx

[CL 17644979 by Jerome Delattre in ue5-main branch]
2021-09-28 09:16:59 -04:00
Jerome Delattre
60839c1816 Improve test exclusion list mechanic
* Rename blacklist to excludelist (requested by high management)
* Support section exclusion rule to be able to exclude entire section of tests (ie PathTracing is only supported on Win64 for now)
* Mark excluded test as skipped in the report instead of entirely removed for test list. Check for exclusion just before running the test.
* Remove NotEnoughParticipant state in favor of Skipped (same conditions lead to Skipped state with appropriate messaging)
* Add support for exclusion management from the Test Automation window. (added a column at the end of each row)
* Expose device information to UE test report
* Add support for metadata in Gauntlet test report for Horde

Limitations:
* Management through the UI is limited to which test is available through in the active worker node. That's mean Runtime only tests are not listed from a worker that is Editor(the default) and platform specific are not clearly identified.
* For platforms, the mechanic to access their config and save it will remain to be done. In the meantime, it needs to be done manually through the target platform config file.

#jira UE-125960
#jira UE-125974
#rb Chris.Constantinescu, Eric.Knapik, Louise.Rasmussen

[CL 17607554 by Jerome Delattre in ue5-main branch]
2021-09-23 09:34:55 -04:00