Commit Graph

7 Commits

Author SHA1 Message Date
robert manuszewski
f8a812a32f Converting hardcoded short class/enum names to pathnames ahead of ANY_PACKAGE removal
#rb trivial
#jira UE-99463
#preflight 6288fd998828ea88c8aef3d0

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 20314896 via CL 20314897 via CL 20314903 via CL 20314904
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)

[CL 20315214 by robert manuszewski in ue5-main branch]
2022-05-22 10:30:02 -04:00
aurel cordonnier
34f55d3a4a Merge from Release-Engine-Test @ 17946149 to UE5/Main
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17949667 by aurel cordonnier in ue5-main branch]
2021-10-27 15:14:40 -04:00
Jerome Delattre
4625465c40 Fix exclusion list not working when test name is input in the code with extra spaces.
#rb trivial

#ROBOMERGE-OWNER: Jerome.Delattre
#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17944768 via CL 17944954 via CL 17944979 via CL 17945043 via CL 17945064 via CL 17945181
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v885-17909292)
#ROBOMERGE-CONFLICT from-shelf

[CL 17945245 by Jerome Delattre in ue5-main branch]
2021-10-27 11:31:29 -04:00
Yoan StAmant
489db6b562 misc non-unity compilation fixes
#rb Jerome.Delattre, Rob.Krajcarski, Stu.McKenna

[CL 17708503 by Yoan StAmant in ue5-main branch]
2021-10-04 11:29:10 -04:00
Jerome Delattre
667dc535e7 Checkout config file before updating test exclude list.
#jira UE-127876
#rb Chris.Constantinescu, Eric Knapik
#rnx

[CL 17644979 by Jerome Delattre in ue5-main branch]
2021-09-28 09:16:59 -04:00
Jerome Delattre
df8b02bb26 Fix a crash when provided test exclusion Reason string is larger than 1024 characters.
#jira UE-127875
#rb trivial
#rnx

[CL 17629918 by Jerome Delattre in ue5-main branch]
2021-09-27 09:42:31 -04:00
Jerome Delattre
60839c1816 Improve test exclusion list mechanic
* Rename blacklist to excludelist (requested by high management)
* Support section exclusion rule to be able to exclude entire section of tests (ie PathTracing is only supported on Win64 for now)
* Mark excluded test as skipped in the report instead of entirely removed for test list. Check for exclusion just before running the test.
* Remove NotEnoughParticipant state in favor of Skipped (same conditions lead to Skipped state with appropriate messaging)
* Add support for exclusion management from the Test Automation window. (added a column at the end of each row)
* Expose device information to UE test report
* Add support for metadata in Gauntlet test report for Horde

Limitations:
* Management through the UI is limited to which test is available through in the active worker node. That's mean Runtime only tests are not listed from a worker that is Editor(the default) and platform specific are not clearly identified.
* For platforms, the mechanic to access their config and save it will remain to be done. In the meantime, it needs to be done manually through the target platform config file.

#jira UE-125960
#jira UE-125974
#rb Chris.Constantinescu, Eric.Knapik, Louise.Rasmussen

[CL 17607554 by Jerome Delattre in ue5-main branch]
2021-09-23 09:34:55 -04:00