#fyi Jerome.Delattre
#jira FORT-617474
Original CL Desc
-----------------------------------------------------------------
Add Support for shader model in automation test framework exclusion list
#jira UE-185221
#preflight 646685c83660522200415d43
#rnx
#rb Chris.Constantinescu
[CL 25715585 by keaton stewart in ue5-main branch]
Adds the value of FApp::GetInstanceId() to the instance field in index.json such that it is now (hostname)-(session ID)-(instance ID)
#jira UE-174430
#preflight 63caca55a265157a6d4fa37b
#rb Jerome.Delattre
[CL 23835184 by hach-que in ue5-main branch]
+ Add support for device tagging through Automation Worker
#preflight 62b1fd0dda272a658f573d57
#rb Chris.Constantinescu
#jira none
[CL 20859264 by Jerome Delattre in ue5-main branch]
* Rename blacklist to excludelist (requested by high management)
* Support section exclusion rule to be able to exclude entire section of tests (ie PathTracing is only supported on Win64 for now)
* Mark excluded test as skipped in the report instead of entirely removed for test list. Check for exclusion just before running the test.
* Remove NotEnoughParticipant state in favor of Skipped (same conditions lead to Skipped state with appropriate messaging)
* Add support for exclusion management from the Test Automation window. (added a column at the end of each row)
* Expose device information to UE test report
* Add support for metadata in Gauntlet test report for Horde
Limitations:
* Management through the UI is limited to which test is available through in the active worker node. That's mean Runtime only tests are not listed from a worker that is Editor(the default) and platform specific are not clearly identified.
* For platforms, the mechanic to access their config and save it will remain to be done. In the meantime, it needs to be done manually through the target platform config file.
#jira UE-125960
#jira UE-125974
#rb Chris.Constantinescu, Eric.Knapik, Louise.Rasmussen
[CL 17607554 by Jerome Delattre in ue5-main branch]
* Isolate code for compressing in PNG and use this code for screenshot image compression
* Mark screenshot as not similar when error message is not empty when considering comparison result
#rnx
#jira UE-121446
#rb Julien.StJean, Chris.Contantinescu
[CL 17138306 by Jerome Delattre in ue5-main branch]
The messaging system destroys these objects with FMemory::Free, which has different alignment logic than operator new when ASAN is used, resulting in a crash.
#jira none
#rnx
#rb Jerome.Delattre, Matt.Peters
[CL 17116813 by mihnea balta in ue5-main branch]
Telemetry data is stored in a csv file that can be picked up later.
Configuration options can be used to specify a custom path and force the csv file to be reset on new (editor) session.
Telemetry data stores: platform, config, datetime, testname, context, datapoint, measurement
#jira UEENGQA-38047
#rb Andrew.Grant
[CL 15667990 by Jerome Delattre in ue5-main branch]
#jira UE-91964
#rb trivial
[FYI] zabir.hoque
#lockdown cristina.riveron
#ROBOMERGE-SOURCE: CL 12868463 in //UE4/Release-4.25/... via CL 12868468 via CL 12868470
#ROBOMERGE-BOT: RELEASE (Release-Engine-Staging -> Main) (v681-12776863)
[CL 12868473 by andrew grant in Main branch]
