jerome delattre
25d929e456
Fix an issue with Automation Command line not being initiated properly
...
#rnx
[CL 30343851 by jerome delattre in ue5-main branch]
2023-12-15 02:13:35 -05:00
jerome delattre
52ad19c319
Fix issue with Automation commands conflicting with Automation CVar
...
#rnx
#rb rob.huyett, sebastian.lewicki
[CL 30302130 by jerome delattre in ue5-main branch]
2023-12-13 15:18:55 -05:00
jerome delattre
299bd595cf
Fix exclusion not working in Test Automation search field
...
Avoid always adding child items if parents are included.
#jira UE-202447
#rnx
#rb rob.huyett, sebastian.lewicki
[CL 30291344 by jerome delattre in ue5-main branch]
2023-12-13 09:15:53 -05:00
oleg krasnov
9650d68fce
AutomationTest - Use FApp::GetInstanceId() instead of Messaging Address to identify Automation worker
...
#jira UE-200940
#rb Jerome.Delattre
#rnx
[CL 30232238 by oleg krasnov in ue5-main branch]
2023-12-11 01:29:09 -05:00
jerome delattre
e898ae373b
Avoid running all tests if Group filter does not exist
...
#rnx
#rb chris.constantinescu, sebastian.lewicki
[CL 30184386 by jerome delattre in ue5-main branch]
2023-12-07 12:51:00 -05:00
jerome delattre
c0a721c39d
Support load and save of platform specific test exclusion list from the Test Automation window
...
#jira UE-143194
#rb rob.huyett, sean.sweeney, sebastian.lewicki
[CL 30126371 by jerome delattre in ue5-main branch]
2023-12-05 13:29:22 -05:00
christopher fiala
d5ec52b3cc
Add a new CVar, Automation.LightweightStereoTestVariants, which stops variants from running if we've already encounted an error, and skips saving/attaching screenshots for successful variants to save space. Enabled by default. Also moves the "Supports Stereo Test Variants" checkbox to the "Screenshot" section.
...
#jira UE-194361
#rb jerome.delattre, chris.constantinescu
[CL 29718813 by christopher fiala in ue5-main branch]
2023-11-14 13:31:30 -05:00
christopher fiala
a0d65ab7f0
Move the global stereo test variants CVar out of ScreenshotFunctionalTest.cpp and into AutomationTest.cpp as "Automation.EnableStereoTestVariants", where it can now be controlled via the automation commandline
...
(e.g. "Automation Runtest Anisotropy;EnableStereoTests;Quit;").
#jira UE-194361
#rb jeff.fisher
[CL 29529430 by christopher fiala in ue5-main branch]
2023-11-07 14:57:30 -05:00
jerome delattre
4a5957a406
Add frame comparison failure to the test report when comparing image sequence for Movie Pipeline Functional Test
...
+ Improve messaging when movie pipeline test is failing for reason other than image comparison.
+ Store ScreenshotName inside comparison request and result.
#jira UE-194701
#rnx
#rb Matt.Hoffman, Sean.Sweeney
[CL 28750594 by jerome delattre in ue5-main branch]
2023-10-13 09:42:36 -04:00
oleg krasnov
6f6f351000
Implement OnBeforeAllTestsEvent and OnAfterAllTestsEvent in FAutomationTestFramework
...
#jira UE-189725
#rb jerome.delattre chris.constantinescu rob.huyett
[CL 26541344 by oleg krasnov in ue5-main branch]
2023-07-24 09:12:45 -04:00
jerome delattre
c9ee79a91a
Fix missing deviceInstance in test results when running without ResumeRunTests flag
...
#rnx
#rb trivial
[CL 26510110 by jerome delattre in ue5-main branch]
2023-07-21 10:07:13 -04:00
jerome delattre
25cc6a7006
Fix infinite loop when Quit command is input more than once
...
#rnx
#rb Clayton.Langford
[CL 26150778 by jerome delattre in ue5-main branch]
2023-06-21 11:26:41 -04:00
Jerome Delattre
86452037e1
Fix ExecCmds Automation queueing command line to support input like -exccmds="Automation RunTest MyTest,Automation List,Automation Quit"
...
#rnx
#rb Chris.Constantinescu
[CL 26050022 by Jerome Delattre in ue5-main branch]
2023-06-16 09:52:35 -04:00
Jerome Delattre
81e77c198f
Fix filtered out test results in automation window for the case when "Search" bar is not empty.
...
Introduce GetEnabledReports and GetFilteredReports; deprecated unspecific GetReports
#rnx
#fyi Oleg.Krasnov
[CL 25976576 by Jerome Delattre in ue5-main branch]
2023-06-14 09:46:24 -04:00
oleg krasnov
ae76461bc6
Implement auto expansion of subgroups that has only one child in SessionFrontend
...
#jira UE-187980
#rb jerome.delattre
[CL 25973143 by oleg krasnov in ue5-main branch]
2023-06-14 04:56:18 -04:00
Jerome Delattre
3ee021ae02
Automation test - standardize status in csv report
...
#rnx
#rb trivial
[CL 25898326 by Jerome Delattre in ue5-main branch]
2023-06-09 13:28:42 -04:00
Jerome Delattre
f10d768dc5
Remove extra characters from skipped and warning status in local csv test report
...
#rnx
#rb trivial
[CL 25892174 by Jerome Delattre in ue5-main branch]
2023-06-09 10:08:59 -04:00
oleg krasnov
5382b63d85
Add header and remove redundant information from exported test results (csv).
...
#jira UE-186122
#rb jerome.delattre
[CL 25888347 by oleg krasnov in ue5-main branch]
2023-06-09 03:01:40 -04:00
jodon karlik
80e2303e74
Adding a GameplayTagQuery field to FGameplayTagRequirements to enable more complex requirements to be specified.
...
[CL 25833608 by jodon karlik in ue5-main branch]
2023-06-06 20:26:28 -04:00
galeone
431c09150e
[UBT] Add support for Code coverage on Linux
...
#rb Brandon.Schaefer, Jerome.Delattre, Joe.Kirchoff
[CL 25794147 by galeone in ue5-main branch]
2023-06-05 12:03:25 -04:00
kirill zorin
b6ee3a6c64
Fix UE_LOG callsites that have format string-related UB
...
#rb trivial
#preflight 647107780a6634dbb236a0a6
[CL 25651638 by kirill zorin in ue5-main branch]
2023-05-26 15:52:39 -04:00
jerome delattre
a9ab832834
Avoid changing the AutomationController state when running test while receiving multiple FindWorkers responses
...
#jira UE-182629
#preflight 643dab42db681113a4bae55b
[CL 25089967 by jerome delattre in ue5-main branch]
2023-04-18 13:26:37 -04:00
zahra nikbakht
680c959a65
Allow source link detection in MessageLog text when the source address is located at the right of the message (previously it would only work when the source address was on the left of the message)
...
#jira UE-172487
#preflight 6425a86bc463fac9c8ffa4f2
#rb Jerome.Delattre
[CL 24859391 by zahra nikbakht in ue5-main branch]
2023-03-30 16:07:32 -04:00
Mikita Hauruk
bcd6b04355
Added EComparisonFileTypes enum for IAutomationReport.h, changed TEXT() to enum AutomationControllerManager.cpp when referencing test report Artifact file key
...
Use enum or predefined const strings when referencing test report Artifact file key in FAutomationArtifact
#jira UE-176635
#rb adam.miezianko, chris.constantinescu, jerome.delattre, oleg.krasnov, saltanat.janybekova, mikalai.sukhikh
#preflight 63ecbb15956709374afcfd36
[CL 24309464 by Mikita Hauruk in ue5-main branch]
2023-02-20 01:02:38 -05:00
Joe Kirchoff
3c75f6cb4f
Fix include path inconsistentcy with Launch module when -AllModules is passed
...
#rnx
#rb trivial
#jira UE-176944
#preflight 63eaaeb1923476b686f41991
[CL 24190159 by Joe Kirchoff in ue5-main branch]
2023-02-13 16:49:45 -05:00
