jerome delattre
43322bb6a0
Validate active screenshot id before accepting screenshot comparison completion
...
#jira UE-202925
#rnx
#rb christopher.fiala, sean.sweeney, sebastian.lewicki
[CL 32122480 by jerome delattre in ue5-main branch]
2024-03-08 11:48:08 -05:00
steve robb
f029468598
Fixed up a lot of bool-taking container resize functions to take EAllowShrinking instead.
...
[CL 30729174 by steve robb in ue5-main branch]
2024-01-19 16:41:35 -05:00
sergei svetlov
c739c0cb35
Clean up screenshot comparison report pipeline
...
#rb Jerome.Delattre
#jira UE-200919
#rnx
[CL 30687983 by sergei svetlov in ue5-main branch]
2024-01-18 12:22:38 -05:00
oleg krasnov
9650d68fce
AutomationTest - Use FApp::GetInstanceId() instead of Messaging Address to identify Automation worker
...
#jira UE-200940
#rb Jerome.Delattre
#rnx
[CL 30232238 by oleg krasnov in ue5-main branch]
2023-12-11 01:29:09 -05:00
jerome delattre
c0a721c39d
Support load and save of platform specific test exclusion list from the Test Automation window
...
#jira UE-143194
#rb rob.huyett, sean.sweeney, sebastian.lewicki
[CL 30126371 by jerome delattre in ue5-main branch]
2023-12-05 13:29:22 -05:00
jerome delattre
4dcbf3ce0c
Introduce OnEnteringTestSectionEvent, OnLeavingTestSectionEvent
...
Called when entering and leaving test section.
ie:
For a test named MyTest.Log.Validation.TestTrue
These will be called through OnEnteringTestSectionEvent before any test of the corresponding section is executed:
- MyTest
- MyTest.Log
- MyTest.Log.Validation
And the corresponding one when leaving the section after execution.
One can register a callback this way:
FAutomationTestFramework::Get().GetOnEnteringTestSection(TEXT("MyTest.Log")).AddRaw(this, &FMyModule::MySectionCallback);
As first argument the name of the section is passed.
#rb Sebastian.Lewicki
[CL 29323495 by jerome delattre in ue5-main branch]
2023-11-01 13:22:44 -04:00
jerome delattre
4a5957a406
Add frame comparison failure to the test report when comparing image sequence for Movie Pipeline Functional Test
...
+ Improve messaging when movie pipeline test is failing for reason other than image comparison.
+ Store ScreenshotName inside comparison request and result.
#jira UE-194701
#rnx
#rb Matt.Hoffman, Sean.Sweeney
[CL 28750594 by jerome delattre in ue5-main branch]
2023-10-13 09:42:36 -04:00
Jerome Delattre
dcaf67b0e2
Fix Failed to save completion automated test report
...
#jira UE-194805
#rnx
#rb Sebastian.Lewicki, Oleg.Krasnov
[CL 27711431 by Jerome Delattre in ue5-main branch]
2023-09-08 10:47:27 -04:00
oleg krasnov
d0173b6b39
Add extra context information when messaging skip reason
...
#jira UE-186405
#rb Jerome.Delattre
[CL 26700451 by oleg krasnov in ue5-main branch]
2023-07-31 04:15:13 -04:00
oleg krasnov
6f6f351000
Implement OnBeforeAllTestsEvent and OnAfterAllTestsEvent in FAutomationTestFramework
...
#jira UE-189725
#rb jerome.delattre chris.constantinescu rob.huyett
[CL 26541344 by oleg krasnov in ue5-main branch]
2023-07-24 09:12:45 -04:00
Jerome Delattre
90ab1647b1
Test Exclusion list - Differentiate null rhi from lack of information
...
+ Always extract Feature Level string
#rnx
#rb trivial
[CL 25952256 by Jerome Delattre in ue5-main branch]
2023-06-13 11:05:05 -04:00
Jerome Delattre
448b0aff16
Fix Exclusion list not working properly on Runtime Game
...
#rnx
[CL 25801899 by Jerome Delattre in ue5-main branch]
2023-06-05 16:01:32 -04:00
Jerome Delattre
80363edc22
Add Support for shader model in automation test framework exclusion list (2nd try)
...
#jira UE-185221
#preflight 64789f69f8715b9b1bfa6ab8
#preflight 6478c221947ff6973c225d8c
#rnx
#rb Chris.Constantinescu
[CL 25736798 by Jerome Delattre in ue5-main branch]
2023-06-01 15:31:00 -04:00
keaton stewart
8bc2626ba4
[Backout] - CL25713520
...
#fyi Jerome.Delattre
#jira FORT-617474
Original CL Desc
-----------------------------------------------------------------
Add Support for shader model in automation test framework exclusion list
#jira UE-185221
#preflight 646685c83660522200415d43
#rnx
#rb Chris.Constantinescu
[CL 25715585 by keaton stewart in ue5-main branch]
2023-05-31 17:39:06 -04:00
Jerome Delattre
82bc568a43
Add Support for shader model in automation test framework exclusion list
...
#jira UE-185221
#preflight 646685c83660522200415d43
#rnx
#rb Chris.Constantinescu
[CL 25713520 by Jerome Delattre in ue5-main branch]
2023-05-31 16:39:48 -04:00
oleg krasnov
e879a455ee
Add FAutomationTestBase::CanRunInEnvironment methods with basic implementation
...
#jira UE-181613
#rb adam.miezianko, chris.constantinescu, jerome.delattre
#preflight 64665b008377b53e1d00bced
#preflight 64665b1736605222002bbf2c
#preflight 646664bb743f7c995bcd6aab
[CL 25530771 by oleg krasnov in ue5-main branch]
2023-05-18 14:52:21 -04:00
Jerome Delattre
5fc9bd1e54
Undo fix from changelist 24482958 (Disable testing in Client net mode)
...
#rnx
#jira UE-179253
#preflight 64065cffaa00423335e578c9
#rb backout
[CL 24531223 by Jerome Delattre in ue5-main branch]
2023-03-06 16:50:52 -05:00
oleg krasnov
70a461259e
Disable testing in Client net mode
...
#jira UE-110748
#rb adam.miezianko, chris.constantinescu, jerome.delattre
#preflight 64003f56437ce3e7f34c2611
#preflight 64003fa1c00784bee282f006
#preflight 64004052f43e53f68194d93d
[CL 24482958 by oleg krasnov in ue5-main branch]
2023-03-02 11:07:04 -05:00
hach-que
828e0840ec
PR #10022 : Include instance ID in automation InstanceName (Contributed by hach-que)
...
Adds the value of FApp::GetInstanceId() to the instance field in index.json such that it is now (hostname)-(session ID)-(instance ID)
#jira UE-174430
#preflight 63caca55a265157a6d4fa37b
#rb Jerome.Delattre
[CL 23835184 by hach-que in ue5-main branch]
2023-01-24 14:02:19 -05:00
ludovic chabant
8141e528a1
Delete deprecated automation classes
...
These were using Matinee before, which has been removed. These automation classes would have to be rewritten using sequencer, but level sequence actors are in a different module.
#rb andrew.rodham, matt.hoffman
#jira UE-105313
#preflight 63586c21555771b1419af8ff
[CL 22803522 by ludovic chabant in ue5-main branch]
2022-10-26 23:20:03 -04:00
Jerome Delattre
01f4b6e7b4
Simplify RHI string when excluding tests by removing the shader model extension
...
- follow up to 21852012
#preflight 631b719aa60c539c98f0992d
#rnx
#jira none
#rb christopher.waters, Chris.Constantinescu
[CL 21927261 by Jerome Delattre in ue5-main branch]
2022-09-09 16:21:53 -04:00
bryan sefcik
cb0456c6d4
Cleaned up build.cs files by removing any include paths that were already being added by UBT. This was done to help identify how include paths are being added and to help with future refactoring.
...
#jira
#preflight 631a5c04967ffc68fbf0dd8f
[CL 21911226 by bryan sefcik in ue5-main branch]
2022-09-08 21:44:02 -04:00
jerome delattre
633b27d9c0
Revert 21824856 (Retry sending a request to run a test if schedule was not confirmed)
...
#rnx
[CL 21908280 by jerome delattre in ue5-main branch]
2022-09-08 20:11:38 -04:00
jerome delattre
ec6f3a74bc
Put back LLM scope and float to double change in test Automation modules
...
#rnx
[CL 21828531 by jerome delattre in ue5-main branch]
2022-09-06 16:29:09 -04:00
jerome delattre
0998fb6b90
Test Automation - Retry sending a request to run a test if schedule was not confirmed.
...
#preflight 631767b36431d379928cc011
#rb Chris.Constantinescu
#rnx
[CL 21828390 by jerome delattre in ue5-main branch]
2022-09-06 16:23:26 -04:00