Commit Graph

25 Commits

Author SHA1 Message Date
oleg krasnov
d63fe33e5d AutomationTest - Add support for a task tracker field in the Exclude Test Options
#jira UE-202465
#rb Jerome.Delattre
#rnx

[CL 30764013 by oleg krasnov in ue5-main branch]
2024-01-22 01:42:51 -05:00
jerome delattre
c0a721c39d Support load and save of platform specific test exclusion list from the Test Automation window
#jira UE-143194
#rb rob.huyett, sean.sweeney, sebastian.lewicki

[CL 30126371 by jerome delattre in ue5-main branch]
2023-12-05 13:29:22 -05:00
henrik karlsson
5db685f97d [Engine]
* Moved dllexport from type to methods/staticvar in all Engine runtime code. This improves compile times, memory and performance in dll builds

[CL 26082269 by henrik karlsson in ue5-main branch]
2023-06-17 18:13:06 -04:00
Jerome Delattre
448b0aff16 Fix Exclusion list not working properly on Runtime Game
#rnx

[CL 25801899 by Jerome Delattre in ue5-main branch]
2023-06-05 16:01:32 -04:00
Jerome Delattre
80363edc22 Add Support for shader model in automation test framework exclusion list (2nd try)
#jira UE-185221
#preflight 64789f69f8715b9b1bfa6ab8
#preflight 6478c221947ff6973c225d8c
#rnx
#rb Chris.Constantinescu

[CL 25736798 by Jerome Delattre in ue5-main branch]
2023-06-01 15:31:00 -04:00
keaton stewart
8bc2626ba4 [Backout] - CL25713520
#fyi Jerome.Delattre
#jira FORT-617474
Original CL Desc
-----------------------------------------------------------------
Add Support for shader model in automation test framework exclusion list

#jira UE-185221
#preflight 646685c83660522200415d43
#rnx
#rb Chris.Constantinescu

[CL 25715585 by keaton stewart in ue5-main branch]
2023-05-31 17:39:06 -04:00
Jerome Delattre
82bc568a43 Add Support for shader model in automation test framework exclusion list
#jira UE-185221
#preflight 646685c83660522200415d43
#rnx
#rb Chris.Constantinescu

[CL 25713520 by Jerome Delattre in ue5-main branch]
2023-05-31 16:39:48 -04:00
bryan sefcik
da92084a12 Optimized out more private modules includes and dependencies.
#preflight 64627c382965f6ea8ea83bd6

[CL 25479683 by bryan sefcik in ue5-main branch]
2023-05-15 16:26:12 -04:00
henrik karlsson
4d744f010f Fixed non unity/pch compile errors reported by build farm
#preflight skipped
#rb none

[CL 24009693 by henrik karlsson in ue5-main branch]
2023-02-04 00:31:50 -05:00
Jerome Delattre
4baead9cf9 Fix NoPCH build break - AutomationState.h:25:9: error: incomplete type 'UEnum' named in nested name specifier
#preflight 63d7fd5331334253e5064e83
#jira none
#rb trivial

[CL 23916111 by Jerome Delattre in ue5-main branch]
2023-01-30 16:19:33 -05:00
marc audy
311f7464bf Updated ../Engine/Source/Runtime/... to inline gen.cpp files
Before:
3648 unity files
Total CPU Time: 47886.140625 s
Total time in Parallel executor: 498.81 seconds

After:
3548 unity files
Total CPU Time: 46643.828125 s
Total time in Parallel executor: 486.06 seconds

#jira
#preflight

[CL 22173263 by marc audy in ue5-main branch]
2022-09-24 13:57:58 -04:00
Jerome Delattre
01f4b6e7b4 Simplify RHI string when excluding tests by removing the shader model extension
- follow up to 21852012

#preflight 631b719aa60c539c98f0992d
#rnx
#jira none
#rb christopher.waters, Chris.Constantinescu

[CL 21927261 by Jerome Delattre in ue5-main branch]
2022-09-09 16:21:53 -04:00
Zak Middleton
84fb0737e0 #ue5 - Fix type conversion warnings in modules: AutomationController, AutomationTest, AVEncoder, AVIWriter.
#jira UE-160830
#rb Andrew.Davidson
#preflight 630d2147556fc14dce527da5

[CL 21690862 by Zak Middleton in ue5-main branch]
2022-08-29 18:32:03 -04:00
Jerome Delattre
c6c0e9a2a5 Support individual test exclusion for different RHI when parent suite does not exclude all RHI
+ enhanced management of RHI through the UI: If a RHI is specify, any child test can be excluded on an additional RHI by clicking on edit exclusion
+ disable exclusion editing on remote session

#jira UE-147020
#preflight 62ff9c99086f90bbc401a999
#rb Chris.Constantinescu

[CL 21462884 by Jerome Delattre in ue5-main branch]
2022-08-19 15:29:47 -04:00
Bryan sefcik
b4a6e947d8 Ran IWYU on Public headers under Engine/Source/Runtime/...
Headers are updated to contain any missing #includes needed to compile and #includes are sorted.  Nothing is removed.

#ushell-cherrypick of 21065896 by bryan.sefcik
#preflight 62d4b1a5a6141b6adfb0c892
#jira

#ROBOMERGE-OWNER: Bryan.sefcik
#ROBOMERGE-AUTHOR: bryan.sefcik
#ROBOMERGE-SOURCE: CL 21150156 via CL 21151754 via CL 21154719
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)
#ROBOMERGE-CONFLICT from-shelf

[CL 21181076 by Bryan sefcik in ue5-main branch]
2022-07-20 11:31:36 -04:00
Jerome Delattre
bf2021953a Use dot syntax to name blueprint functional tests instead of using the full package path (replacing / by .)
+ support backcomp from functional test exclude list
+ support exclude test fallback when RHI options are specified

#preflight 62d06020a6141b6adffe0656
#jira none
#rb Chris.Constantinescu

[CL 21110753 by Jerome Delattre in ue5-main branch]
2022-07-15 11:19:48 -04:00
Jerome Delattre
372a998177 Automation Test - Fix Previously Excluded Test not inheriting exclusion settings from the parent suite
#jira UE-143189
#preflight 62c48168892b4d4f30eb872a
#rb Chris.Constantinescu

[CL 20984440 by Jerome Delattre in ue5-main branch]
2022-07-07 11:28:18 -04:00
Jerome Delattre
2793e2fbee Add Metal in RHI options for Automation Test Exclude list
#jira none
#preflight 62c597352f2d046918f60e2a
#rb trivial
#fyi Colton.Daniels

[CL 20967961 by Jerome Delattre in ue5-main branch]
2022-07-06 11:40:54 -04:00
robert manuszewski
f8a812a32f Converting hardcoded short class/enum names to pathnames ahead of ANY_PACKAGE removal
#rb trivial
#jira UE-99463
#preflight 6288fd998828ea88c8aef3d0

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 20314896 via CL 20314897 via CL 20314903 via CL 20314904
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)

[CL 20315214 by robert manuszewski in ue5-main branch]
2022-05-22 10:30:02 -04:00
aurel cordonnier
34f55d3a4a Merge from Release-Engine-Test @ 17946149 to UE5/Main
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17949667 by aurel cordonnier in ue5-main branch]
2021-10-27 15:14:40 -04:00
Jerome Delattre
4625465c40 Fix exclusion list not working when test name is input in the code with extra spaces.
#rb trivial

#ROBOMERGE-OWNER: Jerome.Delattre
#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 17944768 via CL 17944954 via CL 17944979 via CL 17945043 via CL 17945064 via CL 17945181
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v885-17909292)
#ROBOMERGE-CONFLICT from-shelf

[CL 17945245 by Jerome Delattre in ue5-main branch]
2021-10-27 11:31:29 -04:00
Yoan StAmant
489db6b562 misc non-unity compilation fixes
#rb Jerome.Delattre, Rob.Krajcarski, Stu.McKenna

[CL 17708503 by Yoan StAmant in ue5-main branch]
2021-10-04 11:29:10 -04:00
Jerome Delattre
667dc535e7 Checkout config file before updating test exclude list.
#jira UE-127876
#rb Chris.Constantinescu, Eric Knapik
#rnx

[CL 17644979 by Jerome Delattre in ue5-main branch]
2021-09-28 09:16:59 -04:00
Jerome Delattre
df8b02bb26 Fix a crash when provided test exclusion Reason string is larger than 1024 characters.
#jira UE-127875
#rb trivial
#rnx

[CL 17629918 by Jerome Delattre in ue5-main branch]
2021-09-27 09:42:31 -04:00
Jerome Delattre
60839c1816 Improve test exclusion list mechanic
* Rename blacklist to excludelist (requested by high management)
* Support section exclusion rule to be able to exclude entire section of tests (ie PathTracing is only supported on Win64 for now)
* Mark excluded test as skipped in the report instead of entirely removed for test list. Check for exclusion just before running the test.
* Remove NotEnoughParticipant state in favor of Skipped (same conditions lead to Skipped state with appropriate messaging)
* Add support for exclusion management from the Test Automation window. (added a column at the end of each row)
* Expose device information to UE test report
* Add support for metadata in Gauntlet test report for Horde

Limitations:
* Management through the UI is limited to which test is available through in the active worker node. That's mean Runtime only tests are not listed from a worker that is Editor(the default) and platform specific are not clearly identified.
* For platforms, the mechanic to access their config and save it will remain to be done. In the meantime, it needs to be done manually through the target platform config file.

#jira UE-125960
#jira UE-125974
#rb Chris.Constantinescu, Eric.Knapik, Louise.Rasmussen

[CL 17607554 by Jerome Delattre in ue5-main branch]
2021-09-23 09:34:55 -04:00