142 Commits

Author SHA1 Message Date
sean sweeney
40656279aa FunctionalTest tagging and filtering
Exposes a "Test Tags" field to the Editor UI for Actor objects implementing FunctionalTest, such as BlueprintFunctionalTest and ScreenshotFunctionalTest. This persists user-defined tag data via the asset cache, and supports hot-editing.

#jira UE-213249
#rb jerome.delattre, rob.huyett, sebastian.lewicki

[CL 35829246 by sean sweeney in ue5-main branch]
2024-08-27 12:52:26 -04:00
sean sweeney
e995cbd272 [Backout] CL 35802356
Resolves breaking change on Mac which needs investigation

#jira UE-213249

[CL 35803184 by sean sweeney in ue5-main branch]
2024-08-26 13:18:36 -04:00
sean sweeney
4219762f70 FunctionalTest tagging and filtering
Exposes a "Test Tags" field to the Editor UI for Actor objects implementing FunctionalTest, such as BlueprintFunctionalTest and ScreenshotFunctionalTest. This persists user-defined tag data via the asset cache, and supports hot-editing.

#jira UE-213249
#rb jerome.delattre, rob.huyett, sebastian.lewicki

[CL 35802364 by sean sweeney in ue5-main branch]
2024-08-26 12:46:27 -04:00
jerome delattre
552cba4c8b Capture LogRHI errors and warnings when RHIValidation is enabled even when BP functionalt test is not actively running (second try)
#rnx

[CL 34661104 by jerome delattre in ue5-main branch]
2024-06-25 18:34:35 -04:00
jerome delattre
d2e3696ee4 Reverting changelist 34647546 (linker issue)
#rnx

[CL 34649108 by jerome delattre in ue5-main branch]
2024-06-25 14:13:09 -04:00
jerome delattre
7fb2b66200 Capture LogRHI errors and warnings when RHIValidation is enabled even when BP functionalt test is not actively running
#rnx
#rb Colton.Daniels, sebastian.lewicki, zach.bethel

[CL 34647561 by jerome delattre in ue5-main branch]
2024-06-25 13:48:11 -04:00
sebastian lewicki
e76b014cc7 Promoting functionality to be able to set and reset console variables across various automation tests as to not be limited for Functional Blueprint tests.
#jira UE-210704
#rnx
#rb chris.constantinescu, Jerome.Delattre, rob.huyett, sean.sweeney

[CL 32733842 by sebastian lewicki in ue5-main branch]
2024-04-04 13:10:10 -04:00
zack neyland
355af361ca FuncTest: Fix up visilbity issue.
[CL 32189806 by zack neyland in ue5-main branch]
2024-03-12 16:04:01 -04:00
richard malo
14620f45a3 External Data Layer V1
- Allows for plugins to inject/remove content (actors) in a partitioned world
- Serves as a replacement for the experimental 'Content Bundle' feature
- Added new External Data Layer (EDL) Asset
- Added new Game Feature Action 'AddWorldPartitionContent' to control activation of an EDL asset
- Supports Data Layers inside a plugin (child of an EDL)
- Added builder to convert content bundles to EDL (UGameFeatureActionConvertContentBundleWorldPartitionBuilder)
- Feature is temporarily disabled by default and can be turned on using Editor Experimental Settings 'Enable World Partition External Data Layers' flag
#jira UE-204248
#rb JeanFrancois.Dube, Patrick.Enfedaque, Sebastien.Lussier
#tests QAGame PIE/-game/cooked, Regression test PIE/cook of latest game map, Tested PIE/cook of latest game map converted to EDL

[CL 31015614 by richard malo in ue5-main branch]
2024-01-30 14:18:27 -05:00
jerome delattre
0f4365c1d7 Fix screenshot comparison slipping to the next test
Add a condition to FinishTest to make sure it gets trigger only if the screenshot was taken and compared.
+ move functional test metadata log to when the test is about to run

#jira UE-204671
#rnx
#rb christopher.fiala, rob.huyett, sebastian.lewicki

[CL 30856076 by jerome delattre in ue5-main branch]
2024-01-24 14:18:50 -05:00
christopher fiala
d1fd4e1e08 [Reintegration] - CL30342517
[FYI] christopher.fiala
Original CL Desc
-----------------------------------------------------------------
[Backout] - CL30314361
[FYI] christopher.fiala
Original CL Desc
-----------------------------------------------------------------
Overhaul stereo variants to support an arbitrary number of variants and correctly implement per-variant frame delays and test preparation, significantly reducing false failures.
Fixes compatibility with TSR sequence screenshot functional test blueprints.

#jira UE-194361
#rb sean.sweeney

[CL 30352401 by christopher fiala in ue5-main branch]
2023-12-15 12:41:53 -05:00
christopher fiala
9c052993ed [Backout] - CL30314361
[FYI] christopher.fiala
Original CL Desc
-----------------------------------------------------------------
Overhaul stereo variants to support an arbitrary number of variants and correctly implement per-variant frame delays and test preparation, significantly reducing false failures.
Fixes compatibility with TSR sequence screenshot functional test blueprints.

#jira UE-194361
#rb sean.sweeney

[CL 30342529 by christopher fiala in ue5-main branch]
2023-12-14 22:03:05 -05:00
christopher fiala
7196554c9e Overhaul stereo variants to support an arbitrary number of variants and correctly implement per-variant frame delays and test preparation, significantly reducing false failures.
Fixes compatibility with TSR sequence screenshot functional test blueprints.

#jira UE-194361
#rb sean.sweeney

[CL 30314369 by christopher fiala in ue5-main branch]
2023-12-14 00:32:29 -05:00
matt peters
64658cf6ae GetAssetRegistryTags deprecation: Make the old GetAssetRegistryTags and related functions deprecated.
Upgrade the overrides and callsites in all of Epic's code.
Every class that can be subclassed by licensees that has its override change needs to keep the old version of the function as deprecated. Otherwise subclasses that call Super::GetAssetRegistryTags will have a compile error instead of a deprecation warning.
Several classes had their own extension method for GetAssetRegistryTags being passed on to user data classes. Updated all of those to take FAssetRegistryTagsContext just like GetAssetRegistryTags does.
#rnx
#rb Francis.Hurteau

[CL 30224166 by matt peters in ue5-main branch]
2023-12-08 21:45:21 -05:00
christopher fiala
6291d6738b Update LightweightStereoTestVariants mode to run ONLY stereo test variants, no baseline, since they've been moved into their own category. Remove support for specifically exempting tests from running stereo variants. Save screenshots even for passed variants for the time being, since it's now possible to have a variant be the only test running.
Now `Automation.EnableStereoTestVariants=1` (off by default) enables ViewRectOffset, and adding `Automation.LightweightStereoTestVariants=1` causes us to ONLY run ViewRectOffset (on by default).

#jira UE-194361
#rb Jerome.Delattre

[CL 30174576 by christopher fiala in ue5-main branch]
2023-12-06 23:16:08 -05:00
urias rooney
f62f510394 Fix linker issues when declaring types outside of "FunctionalTesting" that inherit from "FFunctionalTestBase"
#rb dylan.fansler, Eric.Knapik, garrett.conti

[CL 30098023 by urias rooney in ue5-main branch]
2023-12-04 17:33:28 -05:00
kiaran ritchie
4e92dad5ee Fixes IK Rig rotation engine test. Issues caused by floating point discrepency in Rotator/Quat conversion between Linux/Windows platforms.
#JIRA UE-198900
#rb halfdan.ingvarsson



#virtualized

[CL 29989343 by kiaran ritchie in ue5-main branch]
2023-11-29 11:07:09 -05:00
christopher fiala
d5ec52b3cc Add a new CVar, Automation.LightweightStereoTestVariants, which stops variants from running if we've already encounted an error, and skips saving/attaching screenshots for successful variants to save space. Enabled by default. Also moves the "Supports Stereo Test Variants" checkbox to the "Screenshot" section.
#jira UE-194361
#rb jerome.delattre, chris.constantinescu

[CL 29718813 by christopher fiala in ue5-main branch]
2023-11-14 13:31:30 -05:00
christopher fiala
9942c169c2 Add the ViewRectOffset "test variant" to all screenshot functional tests. When a test variant is enabled, the test will take two screenshots, one in the base configuration, and one in the variant configuration, and fail if both are not similar to the ground truth. The ViewRectOffset variant will be enabled if "Support Stereo Test Variants" is checked on the functional test actor (TRUE by default) and the CVar r.EnableStereoScreenshotTestVariants is set to 1. The CVar is 0 by default for the time being, so there should be no changes to ET unless it is manually set to true.
#jira UE-194361
#rb david.harvey

[CL 29341539 by christopher fiala in ue5-main branch]
2023-11-01 20:00:13 -04:00
BenVlodgi
528da2d693 PR #10982: Disable and hide HLOD category for Functional Test Actor
Reduce options bloat from new feature(HLOD).

#rb sebastian.lewicki

[CL 28884914 by BenVlodgi in ue5-main branch]
2023-10-18 14:33:56 -04:00
DuncanRare
0b2cf01d8a Adding flag to toggle whether or not garbage collection should be delayed, by default they are. Added property to show in the Editor Details panel for the Functional Test in the Advanced section.
PR # 10898
#commit 10898
#jira UE-195842

[CL 28294665 by DuncanRare in ue5-main branch]
2023-09-27 17:26:59 -04:00
henrik karlsson
7945247356 Header unit fixes (and disabling a few warnings)
[CL 28173546 by henrik karlsson in ue5-main branch]
2023-09-23 14:10:24 -04:00
christopher waters
4e96f4193d Removing UE_ENABLE_INCLUDE_ORDER_DEPRECATED_IN_5_0 and UE_ENABLE_INCLUDE_ORDER_DEPRECATED_IN_5_1 including all uses in the engine.
[CL 26259545 by christopher waters in ue5-main branch]
2023-06-27 11:54:23 -04:00
philippe deseve
5025986046 AActor types can now supports differents UDataLayerInstance types via IsDataLayerTypeSupported
Deprecate ActorTypeSupportsDataLayer

#rb richard.malo

[CL 25880291 by philippe deseve in ue5-main branch]
2023-06-08 15:54:51 -04:00
mikalai sukhikh
f6ea3b88d9 Add CVar setting node in AFunctionalTest class
#jira UE-171493
#rb adam.miezianko, chris.constantinescu, jerome.delattre
#preflight 64524cb90722d4f6a2dd4351
#preflight 64524cf20722d4f6a2dd4728

[CL 25370907 by mikalai sukhikh in ue5-main branch]
2023-05-08 10:57:51 -04:00