37 Commits

Author SHA1 Message Date
sean sweeney
0687ba9940 bugfix for FunctionalTests failing to register
#jira UE-222852
[FYI] nicolas.bonnelly, colton.daniels

[CL 35882799 by sean sweeney in ue5-main branch]
2024-08-28 18:03:52 -04:00
sean sweeney
40656279aa FunctionalTest tagging and filtering
Exposes a "Test Tags" field to the Editor UI for Actor objects implementing FunctionalTest, such as BlueprintFunctionalTest and ScreenshotFunctionalTest. This persists user-defined tag data via the asset cache, and supports hot-editing.

#jira UE-213249
#rb jerome.delattre, rob.huyett, sebastian.lewicki

[CL 35829246 by sean sweeney in ue5-main branch]
2024-08-27 12:52:26 -04:00
sean sweeney
e995cbd272 [Backout] CL 35802356
Resolves breaking change on Mac which needs investigation

#jira UE-213249

[CL 35803184 by sean sweeney in ue5-main branch]
2024-08-26 13:18:36 -04:00
sean sweeney
4219762f70 FunctionalTest tagging and filtering
Exposes a "Test Tags" field to the Editor UI for Actor objects implementing FunctionalTest, such as BlueprintFunctionalTest and ScreenshotFunctionalTest. This persists user-defined tag data via the asset cache, and supports hot-editing.

#jira UE-213249
#rb jerome.delattre, rob.huyett, sebastian.lewicki

[CL 35802364 by sean sweeney in ue5-main branch]
2024-08-26 12:46:27 -04:00
robert millar
f6c47a85bd Skip actor iteration on world CDO.
[CL 33399512 by robert millar in ue5-main branch]
2024-05-02 12:22:23 -04:00
matt peters
64658cf6ae GetAssetRegistryTags deprecation: Make the old GetAssetRegistryTags and related functions deprecated.
Upgrade the overrides and callsites in all of Epic's code.
Every class that can be subclassed by licensees that has its override change needs to keep the old version of the function as deprecated. Otherwise subclasses that call Super::GetAssetRegistryTags will have a compile error instead of a deprecation warning.
Several classes had their own extension method for GetAssetRegistryTags being passed on to user data classes. Updated all of those to take FAssetRegistryTagsContext just like GetAssetRegistryTags does.
#rnx
#rb Francis.Hurteau

[CL 30224166 by matt peters in ue5-main branch]
2023-12-08 21:45:21 -05:00
Matt Peters
cf27fe051b FunctionalTestingModule: Cook determinism: Sort AssetRegistryTag value for TestNames.
#rb JeanFrancois.Dube
#rnx
#preflight 63da8635d21dbe1d2939af14

[CL 23948705 by Matt Peters in ue5-main branch]
2023-02-01 10:47:46 -05:00
jerome delattre
dc88499945 Check if FunctionalTest is in /Game/ before removing the string from the path
+ update test full names

#preflight 63729807953c19d4352f4d38
#rb Eric.Knapik
#rnx

[CL 23130111 by jerome delattre in ue5-main branch]
2022-11-14 19:07:47 -05:00
henrik karlsson
fa90b399a4 Added includes for future change. This changelist only contains added #include and a couple of empty placeholder files
Tested compiling fortnite, unrealeditor, lyra, qagame with non-unity/pch

#preflight 63635997876630122adeab9f
#rb none

[CL 22958990 by henrik karlsson in ue5-main branch]
2022-11-03 14:18:47 -04:00
robert millar
0491bcc13c FNames containing asset paths are deprecated. FSoftObjectPath or FTopLevelAssetPath should be used instead.
Fixups for misc developer dir files.

#jira UE-161932
#rb none
#preflight 631f8070fd6da68d68b56472

[CL 21976423 by robert millar in ue5-main branch]
2022-09-12 19:53:59 -04:00
Jerome Delattre
bf2021953a Use dot syntax to name blueprint functional tests instead of using the full package path (replacing / by .)
+ support backcomp from functional test exclude list
+ support exclude test fallback when RHI options are specified

#preflight 62d06020a6141b6adffe0656
#jira none
#rb Chris.Constantinescu

[CL 21110753 by Jerome Delattre in ue5-main branch]
2022-07-15 11:19:48 -04:00
robert manuszewski
d1443992e1 Deprecating ANY_PACKAGE.
This change consists of multiple changes:

Core:
- Deprecation of ANY_PACKAGE macro. Added ANY_PACKAGE_DEPRECATED macro which can still be used for backwards compatibility purposes (only used in CoreUObject)
- Deprecation of StaticFindObjectFast* functions that take bAnyPackage parameter
- Added UStruct::GetStructPathName function that returns FTopLevelAssetPath representing the path name (package + object FName, super quick compared to UObject::GetPathName) + wrapper UClass::GetClassPathName to make it look better when used with UClasses
- Added (Static)FindFirstObject* functions that find a first object given its Name (no Outer). These functions are used in places I consider valid to do global UObject (UClass) lookups like parsing command line parameters / checking for unique object names
- Added static UClass::TryFindType function which serves a similar purpose as FindFirstObject however it's going to throw a warning (with a callstack / maybe ensure in the future?) if short class name is provided. This function is used  in places that used to use short class names but now should have been converted to use path names to catch any potential regressions and or edge cases I missed.
- Added static UClass::TryConvertShortNameToPathName utility function
- Added static UClass::TryFixShortClassNameExportPath utility function
- Object text export paths will now also include class path (Texture2D'/Game/Textures/Grass.Grass' -> /Script/Engine.Texture2D'/Game/Textures/Grass.Grass')
- All places that manually generated object export paths for objects will now use FObjectPropertyBase::GetExportPath
- Added a new startup test that checks for short type names in UClass/FProperty MetaData values

AssetRegistry:
- Deprecated any member variables (FAssetData / FARFilter) or functions that use FNames to represent class names and replaced them with FTopLevelAssetPath
- Added new member variables and new function overloads that use FTopLevelAssetPath to represent class names
- This also applies to a few other modules' APIs to match AssetRegistry changes

Everything else:
- Updated code that used ANY_PACKAGE (depending on the use case) to use FindObject(nullptr, PathToObject), UClass::TryFindType (used when path name is expected, warns if it's a short name) or FindFirstObject (usually for finding types based on user input but there's been a few legitimate use cases not related to user input)
- Updated code that used AssetRegistry API to use FTopLevelAssetPaths and USomeClass::StaticClass()->GetClassPathName() instead of GetFName()
- Updated meta data and hardcoded FindObject(ANY_PACKAGE, "EEnumNameOrClassName") calls to use path names

#jira UE-99463
#rb many.people
[FYI] Marcus.Wassmer
#preflight 629248ec2256738f75de9b32

#codereviewnumbers 20320742, 20320791, 20320799, 20320756, 20320809, 20320830, 20320840, 20320846, 20320851, 20320863, 20320780, 20320765, 20320876, 20320786

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 20430220 via CL 20433854 via CL 20435474 via CL 20435484
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v949-20362246)

[CL 20448496 by robert manuszewski in ue5-main branch]
2022-06-01 03:46:59 -04:00
JeanFrancois Dube
51ad294492 OFPA support for functional tests.
Maps and functional test actors needs to be resaved.

#jira UE-151432, UE-145986
#rb richard.malo
#preflight 628f7234f622d972b5d7d752

[CL 20378197 by JeanFrancois Dube in ue5-main branch]
2022-05-26 08:42:23 -04:00
Matt Peters
7ad238a806 AssetRegistry includes (Engine/Source): change #include "AssetData.h" -> #include "AssetRegistry/AssetData.h", and similar for the other moved AssetRegistry headers.
#rb Zousar.Shaker
#rnx
#preflight 6270509a220f89f0ad573030

[CL 20016982 by Matt Peters in ue5-main branch]
2022-05-02 18:06:48 -04:00
aurel cordonnier
1ee4eed9aa Merge from Release-Engine-Test @ 17666640 to UE5/Main
This represents UE4/Main @17638339 and Dev-PerfTest @17636504

[CL 17668579 by aurel cordonnier in ue5-main branch]
2021-09-29 17:45:16 -04:00
ryan durand
471d972e62 Updating copyright for Engine Developer.
#rnx
#rb none


#ROBOMERGE-SOURCE: CL 10869240 via CL 10869516 via CL 10869902
#ROBOMERGE-BOT: (v613-10869866)

[CL 10870584 by ryan durand in Main branch]
2019-12-26 15:32:37 -05:00
Jerome Delattre
ab2cc4ec67 Copy from Dev-Enterprise - Add capacity to Black list any test
+ Add copy test names contextual menu

#jira UE-73374
#rb Andrew.Grant, Jeanluc.Corenthin

[CL 8385160 by Jerome Delattre in Main branch]
2019-08-30 13:26:31 -04:00
Ben Marsh
7598af0532 Update copyright notices to 2019.
#rb none
#lockdown Nick.Penwarden

[CL 4662404 by Ben Marsh in Main branch]
2018-12-14 13:41:00 -05:00
Ben Marsh
ea340d3fbf Copying //UE4/Fortnite-Staging to Dev-Main (//UE4/Dev-Main)
#rb none
#lockdown Nick.Penwarden

[CL 4567513 by Ben Marsh in Main branch]
2018-11-14 19:05:13 -05:00
Andrew Grant
24a57af222 Merging from //UE4/Release-4.20 - Added ability to suppress warning for blacklisted automation tests
#jira na
#rb na
#lockdown Nick.Penwarden

[CL 4147987 by Andrew Grant in Main branch]
2018-06-19 16:53:59 -04:00
Andrew Grant
7257446392 Merging change from //UE4/Release-Staging-4.20 - only display a warning for blacklisted tests if there is a reason specified
#lockdown Nick.Penwarden
#rb none

[CL 4133971 by Andrew Grant in Main branch]
2018-06-15 18:06:56 -04:00
Andrew Grant
bf668dff59 Merging fix for UE-6025, UE-60260, UE-60280 from //UE4/Release-Staging-4.20
Added GroundTruth for UE-60162

Merged Testblacklist work from Release-4.20

#lockdown Nick.Penwarden
#tests ran locally
#rb none

[CL 4133609 by Andrew Grant in Main branch]
2018-06-15 16:35:24 -04:00
Marc Audy
d90da4ab1a Merge to Dev-Main for 4.20 @ 4090813
#rb
#rnx
#lockdown Nick.Penwarden

[CL 4091081 by Marc Audy in Main branch]
2018-05-23 21:04:31 -04:00
Ben Marsh
13d012685f Merging copyright update from 4.19 branch.
#rb none
#rnx
#jira

[CL 3818977 by Ben Marsh in Staging-4.19 branch]
2018-01-02 15:30:26 -05:00
Chris Bunner
d6e57b4ca3 Copying //UE4/Dev-Automation to //UE4/Dev-Main (Source: //UE4/Dev-Automation @ 3792497)
#rb
#lockdown Nick.Penwarden

============================
  MAJOR FEATURES & CHANGES
============================

Change 3776794 by Chris.Bunner

	Fixed inverted check.

Change 3778396 by Chris.Bunner

	By default functional screenshot tests now enable camera cut and a fixed tonemap/exposure.
	Existing tests in PostProcessing have had the FixedTonemapping flag disabled.
	Updated all existing screenshots against the new fixed gamma ground truth.

Change 3778592 by Chris.Bunner

	Updating PostProcess screenshots that managed to collide mid P4 add.

Change 3778793 by Chris.Bunner

	Override the secondary screen percentage (used for high DPI) when taking screenshots. This is necessary for consistent results between machines.

Change 3781715 by Chris.Bunner

	Updating Windows screenshots.

Change 3781717 by Chris.Bunner

	Fixes for eye adaptation and tonemapping override consistency between test types and run modes.

Change 3783199 by Chris.Bunner

	Added separate add/replace screenshot buttons to know if we're working with a matching platform tier or a fallback.

Change 3783228 by Chris.Bunner

	When incoming screenshots are different sizes create a delta of the minimum shared dimensions but still force a failure. The UI is more consistent showing any delta, even if it's almost pure white.

Change 3783712 by Chris.Bunner

	Rebuilt translucency lighting test map and updated screenshot results.

Change 3784010 by Chris.Bunner

	Adding Mac-specific PostProcessing screenshots.

Change 3787456 by Chris.Bunner

	Improving name matching consistency of test blacklist entries.

Change 3787522 by Chris.Bunner

	Updating Mac-specific screenshots.

Change 3787583 by Chris.Bunner

	Updating Mac-Specific screenshots.

Change 3787832 by Chris.Bunner

	Fixing-up NaNs in two saved level's HLOD world settings.

Change 3789147 by Chris.Bunner

	Updating Sequencer sub-levels which still had NaNs in World Settings.

Change 3791454 by Chris.Bunner

	Deleted ancient screenshot re-introduced by Fortnite merge.

Change 3781713 by Chris.Bunner

	Updating platform unique screenshots - Tessellation, fixed vs variable screenshot size, Niagara simulation.

Change 3776756 by Chris.Bunner

	Initial pass at hierarchical screenshot testing.
	Deleted existing platforms automated test screenshots.

Change 3784051 by Chris.Bunner

	Updated CableActor screenshots for new capture defaults.

Change 3787092 by Chris.Bunner

	Added blacklist as "AutomationTestBlacklist" in Engine.ini.
	Formatting fix-up in existing automation test config.
	Removed workaround cvar for physicalized animation tests failing on platforms.

[CL 3792526 by Chris Bunner in Main branch]
2017-12-06 14:51:13 -05:00