izzy/UnrealEngineUWP
0
0
Fork 0
mirror of https://github.com/izzy2lost/UnrealEngineUWP.git synced 2026-03-26 18:15:20 -07:00
Code Issues Packages Projects Releases Wiki Activity
Files
daacee5732ea20871e243ccd11746bd97a142e4e
UnrealEngineUWP/Engine/Build/EditorPerf.xml

480 lines
33 KiB
XML
Raw Normal View History

Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<?xml version='1.0' ?>
<BuildGraph xmlns="http://www.epicgames.com/BuildGraph" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.epicgames.com/BuildGraph ../../../Build/Graph/Schema.xsd" >
<!-- Horde Options -->
<EnvVar Name="UE_HORDE_JOBID"/>
Remove References to internal Horde server deployment and network path #jira UE-201978 #rnx #rb sean.sweeney, sebastian.lewicki [CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
<EnvVar Name="UE_HORDE_STEPID"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Option Name="Horde" Restrict="true|false" DefaultValue="false" Description="Whether the build is running under Horde"/>
<Option Name="PreflightChange" DefaultValue="" Description="Preflight CL number if preflight, empty otherwise"/>
<Option Name="SetPreflightFlag" DefaultValue="true" Description="Whether to set the IsPreflight flag to true for preflights. Use with caution: this will cause things like build versions to be set to their non-preflight form."/>
<Property Name="IsPreflight" Value="false"/>
<Property Name="IsPreflight" Value="true" If="'$(PreflightChange)' != '' And $(SetPreflightFlag)"/>
<Property Name="PreflightSuffix" Value=""/>
<Property Name="PreflightSuffix" Value="-PF-$(PreflightChange)-$(UE_HORDE_JOBID)" If="$(IsPreflight)"/>
<Property Name="BuildName" Value="$(EscapedBranch)-CL-$(Change)$(PreflightSuffix)"/>
Add options for label categories, which can vary on different Horde servers Move properties out of agent blocks (they only are necessary for Node) #rnd #rb trivial #presubmit 615b51abe3b24d00016b6954 #ROBOMERGE-OWNER: geoff.evans #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17713559 via CL 17713577 via CL 17713591 via CL 17713594 via CL 17713619 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v879-17706426) #ROBOMERGE-CONFLICT from-shelf #ROBOMERGE[STARSHIP]: UE5-Main [CL 17714342 by geoff evans in ue5-release-engine-test branch]
2021-10-04 17:28:23 -04:00
<Option Name="CompileCategory" DefaultValue="Editors" Description="Category string for Compile Label"/>
<Option Name="RunCategory" DefaultValue="Test" Description="Category string for Run Label"/>
<Option Name="BaselineCategory" DefaultValue="Test" Description="Category string for Baseline Label"/>
Add option to run all compiles on a single machine Add option to run compiles with nodebuginfo Remove UHT #jira none #rnx #rb Ryan.Hummer, Francis.Hurteau [CL 23393325 by Bryan Johnson in ue5-main branch]
2022-12-05 12:34:24 -05:00
<Option Name="SingleAgentCompile" Restrict="true|false" DefaultValue="false" Description="Run all compile steps on same agent"/>
Add ability to have AdditionalEditorCompileArgs #rnx #rb none [CL 27839423 by bryan johnson in ue5-main branch]
2023-09-13 13:44:07 -04:00
<Option Name="AdditionalEditorCompileArgs" DefaultValue="" Description="Additional Compile Arguments for the Editor"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Projects setup-->
<Option Name="Projects" DefaultValue="false" Restrict=".+" Description="The projects to test"/>
<Error Message="No project names specified" If="'$(Projects)' == 'false'"/>
<!-- Platform Options -->
<Option Name="Platforms" DefaultValue="Win64" Description="The list of platforms to profile"/>
Add using Win64Compile Agent for Compile instead of just Win64 #rnx #rb none [CL 25712695 by bryan johnson in ue5-main branch]
2023-05-31 16:20:30 -04:00
<Property Name="Win64CompileAgentType" Value="Win64Compile;Win64"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="MacCompileAgentType" Value="TestMac"/>
Add support for Linux Add support to pass arguments to editor process with an option Add support for compiling with TSAN #jira none #rnx #rb none [CL 24860087 by Bryan Johnson in ue5-main branch]
2023-03-30 16:44:58 -04:00
<Property Name="LinuxCompileAgentType" Value="Linux"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Error Message="No platforms specified" If="'$(Platforms)' == ''"/>
<!-- Build Options -->
Add option to run all compiles on a single machine Add option to run compiles with nodebuginfo Remove UHT #jira none #rnx #rb Ryan.Hummer, Francis.Hurteau [CL 23393325 by Bryan Johnson in ue5-main branch]
2022-12-05 12:34:24 -05:00
<Option Name="NoDebugInfo" Restrict="true|false" DefaultValue="false" Description="Compile without including debug info"/>
Add support for Linux Add support to pass arguments to editor process with an option Add support for compiling with TSAN #jira none #rnx #rb none [CL 24860087 by Bryan Johnson in ue5-main branch]
2023-03-30 16:44:58 -04:00
<Option Name="WithTSAN" Restrict="true|false" DefaultValue="false" Description="Compile using TSAN"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="ExtraPluginsCommaDelims" Value="EditorTests"/>
<Property Name="ExtraPluginsPlusDelims" Value=""/> <!-- populated programmatically -->
<ForEach Name="Plugin" Values="$(ExtraPluginsCommaDelims)">
<Property Name="ExtraPluginString" Value="$(Plugin)" If="'$(ExtraPluginsPlusDelims)' == ''"/>
<Property Name="ExtraPluginString" Value="$(ExtraPluginsPlusDelims)+$(Plugin)" If="'$(ExtraPluginsPlusDelims)' != ''"/>
<Property Name="ExtraPluginsPlusDelims" Value="$(ExtraPluginString)"/>
</ForEach>
EditorPerf Update project configurations, projects configured in horde Use to MapsToPIETest instead of AssetsToOpen... because we PIE test them :) #rnx #jira none #rb trivial #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17546319 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530) [CL 17546323 by geoff evans in ue5-release-engine-test branch]
2021-09-16 20:02:03 -04:00
<Property Name="EditorCompileArgs" Value=""/>
<Property Name="EditorCompileArgs" Value="-BuildPlugin=$(ExtraPluginsPlusDelims)" If="'$(ExtraPluginsPlusDelims)' != ''"/>
Add option to run all compiles on a single machine Add option to run compiles with nodebuginfo Remove UHT #jira none #rnx #rb Ryan.Hummer, Francis.Hurteau [CL 23393325 by Bryan Johnson in ue5-main branch]
2022-12-05 12:34:24 -05:00
<Property Name="EditorCompileArgs" Value="$(EditorCompileArgs) -nodebuginfo" If="$(NoDebugInfo)"/>
Add support for Linux Add support to pass arguments to editor process with an option Add support for compiling with TSAN #jira none #rnx #rb none [CL 24860087 by Bryan Johnson in ue5-main branch]
2023-03-30 16:44:58 -04:00
<Property Name="EditorCompileArgs" Value="$(EditorCompileArgs) -EnableTSAN -Monolithic" If="$(WithTSAN)"/>
Add ability to have AdditionalEditorCompileArgs #rnx #rb none [CL 27839423 by bryan johnson in ue5-main branch]
2023-09-13 13:44:07 -04:00
<Property Name="EditorCompileArgs" Value="$(EditorCompileArgs) $(AdditionalEditorCompileArgs)" If="'$(AdditionalEditorCompileArgs)' != ''"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
Remove References to internal Horde server deployment and network path #jira UE-201978 #rnx #rb sean.sweeney, sebastian.lewicki [CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
<!-- Get shared properties -->
<Include Script="Graph/Tasks/Inc/SharedProperties.xml" />
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Automation uses its own network output directory -->
Remove References to internal Horde server deployment and network path #jira UE-201978 #rnx #rb sean.sweeney, sebastian.lewicki [CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
<Property Name="AutomationNetworkRootDir" Value="$(NetworkReportRoot)\EditorPerf"/>
<Property Name="AutomationNetworkRootDir" Value="$(NetworkReportRoot)/EditorPerf" If="'$(HostPlatform)' != 'Win64'"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="AutomationLocalOutputDir" Value="$(RootDir)/LocalBuilds/Reports"/>
<!-- Outputs for this run keeping slashes flipped the right way because it shows up on the webapp this way -->
<Property Name="AutomationNetworkOutputDir" Value="$(AutomationNetworkRootDir)\$(BuildName)"/>
<Property Name="AutomationNetworkOutputDir" Value="$(AutomationNetworkRootDir)/$(BuildName)" If="'$(HostPlatform)' != 'Win64'"/>
<Property Name="AutomationOutputDir" Value="$(AutomationLocalOutputDir)"/>
<Property Name="AutomationOutputDir" Value="$(AutomationNetworkOutputDir)" If="$(IsBuildMachine)"/>
<!-- Options for baselining -->
<Option Name="RunAndBaseline" DefaultValue="false" Description="Enable graph dependencies for running and setting the baseline in a single build."/>
<Option Name="BaselineDir" DefaultValue="$(RootDir)/Engine/Build/Baseline" Description="The revision controlled location of the baseline telemetry files."/>
<Option Name="BaselineBuildName" DefaultValue="$(BuildName)" Description="The BuildName of the build to set as the new baseline to compare against."/>
<Property Name="BaselineAutomationNetworkOutputDir" Value="$(AutomationNetworkRootDir)/$(BaselineBuildName)"/>
<Property Name="BaselineAutomationNetworkOutputDir" Value="$(AutomationOutputDir)" If="$(RunAndBaseline)"/>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<!-- Options for warm+cold vs cold cache only -->
<Option Name="IncludeWarmPhase" DefaultValue="true" Description="Whether to include a warm cache phase. Default is true and will run cold and warm tests. If false, only a cold test will run."/>
<Property Name="Phases" Value="Cold;Warm"/>
<Property Name="Phases" Value="Cold" If="'$(IncludeWarmPhase)'=='false'"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Arguments for tracing -->
<Property Name="TraceDir" Value="$(RootDir)/Engine/Programs/UnrealInsights/Saved/TraceSessions"/>
<!-- Arguments for phases, keep in mind that these are passed to both the DDCCleanupCommandlet and RunUnreal -->
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
<Option Name="EnableBasePhaseTests" DefaultValue="true" Description="Enable the base phase perf tests."/>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Option Name="ColdArgs" DefaultValue="-ddc=Cold -NoAssetRegistryCacheRead" Description="Arguments to unreal for the cold phase"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Option Name="WarmArgs" DefaultValue="-ddc=Warm" Description="Arguments to unreal for the warm phase"/>
<!-- Iterations to run and average together -->
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<Option Name="Iterations" DefaultValue="1" Description="The list of iteration numbers to run. For example '1;2;3' for three iterations"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
<!-- Used to determine if we will include internal projects -->
<Option Name="IsLicensee" Restrict="true|false" DefaultValue="false" Description="Define to true if this script is used externally."/>
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- Internal property to track all projects that have been declared -->
<Property Name="AllProjects" Value=""/>
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
<!-- A macro that can be used to easily set up a new test project. -->
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Macro Name="SetupPerfProject" Arguments="ProjectName" OptionalArguments="CopyDefaultsFrom;ProjectTarget;EditorTarget;MapPath;GameSpecificArgs;UseBinariesFrom;ExtraNonCopyableArgs">
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
<Property Name="$(ProjectName)__ProjectTarget" Value="$(ProjectName)" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__ProjectTarget" Value="$($(CopyDefaultsFrom)__ProjectTarget)" If="'$(CopyDefaultsFrom)' != ''"/>
<Property Name="$(ProjectName)__ProjectTarget" Value="$(ProjectTarget)" If="'$(ProjectTarget)' != ''"/>
<Property Name="$(ProjectName)__EditorTarget" Value="$(ProjectName)Editor" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__EditorTarget" Value="$($(CopyDefaultsFrom)__EditorTarget)" If="'$(CopyDefaultsFrom)' != ''"/>
<Property Name="$(ProjectName)__EditorTarget" Value="$(EditorTarget)" If="'$(EditorTarget)' != ''"/>
<Property Name="$(ProjectName)__MapArgs" Value="" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__MapArgs" Value="$($(CopyDefaultsFrom)__MapArgs)" If="'$(CopyDefaultsFrom)' != ''"/>
<Property Name="$(ProjectName)__MapArgs" Value="-ini:Engine:[/Script/Engine.AutomationTestSettings]:MapsToPIETest=\&quot;$(MapPath)\&quot;" If="'$(MapPath)' != ''"/>
<Property Name="$(ProjectName)__SpecificArgs" Value="" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__SpecificArgs" Value="$($(CopyDefaultsFrom)__SpecificArgs)" If="'$(CopyDefaultsFrom)' != ''"/>
<Property Name="$(ProjectName)__SpecificArgs" Value="$(GameSpecificArgs)" If="'$(GameSpecificArgs)' != ''"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Property Name="$(ProjectName)__UseBinariesFrom" Value="" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__UseBinariesFrom" Value="$(CopyDefaultsFrom)" If="'$(CopyDefaultsFrom)' != ''"/>
<Property Name="$(ProjectName)__UseBinariesFrom" Value="$(UseBinariesFrom)" If="'$(UseBinariesFrom)' != ''"/>
<!-- Immediately resolve any indirections on UseBinariesFrom. We cannot support them later when we set up the actual nodes. -->
<Do If="'$($(ProjectName)__UseBinariesFrom)' != ''">
<Property Name="$(ProjectName)__UseBinariesFrom" Value="$($($(ProjectName)__UseBinariesFrom)__UseBinariesFrom)" If="'$($($(ProjectName)__UseBinariesFrom)__UseBinariesFrom)' != ''"/>
</Do>
<Property Name="$(ProjectName)__ExtraNonCopyableArgs" Value="" CreateInParentScope="true"/>
<Property Name="$(ProjectName)__ExtraNonCopyableArgs" Value="$(ExtraNonCopyableArgs)" If="'$(ExtraNonCopyableArgs)' != ''"/>
<Property Name="AllProjects" Value="$(AllProjects);$(ProjectName)" />
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
</Macro>
Expose a param on editor perf test to specify a map to load for the test using the full asset path #rb Jerome.Delattre #jira UE-170933 #preflight 6390fa27bb6fefa47239405e [CL 23436748 by francis hurteau in ue5-main branch]
2022-12-07 18:21:54 -05:00
Move internal project specific args to restricted file for Editor Perf #jira UE-187725 #rb Bryan.Johnson [CL 25963059 by francis hurteau in ue5-main branch]
2023-06-13 16:46:06 -04:00
<!-- Inject internal projects default argument at the global scope -->
<Include Script="../Restricted/NotForLicensees/Build/EditorPerfInternalArgs.xml" If="!$(IsLicensee)" />
[EditorPerf] Reuse per branch asset registry to make incremental runs representative of user experience #rnx #jira UE-191845 #rb Francis.Hurteau [CL 28788039 by danny couture in ue5-main branch]
2023-10-14 12:40:57 -04:00
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<!-- Option to retain per-branch asset registry between runs so that warm is representative of user experience -->
[EditorPerf] Reuse per branch asset registry to make incremental runs representative of user experience #rnx #jira UE-191845 #rb Francis.Hurteau [CL 28788039 by danny couture in ue5-main branch]
2023-10-14 12:40:57 -04:00
<Property Name="AssetRegistryCache_Folder" Value="$(RootDir)/../../../EditorPerfAssetRegistryCache/$(EscapedBranch)/"/>
Add support for Linux Add support to pass arguments to editor process with an option Add support for compiling with TSAN #jira none #rnx #rb none [CL 24860087 by Bryan Johnson in ue5-main branch]
2023-03-30 16:44:58 -04:00
<!-- Options for extra runtime args -->
<Option Name="AdditionalRuntimeArgs" DefaultValue="" Description="Additional Arguments to pass to RunTest"/>
Expose a param on editor perf test to specify a map to load for the test using the full asset path #rb Jerome.Delattre #jira UE-170933 #preflight 6390fa27bb6fefa47239405e [CL 23436748 by francis hurteau in ue5-main branch]
2022-12-07 18:21:54 -05:00
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
<!-- Options for extra Zen Loader tests -->
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Option Name="EnableZenLoaderTest" DefaultValue="true" Description="Enable additional test per phase that uses the Zen Loader."/>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Option Name="EnableZenLoaderAsyncThreadTest" DefaultValue="false" Description="Enable additional test per phase that uses the Zen Loader with an async loading thread."/>
<Option Name="DisableEditorDomainForZenLoaderTests" DefaultValue="true" Description="Explicitly disables editordomain (-noeditordomain) for zen loader tests"/>
Add Options to run additional editor tests with Zen Loader and async thread enabled as part of the editor perf tests #rb Jerome.Delattre #jira UE-162833 #preflight 63473c27f93be0f6348a12f6 [CL 22504774 by Francis Hurteau in ue5-main branch]
2022-10-13 10:52:46 -04:00
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- Option for number of PIE iterations to run (per editor launch) -->
<Property Name="DefaultNumIterationsPie" Value="2" />
<Option Name="NumIterationsPIE" DefaultValue="$(DefaultNumIterationsPIE)" Description="Specify the number of times to start/stop PIE sessions in a single editor run."/>
<Do If="'$(NumIterationsPIE)' &lt;= '0'">
<Warning Message="NumIterationPIE must be greater than 0. Setting to default of $(DefaultNumIterationsPIE)."/>
<Property Name="NumIterationsPIE" Value="$(DefaultNumIterationsPIE)" />
</Do>
<Property Name="ArgIterationsPIE" Value="-ini:Engine:[ConsoleVariables]:project.iteration.pie.testiterations=$(NumIterationsPIE)" />
Add Options to run additional editor tests with Zen Loader and async thread enabled as part of the editor perf tests #rb Jerome.Delattre #jira UE-162833 #preflight 63473c27f93be0f6348a12f6 [CL 22504774 by Francis Hurteau in ue5-main branch]
2022-10-13 10:52:46 -04:00
<!-- Zen Loader tests specifc arguments -->
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Property Name="ZenLoaderTestArgs" Value="-zenloader"/>
Added a -nozenloader parameter to EditorPerf due to ZenLoader being on by default. #rb matt.breindel, thierry.begin [CL 31352202 by jan yu in ue5-main branch]
2024-02-09 15:17:04 -05:00
<Property Name="NoZenLoaderTestArgs" Value="-nozenloader"/>
Gauntlet - Use space instead of coma when parsing extra engine arguments Follow up to 24507995 #preflight 6407638d5515f4f57b431116 #rb Ben.Salem [CL 24546974 by jerome delattre in ue5-main branch]
2023-03-07 15:37:47 -05:00
<Property Name="ZenLoaderAsyncTestArgs" Value="$(ZenLoaderTestArgs) -asyncloadingthread" />
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="ZenLoaderTestArgs" Value="$(ZenLoaderTestArgs) -noeditordomain" If="$(DisableEditorDomainForZenLoaderTests)" />
<Property Name="ZenLoaderAsyncTestArgs" Value="$(ZenLoaderAsyncTestArgs) -noeditordomain" If="$(DisableEditorDomainForZenLoaderTests)" />
Add Options to run additional editor tests with Zen Loader and async thread enabled as part of the editor perf tests #rb Jerome.Delattre #jira UE-162833 #preflight 63473c27f93be0f6348a12f6 [CL 22504774 by Francis Hurteau in ue5-main branch]
2022-10-13 10:52:46 -04:00
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
<!-- Options for extra Zen Store tests -->
<Option Name="EnableZenStoreDDCTest" DefaultValue="false" Description="Enable additional test on warm phase that uses the Zen Store DDC."/>
<!-- Zen Store tests specific arguments -->
<Property Name="ZenServerCache" Value="$(RootDir)\ZenCache" />
Gauntlet - Use space instead of coma when parsing extra engine arguments Follow up to 24507995 #preflight 6407638d5515f4f57b431116 #rb Ben.Salem [CL 24546974 by jerome delattre in ue5-main branch]
2023-03-07 15:37:47 -05:00
<Property Name="ZenStoreCommonArgs" Value="-ini:Engine:[Zen.AutoLaunch]:LimitProcessLifetime=true -ZenDataPath=$(ZenServerCache) "/>
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
<Property Name="ZenStoreDDCPhaseArgs" Value="-ddc=ZenDDC"/>
<Property Name="ZenStoreDDCTestArgs" Value="$(ZenStoreCommonArgs)"/>
<!-- Options for extra LazyLoad tests -->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Option Name="EnableLazyLoadNoZenLoaderTest" DefaultValue="false" Description="Enable additional test on warm phase that uses LazyLoad with Zen Loader disabled."/>
<Option Name="EnableLazyLoadZenLoaderTest" DefaultValue="false" Description="Enable additional test on warm phase that uses LazyLoad with Zen Loader enabled."/>
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
<!-- LazyLoad tests specific arguments -->
<Property Name="LazyLoadTestArgs" Value="-LazyLoadImports"/>
Gauntlet - Use space instead of coma when parsing extra engine arguments Follow up to 24507995 #preflight 6407638d5515f4f57b431116 #rb Ben.Salem [CL 24546974 by jerome delattre in ue5-main branch]
2023-03-07 15:37:47 -05:00
<Property Name="LazyLoadZenTestArgs" Value="$(LazyLoadTestArgs) -zenloader" />
Add Zen Store DDC and Lazy Load Editor Perf Tests #rb Jerome.Delattre #jira UE-170931,UE-170932 #preflight 638103cc170bc34a93bd62a8 [CL 23300302 by francis hurteau in ue5-main branch]
2022-11-28 19:16:48 -05:00
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Gauntlet arguments for all runs -->
Rebase Gauntlet EditorTests to UE.AutomationTestNode #jira none #rb logan.buchy, han.chu #rnx [CL 26704404 by Jerome Delattre in ue5-main branch]
2023-07-31 09:29:53 -04:00
<Property Name="GauntletArgs" Value="-build=editor -verbose -tempdir=&quot;$(RootDir)/Tests&quot;"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="GauntletArgs" Value="$(GauntletArgs) -branch=$(Branch) -ECBranch=&quot;$(Branch)&quot; -ECChangelist=&quot;$(Change)&quot;"/>
<Property Name="GauntletArgs" Value="$(GauntletArgs) -maxduration=28800"/>
<!-- Gauntlet arguments for profile runs -->
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="ProfileArgs" Value="-test=EditorTests -tracefiletrunc"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="ProfileArgs" Value="$(ProfileArgs) -EnablePlugins=$(ExtraPluginsCommaDelims)" If="'$(ExtraPluginsCommaDelims)' != ''"/>
Update AutomationController Log settings Introduce bElevateLogWarningsToErrors as a good name for existing functionality. Note it's assuming the name as it's known by its customer code. This change lines up the settings variable to its colloquial name around the codebase. Deprecate bTreatLogWarningsAsTestErrors as it was misleading because it doesn't really shuffle log warnings into the test errors bucket as much as it just reclassifies the log verbosity from log warning to log error. Remove bTreatLogErrorsAsTestErrors as it wasn't functional outside of EditorIterationTest's custom base class, and it's tempting to use incorrectly in place of bSuppressLogErrors #rnx #jira none #rb andrew.grant #preflight 6142442c4778fa000135b987 #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17526549 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530) [CL 17526590 by geoff evans in ue5-release-engine-test branch]
2021-09-15 16:52:23 -04:00
<Property Name="ProfileArgs" Value="$(ProfileArgs) -SuppressLogWarnings -SuppressLogErrors"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="ProfileArgs" Value="$(ProfileArgs) -GameInstanceLostTimerSeconds=3600"/>
<Property Name="ProfileArgs" Value="$(ProfileArgs) -NoLoadLevelAtStartup -Benchmarking -NODDCCLEANUP"/>
<Property Name="ProfileArgs" Value="$(ProfileArgs) -NoShaderDistrib -VerboseShaderLogging"/>
Rebase Gauntlet EditorTests to UE.AutomationTestNode #jira none #rb logan.buchy, han.chu #rnx [CL 26704404 by Jerome Delattre in ue5-main branch]
2023-07-31 09:29:53 -04:00
<Property Name="ProfileArgs" Value="$(ProfileArgs) -ResumeOnCriticalFailure"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
Add an option to disable the summarize trace step #rb Jerome.Delattre #jira UE-185261 #preflight skip [CL 25395018 by francis hurteau in ue5-main branch]
2023-05-09 16:27:59 -04:00
<!-- options for summarize runs -->
Disable the summarize trace by default #rb trivial #jira UE-185261 #preflight skip [CL 25395027 by francis hurteau in ue5-main branch]
2023-05-09 16:28:22 -04:00
<Option Name="RunTraceSummary" DefaultValue="false" Description="Summarize the insights trace after the run"/>
Add an option to disable the summarize trace step #rb Jerome.Delattre #jira UE-185261 #preflight skip [CL 25395018 by francis hurteau in ue5-main branch]
2023-05-09 16:27:59 -04:00
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Gauntlet arguments for commandlet, summarize runs -->
EditorPerf: Remove -ddc=NoShared from Commandlet runs. It was introduced to mitigate errors, and its no longer necessary. #rnx #rb devin.doucette #jira UE-157082 #preflight 62b0a1a4de510ae06e550d82 [CL 20740220 by geoff evans in ue5-main branch]
2022-06-20 13:06:30 -04:00
<Property Name="CommandletArgs" Value="-notraceserver"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="SummarizeArgs" Value=""/>
<Property Name="SummarizeArgs" Value="-skipbaseline" If="$(RunAndBaseline)"/>
Telemetry - modify data model to use a build table and a record table separately + support for staging db target #jira none #rb Chris.Constantinescu, Geoff.Evans #ROBOMERGE-AUTHOR: jerome.delattre #ROBOMERGE-SOURCE: CL 17923403 in //UE5/Release-5.0/... via CL 17923442 via CL 17923450 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v885-17909292) [CL 17923463 by jerome delattre in ue5-main branch]
2021-10-26 10:13:23 -04:00
<!-- Publish telemetry options -->
<Option Name="TelemetryConfig" DefaultValue="" Description="The configuration to use when publishing telemetry data to a database"/>
Add an option to disable the summarize trace step #rb Jerome.Delattre #jira UE-185261 #preflight skip [CL 25395018 by francis hurteau in ue5-main branch]
2023-05-09 16:27:59 -04:00
<Property Name="TelemetryConfig" Value="UETelemetryStaging" If="$(IsBuildMachine) And $(IsPreflight) And '$(TelemetryConfig)' == '' And $(RunTraceSummary)"/>
<Property Name="TelemetryConfig" Value="UETelemetry" If="$(IsBuildMachine) And '$(TelemetryConfig)' == '' And $(RunTraceSummary)"/>
Remove References to internal Horde server deployment and network path #jira UE-201978 #rnx #rb sean.sweeney, sebastian.lewicki [CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
<Option Name="ExtraTelemetryArgs" DefaultValue="" Description="Extra arguments passed to the publish telemetry command"/>
<Property Name="ExtraTelemetryArgs" Value="$(ExtraTelemetryArgs) -JobLink=&quot;$(HordeDashboardURL)/job/$(UE_HORDE_JOBID)?step=$(UE_HORDE_STEPID)&quot;" If="'$(HordeDashboardURL)' != ''"/>
Telemetry - modify data model to use a build table and a record table separately + support for staging db target #jira none #rb Chris.Constantinescu, Geoff.Evans #ROBOMERGE-AUTHOR: jerome.delattre #ROBOMERGE-SOURCE: CL 17923403 in //UE5/Release-5.0/... via CL 17923442 via CL 17923450 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Test -> Main) (v885-17909292) [CL 17923463 by jerome delattre in ue5-main branch]
2021-10-26 10:13:23 -04:00
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- The main test running macro logic that is expanded with platform and dependency node names -->
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<Macro Name="RunTest" Arguments="TestNameSuffix;Platform;ProjectName;ProjectTarget;NodeName;Phase;Iteration;Args;EditorArgs">
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Property Name="TestName" Value="EditorPerf$(Phase)$(TestNameSuffix)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="TestFilter" Value="Project.Iteration.PIE"/>
Rebase Gauntlet EditorTests to UE.AutomationTestNode #jira none #rb logan.buchy, han.chu #rnx [CL 26704404 by Jerome Delattre in ue5-main branch]
2023-07-31 09:29:53 -04:00
<Property Name="TestFilterArgs" Value="-runtest=$(TestFilter)"/>
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Property Name="IterationSuffix" Value=""/>
<Property Name="IterationSuffix" Value="$(Iteration)" If="'$(Iteration)' != '1'"/>
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<Property Name="TestOutputDir" Value="$(AutomationOutputDir)/$(ProjectName)$(Platform)EditorPerf"/>
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<Property Name="IterationName" Value="$(ProjectName)$(Platform)$(TestName)$(IterationSuffix)"/>
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<Property Name="TraceFilePath" Value="$(TraceDir)/$(IterationName).utrace"/>
<Property Name="TelemetryFileName" Value="$(IterationName)Telemetry.csv"/>
<Property Name="TelemetryFilePath" Value="$(TraceDir)/$(TelemetryFileName)"/>
Separate the traces data copy from the running of the tests so they can still be copied on failures #jira UE-187567 #rb Bryan.Johnson [CL 26059666 by francis hurteau in ue5-main branch]
2023-06-16 13:20:57 -04:00
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Property Name="LogOutputParams" Value="-logdir=&quot;$(TestOutputDir)&quot;"/>
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<Property Name="ReportParams" Value="-WriteTestResultsForHorde -HordeTestDataKey=&quot;$(NodeName)$(PreflightSuffix)&quot;"/>
Adjusted the naming of Editor Perf tests Split Zen into 2 separate tests with toggles for zenloader and async loading Adjusted location of traces and csv storage to be representative of the job link #rb Jerome.Delattre #jira UE-162833 #preflight 635a99d75b54febd385d307d [CL 22816191 by Francis Hurteau in ue5-main branch]
2022-10-27 15:27:55 -04:00
<Property Name="ArtifactName" Value="$(Phase)$(IterationSuffix)$(TestNameSuffix)"/>
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<Property Name="AllGauntletArgs" Value="-Project=$(ProjectTarget) -Platform=$(Platform) $(GauntletArgs) $(ReportParams) $(LogOutputParams) -artifactname=&quot;$(ArtifactName)&quot;"/>
[EditorPerf] Reuse per branch asset registry to make incremental runs representative of user experience #rnx #jira UE-191845 #rb Francis.Hurteau [CL 28788039 by danny couture in ue5-main branch]
2023-10-14 12:40:57 -04:00
<Property Name="AssetRegistryCacheRootFolderArg" Value="-AssetRegistryCacheRootFolder=&quot;$(AssetRegistryCache_Folder)&quot;"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Property Name="CombinedEditorArgs" Value="$(EditorArgs) $(AssetRegistryCacheRootFolderArg) $(ArgIterationsPIE)"/>
[EditorPerf] Reuse per branch asset registry to make incremental runs representative of user experience #rnx #jira UE-191845 #rb Francis.Hurteau [CL 28788039 by danny couture in ue5-main branch]
2023-10-14 12:40:57 -04:00
<Property Name="RunArgs" Value="$(Args) -editorargs=&quot;$(CombinedEditorArgs)&quot;"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<!-- Do DDC cleanup outside the editor process, handles Cold cleanup without changing stats -->
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<!-- <Commandlet Project="$(ProjectTarget)" Name="DDCCleanup" Arguments="$(Args) $(CommandletArgs)"/> -->
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<!-- Run the Gauntlet EditorPerf Tests -->
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Command Name="RunUnreal" Arguments="$(AllGauntletArgs) $(ProfileArgs) $(TestFilterArgs) $(RunArgs) -sessionlabel=&quot;$(TestName)&quot; -tracefile=&quot;$(TraceFilePath)&quot;"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<!-- Translate the utrace file into csv data -->
Add an option to disable the summarize trace step #rb Jerome.Delattre #jira UE-185261 #preflight skip [CL 25395018 by francis hurteau in ue5-main branch]
2023-05-09 16:27:59 -04:00
<Do If="$(RunTraceSummary)">
<Commandlet Project="$(ProjectTarget)" Name="SummarizeTrace" Arguments="-inputfile=&quot;$(TraceFilePath)&quot; -testname=&quot;$(TestName)&quot; $(SummarizeArgs) $(CommandletArgs)"/>
</Do>
Separate the traces data copy from the running of the tests so they can still be copied on failures #jira UE-187567 #rb Bryan.Johnson [CL 26059666 by francis hurteau in ue5-main branch]
2023-06-16 13:20:57 -04:00
EditorPerf: Allocate a <Node> per Phase and Iteration to make Horde results easier to read #rnx #jira none #rb trivial #preflight #ushell-cherrypick of 18043454 by geoff.evans [CL 18043580 by geoff evans in ue5-main branch]
2021-11-03 19:58:01 -04:00
<Do If="'$(TelemetryConfig)' != ''">
<!-- Publish telemetry to the db -->
Remove References to internal Horde server deployment and network path #jira UE-201978 #rnx #rb sean.sweeney, sebastian.lewicki [CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
<Command Name="PublishUnrealAutomationTelemetry" Arguments="-CSVFile=&quot;$(TelemetryFilePath)&quot; -project=$(Project) -changelist=$(Change) -branch=$(Branch) -TelemetryConfig=$(TelemetryConfig) $(ExtraTelemetryArgs)"/>
Separate the traces data copy from the running of the tests so they can still be copied on failures #jira UE-187567 #rb Bryan.Johnson [CL 26059666 by francis hurteau in ue5-main branch]
2023-06-16 13:20:57 -04:00
</Do>
</Macro>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<!-- The main editor workflows test running macro logic that is expanded with platform and dependency node names -->
<Macro Name="RunEditorWorkflowsTest" Arguments="Platform;ProjectName;NodeName">
<Property Name="TestName" Value="Editor.Workflows"/>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="TestFilterArgs" Value="-runtest=$(TestName)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="TestOutputDir" Value="$(AutomationOutputDir)/$(ProjectName)$(Platform)EditorWorkflows"/>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="TraceFilePath" Value="$(TraceDir)/$(TestName)/$(ProjectName)$(Platform)EditorWorkflows.utrace" />
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="LogOutputParams" Value="-logdir=&quot;$(TestOutputDir)&quot;"/>
<Property Name="ReportParams" Value="-WriteTestResultsForHorde -HordeTestDataKey=&quot;$(NodeName)$(PreflightSuffix)&quot;"/>
<Property Name="AllGauntletArgs" Value="-Project=$(ProjectName) -Platform=$(Platform) $(GauntletArgs) $(ReportParams) $(LogOutputParams)"/>
<Command Name="RunUnreal" Arguments="$(AllGauntletArgs) $(ProfileArgs) $(TestFilterArgs) -sessionlabel=&quot;$(TestName)&quot; -tracefile=&quot;$(TraceFilePath)&quot;" />
</Macro>
Separate the traces data copy from the running of the tests so they can still be copied on failures #jira UE-187567 #rb Bryan.Johnson [CL 26059666 by francis hurteau in ue5-main branch]
2023-06-16 13:20:57 -04:00
<Macro Name="UploadTestTraces" Arguments="Platform;ProjectName">
<!-- Save all files named for this project in the trace directory -->
<Property Name="TestOutputDir" Value="$(AutomationOutputDir)/$(ProjectName)$(Platform)EditorPerf"/>
<Copy From="$(TraceDir)/$(ProjectName)$(Platform)EditorPerf*.*" To="$(TestOutputDir)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
</Macro>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Macro Name="UploadEditorWorkflowsPerformanceDataAndTraces" Arguments="Platform;ProjectName">
<Property Name="TestOutputDir" Value="$(AutomationOutputDir)/$(ProjectName)$(Platform)EditorWorkflows"/>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="TraceFilePath" Value="$(TraceDir)/Editor.Workflows/$(ProjectName)$(Platform)EditorWorkflows.utrace" />
<!-- Translate the utrace file into csv data -->
<Commandlet Project="$(ProjectName)" Name="SummarizeTraceEditorWorkflows" Arguments="-inputfile=&quot;$(TraceFilePath)&quot; -testname=&quot;Editor.Workflows&quot; $(CommandletArgs)" />
Copy "index.json" #jira UE-189267 #rb [CL 26784675 by han chu in ue5-main branch]
2023-08-02 15:38:09 -04:00
<!-- Copy the utrace file and the generated csv performance data to the output directory -->
<Copy From="$(TraceDir)/Editor.Workflows/*" To="$(TestOutputDir)/Editor.Workflows" Overwrite="true"/>
<!-- Copy "index.json" that captures the functional results to the output directory -->
<Copy From="$(RootDir)/Tests/TestReport/index.json" To="$(TestOutputDir)/Editor.Workflows/index.json" Overwrite="true"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
</Macro>
<!-- These will be set to the names of all nodes we want to execute based on specified platforms/options -->
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="RunGraphNodes" Value=""/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="RunEditorWorkflowsGraphNodes" Value=""/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- Mimic of the Runner that retrieves the stashed telemetry file and copies it to the depot location -->
<Macro Name="BaselineResult" Arguments="Platform;Project;Phase">
Rechristen IterationProfile -> EditorPerf for clarity Part 2 - modify branched files, delete old files #rnx #jira none #rb jerome.delattre #preflight 611fbfeb76f1fd0001a5f04b #ROBOMERGE-SOURCE: CL 17251815 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17251843 by geoff evans in ue5-release-engine-test branch]
2021-08-20 15:28:36 -04:00
<Property Name="TestName" Value="EditorPerf$(Phase)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<Property Name="IterationName" Value="$(Project)$(Platform)$(TestName)1"/> <!-- Note the 1! We use Iteration 1 for baselines for now -->
<Property Name="TelemetryFileName" Value="$(IterationName)Telemetry.csv"/>
<Property Name="LocalTelemetryFilePath" Value="$(BaselineDir)/$(TelemetryFileName)"/>
<Property Name="NetworkTelemetryFilePath" Value="$(BaselineAutomationNetworkOutputDir)/$(TelemetryFileName)"/>
<Copy From="$(NetworkTelemetryFilePath)" To="$(LocalTelemetryFilePath)" Overwrite="true"/>
<Do If="!$(IsBuildMachine)">
<Spawn Exe="p4" Arguments="reconcile -ea $(LocalTelemetryFilePath)"/>
</Do>
</Macro>
<!-- This will be set to the names of all nodes we want to execute based on specified platforms/options -->
<Property Name="BaselineGraphNodes" Value=""/>
<!-- ForEach Platform to run, generate graph nodes -->
<ForEach Name="Platform" Values="$(Platforms)">
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- ForEach Project that is defined, generate the graph nodes -->
<ForEach Name="Project" Values="$(AllProjects)">
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
<!-- Each project should be setup by invoking the SetupPerfProject macro which will set up the various variables we'll need for the tests -->
Small bug fix to CL 31276995 to actually use the ExtraNonCopyableArgs added to EditorPerf.xml perf projects. #rb matt.breindel #jira UE-205021 [CL 31305925 by matt breindel in ue5-main branch]
2024-02-08 16:48:45 -05:00
<Property Name="ProjectCombinedArgs" Value="$($(Project)__SpecificArgs) $($(Project)__MapArgs) $($(Project)__ExtraNonCopyableArgs) $(AdditionalRuntimeArgs)"/>
Adding support to the BuildGraph system to allow properties first declared inside a macro to be flagged as CreateInParentScope causing them to be created in the scope containing the macro invocation. This allows macros to be used to define collections of properties. This pattern is now used in EditorPerf.xml inside the SetupPerfProject macro. #rb [at]ben.marsh [at]ryan.hummer [at]bryan.johnson #jira UE-205820 [CL 31149655 by matt breindel in ue5-main branch]
2024-02-02 19:00:11 -05:00
<Property Name="ProjectTarget" Value="$($(Project)__ProjectTarget)"/>
<Property Name="EditorTarget" Value="$($(Project)__EditorTarget)"/>
Expose a param on editor perf test to specify a map to load for the test using the full asset path #rb Jerome.Delattre #jira UE-170933 #preflight 6390fa27bb6fefa47239405e [CL 23436748 by francis hurteau in ue5-main branch]
2022-12-07 18:21:54 -05:00
EditorPerf Update for project-specific UHT targets #rnx #preflight 61523074d0edce00010657e2 #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17637177 via CL 17637888 via CL 17638532 via CL 17638553 via CL 17638567 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v874-17637634) #ROBOMERGE[STARSHIP]: UE5-Main [CL 17638590 by geoff evans in ue5-release-engine-test branch]
2021-09-27 19:39:25 -04:00
<!-- Use as base string for directories and key for node names -->
Fix Agent setup to parallelize across projects #rnd #jira none #rb trivial #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17546550 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530) [CL 17546559 by geoff evans in ue5-release-engine-test branch]
2021-09-16 20:42:29 -04:00
<Property Name="OutputName" Value="$(Project)$(Platform)EditorPerf"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- Compile the Editor. Set up compilation nodes for all projects that have been defined even if we aren't going to test them. This lets the tested projects depend on non-tested ones. -->
<Property Name="CompileNodeName" Value="Compile $(Project) $(Platform)" />
Add option to run all compiles on a single machine Add option to run compiles with nodebuginfo Remove UHT #jira none #rnx #rb Ryan.Hummer, Francis.Hurteau [CL 23393325 by Bryan Johnson in ue5-main branch]
2022-12-05 12:34:24 -05:00
<Property Name="AgentModifier" Value=""/>
<Property Name="AgentModifier" Value=" $(Project)" If="!$(SingleAgentCompile)"/>
<Agent Name="Compile Editor Agent $(Platform)$(AgentModifier" Type="$($(Platform)CompileAgentType)">
Add options for label categories, which can vary on different Horde servers Move properties out of agent blocks (they only are necessary for Node) #rnd #rb trivial #presubmit 615b51abe3b24d00016b6954 #ROBOMERGE-OWNER: geoff.evans #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17713559 via CL 17713577 via CL 17713591 via CL 17713594 via CL 17713619 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v879-17706426) #ROBOMERGE-CONFLICT from-shelf #ROBOMERGE[STARSHIP]: UE5-Main [CL 17714342 by geoff evans in ue5-release-engine-test branch]
2021-10-04 17:28:23 -04:00
<Node Name="$(CompileNodeName)">
Added SetVersion to EditorPerf job #fyi geoff.evans #rb bryan.johnson [CL 20520901 by mark lintott in ue5-main branch]
2022-06-06 11:28:11 -04:00
<SetVersion Change="$(Change)" Branch="$(EscapedBranch)" If="$(IsBuildMachine)"/>
EditorPerf Update for project-specific UHT targets #rnx #preflight 61523074d0edce00010657e2 #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17637177 via CL 17637888 via CL 17638532 via CL 17638553 via CL 17638567 #ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v874-17637634) #ROBOMERGE[STARSHIP]: UE5-Main [CL 17638590 by geoff evans in ue5-release-engine-test branch]
2021-09-27 19:39:25 -04:00
<Compile Target="ShaderCompileWorker" Platform="$(Platform)" Configuration="Development"/>
Editor Perf Test build graph change to support plugin based sub projects Changed load and pie scope for summarize trace to use wildcard #rb Bryan.Johnson [CL 25290029 by francis hurteau in ue5-main branch]
2023-05-01 15:48:14 -04:00
<Compile Target="CrashReportClientEditor" Platform="$(Platform)" Project="$(ProjectTarget)" Configuration="Shipping"/>
<Compile Target="$(EditorTarget)" Platform="$(Platform)" Project="$(ProjectTarget)" Configuration="Development" Arguments="$(EditorCompileArgs)"/>
EditorPerf Update project configurations, projects configured in horde Use to MapsToPIETest instead of AssetsToOpen... because we PIE test them :) #rnx #jira none #rb trivial #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17546319 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530) [CL 17546323 by geoff evans in ue5-release-engine-test branch]
2021-09-16 20:02:03 -04:00
</Node>
EditorPerf Attempt fixes for Horde: Move Editor Compiles back onto WIN-UE5 agents Set Iteratiions back to 1 #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17575475 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257) [CL 17575486 by geoff evans in ue5-release-engine-test branch]
2021-09-20 16:43:30 -04:00
</Agent>
Update Label strings, add a badge for Run #jira UE-150300 #preflight 6279af2d10766ef8c1c67984 [CL 20115410 by geoff evans in ue5-main branch]
2022-05-09 20:55:59 -04:00
<Label Category="$(CompileCategory)" Name="$(Project) Editor Compile" Requires="$(CompileNodeName)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- Store off the name of the compile node so that we can use look it up by Project name from UseBinariesFrom. -->
<Property Name="$(Project)__CompileNodeName" Value="$(CompileNodeName)"/>
EditorPerf Attempt fixes for Horde: Move Editor Compiles back onto WIN-UE5 agents Set Iteratiions back to 1 #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17575475 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v871-17566257) [CL 17575486 by geoff evans in ue5-release-engine-test branch]
2021-09-20 16:43:30 -04:00
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- If the project will be run, set up the test nodes -->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Do If="ContainsItem('$(Projects)', '$(Project)', ';')=='true'">
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!-- Run the Tests -->
<Property Name="RunNodeRequires" Value="$(CompileNodeName)"/>
<Property Name="RunNodeRequires" Value="$($($(Project)__UseBinariesFrom)__CompileNodeName)" If="'$($(Project)__UseBinariesFrom)'!=''"/>
<Property Name="RunNodeList" Value=""/>
<!--Each node in this the nested loops below, they need to depend on predecessors-->
<Property Name="UploadNodeList" Value=""/>
<Agent Name="EditorPerf Agent $(Platform) $(Project)" Type="EditorPerf$(Platform)">
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<ForEach Name="Phase" Values="$(Phases)">
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Do If="$(EnableBasePhaseTests)">
<ForEach Name="Iteration" Values="$(Iterations)">
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="IterationSuffix" Value=""/>
<Property Name="IterationSuffix" Value="$(Iteration)" If="'$(Iteration)' != '1'"/>
<Property Name="RunNodeName" Value="Run $(OutputName) $(Phase)$(IterationSuffix)"/>
<Node Name="$(RunNodeName)" Requires="$(RunNodeRequires);$(RunNodeList)">
<Expand Name="RunTest" TestNameSuffix="NoZenLoader" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeName)" Phase="$(Phase)" Iteration="$(Iteration)" Args="$($(Phase)Args)" EditorArgs="$(ProjectCombinedArgs) $(NoZenLoaderTestArgs)"/>
</Node>
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeName)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</ForEach>
</Do>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<!-- Setup Zen Loader tests for this phase -->
<Do>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!--Zen Loader TestRun if enabled-->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeZenName" Value="Run $(OutputName) $(Phase) ZenLoader"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Node Name="$(RunNodeZenName)" Requires="$(RunNodeRequires);$(RunNodeList)" If="$(EnableZenLoaderTest)">
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Expand Name="RunTest" TestNameSuffix="ZenLoader" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeZenName)" Phase="$(Phase)" Iteration="1" Args="$($(Phase)Args)" EditorArgs="$(ProjectCombinedArgs) $(ZenLoaderTestArgs)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Node>
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeZenName)" If="$(EnableZenLoaderTest)"/>
<!--Zen Loader Async TestRun if enabled-->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeZenAsyncName" Value="Run $(OutputName) $(Phase) ZenLoader Async"/>
<Node Name="$(RunNodeZenAsyncName)" Requires="$(RunNodeRequires);$(RunNodeList)" If="$(EnableZenLoaderAsyncThreadTest)">
<Expand Name="RunTest" TestNameSuffix="ZenLoaderAsync" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeZenAsyncName)" Phase="$(Phase)" Iteration="1" Args="$($(Phase)Args)" EditorArgs="$(ProjectCombinedArgs) $(ZenLoaderAsyncTestArgs)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Node>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeZenAsyncName)" If="$(EnableZenLoaderAsyncThreadTest)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!--Zen Store DDC TestRun if enabled-->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeZenStoreDDCName" Value="Run $(OutputName) $(Phase) ZenLoader Store DDC"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<Node Name="$(RunNodeZenStoreDDCName)" Requires="$(RunNodeRequires);$(RunNodeList)" If="$(EnableZenStoreDDCTest)">
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Expand Name="RunTest" TestNameSuffix="ZenStoreAsyncDDC" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeZenStoreDDCName)" Phase="$(Phase)" Iteration="1" Args="$(ZenStoreDDCPhaseArgs)" EditorArgs="$(ProjectCombinedArgs) $(ZenStoreDDCTestArgs)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Node>
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeZenStoreDDCName)" If="$(EnableZenStoreDDCTest)"/>
</Do>
<!--Warm only test runs e.g LazyLoad-->
<Do If="'$(Phase)' == 'Warm'">
<!--Legacy LazyLoad TestRun if enabled-->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeLazyLoadName" Value="Run $(OutputName) $(Phase) LazyLoad NoZenLoader"/>
<Node Name="$(RunNodeLazyLoadName)" Requires="$(RunNodeRequires);$(RunNodeList)" If="$(EnableLazyLoadNoZenLoaderTest)">
Added a -nozenloader parameter to EditorPerf due to ZenLoader being on by default. #rb matt.breindel, thierry.begin [CL 31352202 by jan yu in ue5-main branch]
2024-02-09 15:17:04 -05:00
<Expand Name="RunTest" TestNameSuffix="NoZenLoader" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeLazyLoadName)" Phase="$(Phase)" Iteration="1" Args="$($(Phase)Args)" EditorArgs="$(ProjectCombinedArgs) $(LazyLoadTestArgs) $(NoZenLoaderTestArgs)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Node>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeLazyLoadName)" If="$(EnableLazyLoadNoZenLoaderTest)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
<!--Zen LazyLoad TestRun if enabled-->
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeLazyLoadZenName" Value="Run $(OutputName) $(Phase) LazyLoad ZenLoader"/>
<Node Name="$(RunNodeLazyLoadZenName)" Requires="$(RunNodeRequires);$(RunNodeList)" If="$(EnableLazyLoadZenLoaderTest)">
Added a -nozenloader parameter to EditorPerf due to ZenLoader being on by default. #rb matt.breindel, thierry.begin [CL 31352202 by jan yu in ue5-main branch]
2024-02-09 15:17:04 -05:00
<Expand Name="RunTest" TestNameSuffix="ZenLoader" Platform="$(Platform)" ProjectName="$(Project)" ProjectTarget="$(ProjectTarget)" NodeName="$(RunNodeLazyLoadZenName)" Phase="$(Phase)" Iteration="1" Args="$($(Phase)Args)" EditorArgs="$(ProjectCombinedArgs) $(LazyLoadZenTestArgs)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Node>
Removing Incremental phase from EditorPerfTest as it never functioned properly. General cleanup of naming and logic around phases and zen loader. Cleared up an issue with AssetRegistryCache where we would have had a warm registry cache on Cold phases after the first. These changes require corresponding changes to the stream json. [REVIEW] [at]*francis.hurteau [FYI] [at]mark.lintott #jira UE-206326 #rb Francis.Hurteau#preflight 65c6b4c0964af0e0ad11e2bf [CL 31368514 by matt breindel in ue5-main branch]
2024-02-10 12:55:05 -05:00
<Property Name="RunNodeList" Value="$(RunNodeList);$(RunNodeLazyLoadZenName)" If="$(EnableLazyLoadZenLoaderTest)"/>
* Improved dependency management for editor perf tests. SetupPerfTests now accepts a UseBinariesFrom argument to allow projects to reuse the binaries generated from other projects' compile steps. * Added a new option for specifying a number of PIE iterations during each editor run. -NumIterationPIE must be a value >0. #jira UE-205003 [REVIEW] [at]*bryan.johnson [at]francis.hurteau [FYI] [at]mark.lintott #rb Bryan.Johnson [CL 31277047 by matt breindel in ue5-main branch]
2024-02-07 18:33:10 -05:00
</Do>
</ForEach>
<Property Name="RunNodeUploadPhaseTraces" Value="Upload $(OutputName) Traces"/>
<Node Name="$(RunNodeUploadPhaseTraces)">
<Expand Name="UploadTestTraces" Platform="$(Platform)" ProjectName="$(Project)"/>
</Node>
<Property Name="UploadNodeList" Value="$(RunNodeUploadPhaseTraces)"/>
</Agent>
<Label Category="$(RunCategory)" Name="$(Project) Editor Run" Requires="$(RunNodeRequires);$(RunNodeList);$(UploadNodeList)" UgsBadge="$(Project) Editor Run"/>
<Property Name="RunGraphNodes" Value="$(RunGraphNodes);$(RunNodeList);$(UploadNodeList)"/>
<!--Baseline the Results-->
<Property Name="BaselineNodeName" Value="Baseline $(OutputName)"/>
<Property Name="BaselineNodeRequires" Value=""/>
<Property Name="BaselineNodeRequires" Value="$(RunNodeName)" If="$(RunAndBaseline)"/>
<Property Name="BaselineGraphNodes" Value="$(BaselineGraphNodes);$(BaselineNodeName)"/>
<Agent Name="EditorPerf Agent $(Platform) $(Project)" Type="EditorPerf$(Platform)">
<Node Name="$(BaselineNodeName)" Requires="$(BaselineNodeRequires)">
<ForEach Name="Phase" Values="$(Phases)">
<Expand Name="BaselineResult" Platform="$(Platform)" Project="$(Project)" Phase="$(Phase)"/>
</ForEach>
</Node>
</Agent>
<Label Category="$(BaselineCategory)" Name="$(Project) Perf Baseline" Requires="$(BaselineNodeName)"/>
</Do>
Fix Agent setup to parallelize across projects #rnd #jira none #rb trivial #ROBOMERGE-AUTHOR: geoff.evans #ROBOMERGE-SOURCE: CL 17546550 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530) [CL 17546559 by geoff evans in ue5-release-engine-test branch]
2021-09-16 20:42:29 -04:00
</ForEach> <!-- Projects -->
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
</ForEach> <!-- Platforms -->
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<!-- Generate graph nodes for each platform to run -->
<ForEach Name="Platform" Values="$(Platforms)">
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="ProjectName" Value="EngineTest" />
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<!-- Define output name for the EditorWorkflows test -->
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="EditorWorkflowsOutputName" Value="$(ProjectName)$(Platform)EditorWorkflows"/>
<Property Name="CompileNodeName" Value="Compile $(ProjectName) $(Platform) EditorWorkflows"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="AgentModifier" Value=""/>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Property Name="AgentModifier" Value=" $(ProjectName)" If="!$(SingleAgentCompile)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<!-- Compile Agent configuration -->
<Agent Name="Compile Editor Agent $(Platform)$(AgentModifier)" Type="$($(Platform)CompileAgentType)">
<Node Name="$(CompileNodeName)">
<SetVersion Change="$(Change)" Branch="$(EscapedBranch)" If="$(IsBuildMachine)"/>
<Compile Target="ShaderCompileWorker" Platform="$(Platform)" Configuration="Development"/>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Compile Target="CrashReportClientEditor" Platform="$(Platform)" Project="$(ProjectName)" Configuration="Shipping"/>
<Compile Target="$(ProjectName)Editor" Platform="$(Platform)" Project="$(ProjectName)" Configuration="Development" Arguments="$(EditorCompileArgs)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
</Node>
</Agent>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Label Category="$(CompileCategory)" Name="$(ProjectName) Editor Compile" Requires="$(CompileNodeName)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<!-- Set up properties for run and upload nodes -->
<Property Name="RunEditorWorkflowsNodeRequires" Value="$(CompileNodeName)"/>
<Property Name="UploadEditorWorkflowsNodeList" Value=""/>
<Property Name="RunEditorWorkflowsNodeList" Value=""/>
<!-- Configure EditorWorkflows Agent -->
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Agent Name="EditorWorkflows Agent $(Platform) $(ProjectName)" Type="EditorPerf$(Platform)">
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="RunEditorWorkflowsNodeName" Value="Run $(EditorWorkflowsOutputName)" />
<Node Name="$(RunEditorWorkflowsNodeName)" Requires="$(RunEditorWorkflowsNodeRequires);$(RunEditorWorkflowsNodeList)">
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Expand Name="RunEditorWorkflowsTest" Platform="$(Platform)" ProjectName="$(ProjectName)" NodeName="$(RunEditorWorkflowsNodeName)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
</Node>
<Property Name="RunEditorWorkflowsNodeList" Value="$(RunEditorWorkflowsNodeList);$(RunEditorWorkflowsNodeName)" />
<Property Name="RunNodeUploadTraces" Value="Upload $(EditorWorkflowsOutputName) Traces"/>
<!-- Set up Node for uploading traces -->
<Node Name="$(RunNodeUploadTraces)">
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Expand Name="UploadEditorWorkflowsPerformanceDataAndTraces" Platform="$(Platform)" ProjectName="$(ProjectName)"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
</Node>
<!-- Update UploadEditorWorkflowsNodeList -->
<Property Name="UploadEditorWorkflowsNodeList" Value="$(UploadEditorWorkflowsNodeList);$(RunNodeUploadTraces)"/>
</Agent>
Make SummarizeTraceEditorWorkflows part of UploadEditorWorkflowsPerformanceDataAndTraces an after step not conditional to previous step success state #rb Han Chu #rnx [CL 26963827 by Jerome Delattre in ue5-main branch]
2023-08-09 13:47:29 -04:00
<Label Category="$(RunCategory)" Name="$(ProjectName) Editor Run" Requires="$(RunEditorWorkflowsNodeRequires);$(RunEditorWorkflowsNodeList);$(UploadEditorWorkflowsNodeList)" UgsBadge="$(ProjectName) Editor Run"/>
Build graph and performance metrics A new commandlet was added to record the performance data of workflows tests. Modified the build graph script for the EditorPerf test to include the task nodes and agents for the workflows tests. #jira UE-189274 #review @Francis.Hurteau @logan.buchy [CL 26532108 by han chu in ue5-main branch]
2023-07-21 21:34:35 -04:00
<Property Name="RunEditorWorkflowsGraphNodes" Value="$(RunEditorWorkflowsGraphNodes);$(RunEditorWorkflowsNodeList);$(UploadEditorWorkflowsNodeList)"/>
</ForEach>
<!-- End ForEach Platforms -->
<!-- These Nodes run the Editor Workflows test and gather profile data -->
<Aggregate Name="Run EditorWorkflows Tests" Requires="$(RunEditorWorkflowsGraphNodes)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- These Nodes run the Editor and gather profile data -->
Rechristen IterationProfile -> EditorPerf for clarity Part 2 - modify branched files, delete old files #rnx #jira none #rb jerome.delattre #preflight 611fbfeb76f1fd0001a5f04b #ROBOMERGE-SOURCE: CL 17251815 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17251843 by geoff evans in ue5-release-engine-test branch]
2021-08-20 15:28:36 -04:00
<Aggregate Name="Run EditorPerf Tests" Requires="$(RunGraphNodes)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- These Nodes copies the CSV telemetry files to special location in the depot, thus making them the "baselines" -->
Rechristen IterationProfile -> EditorPerf for clarity Part 2 - modify branched files, delete old files #rnx #jira none #rb jerome.delattre #preflight 611fbfeb76f1fd0001a5f04b #ROBOMERGE-SOURCE: CL 17251815 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17251843 by geoff evans in ue5-release-engine-test branch]
2021-08-20 15:28:36 -04:00
<Aggregate Name="Baseline EditorPerf Results" Requires="$(BaselineGraphNodes)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
<!-- This Node submits the baseline CSV files to Perforce -->
<!--
<Agent Name="Submission Agent Win64" Type="Win64">
<Node Name="Submit Baseline To Perforce" Requires="$(BaselineGraphNodes)">
Rechristen IterationProfile -> EditorPerf for clarity Part 2 - modify branched files, delete old files #rnx #jira none #rb jerome.delattre #preflight 611fbfeb76f1fd0001a5f04b #ROBOMERGE-SOURCE: CL 17251815 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17251843 by geoff evans in ue5-release-engine-test branch]
2021-08-20 15:28:36 -04:00
<Submit Description="[CL $(Change)] Updated EditorPerf baselines" Files="$(BaselineFiles)"/>
Rechristen IterationProfile -> EditorPerf for clarity Part 1 - branch files to new names No preflight as this just creates some new files, which shouldn't cause any issues #rnx #jira none #rb trivial #preflight skip trivial #ROBOMERGE-SOURCE: CL 17247460 in //UE5/Main/... #ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924) [CL 17247507 by geoff evans in ue5-release-engine-test branch]
2021-08-20 10:27:07 -04:00
</Node>
</Agent>
-->
</BuildGraph>
Reference in New Issue Copy Permalink