Commit Graph

163 Commits

Author SHA1 Message Date
jerome delattre
a9ab832834 Avoid changing the AutomationController state when running test while receiving multiple FindWorkers responses
#jira UE-182629
#preflight 643dab42db681113a4bae55b

[CL 25089967 by jerome delattre in ue5-main branch]
2023-04-18 13:26:37 -04:00
zahra nikbakht
680c959a65 Allow source link detection in MessageLog text when the source address is located at the right of the message (previously it would only work when the source address was on the left of the message)
#jira UE-172487
#preflight 6425a86bc463fac9c8ffa4f2
#rb Jerome.Delattre

[CL 24859391 by zahra nikbakht in ue5-main branch]
2023-03-30 16:07:32 -04:00
Mikita Hauruk
bcd6b04355 Added EComparisonFileTypes enum for IAutomationReport.h, changed TEXT() to enum AutomationControllerManager.cpp when referencing test report Artifact file key
Use enum or predefined const strings when referencing test report Artifact file key in FAutomationArtifact

#jira UE-176635
#rb adam.miezianko, chris.constantinescu, jerome.delattre, oleg.krasnov, saltanat.janybekova, mikalai.sukhikh
#preflight 63ecbb15956709374afcfd36

[CL 24309464 by Mikita Hauruk in ue5-main branch]
2023-02-20 01:02:38 -05:00
Joe Kirchoff
3c75f6cb4f Fix include path inconsistentcy with Launch module when -AllModules is passed
#rnx
#rb trivial
#jira UE-176944
#preflight 63eaaeb1923476b686f41991

[CL 24190159 by Joe Kirchoff in ue5-main branch]
2023-02-13 16:49:45 -05:00
jerome delattre
80b32adb45 Prevent approved reference images to be copied to html test report for successful test
#jira UE-176364
#preflight 63e3d66d8374ef68dffe3565
#rb Chris.Constantinescu

[CL 24085750 by jerome delattre in ue5-main branch]
2023-02-08 18:20:35 -05:00
Jerome Delattre
2f083222dd Improve device timeout error by differenciating DeviceName and GameInstance from the Automation device cluster manager API
#preflight 63d432775d0c0164cca5fb47
#rb Chris.Constantinescu
#jira none

[CL 23932523 by Jerome Delattre in ue5-main branch]
2023-01-31 13:35:09 -05:00
jeanmichel dignard
8d07a7338f Exec commands changes:
- Port some development only exec commands to Exec_Dev.

#rb none
#preflight 63c5c97f02024f93d822d678

[CL 23734254 by jeanmichel dignard in ue5-main branch]
2023-01-16 19:28:53 -05:00
Jerome Delattre
a780c91ede AutomationController - Fixing end queue message not being triggered
Prevent multiple Run Test to be queued at the same time (not supported)
Rename Filter: to StartsWith:
Some more code cleanup

#jira UE-170942
#rnx
#rb Ben.Salem
#preflight 638f68315c5308d18ce3c7ee

[CL 23416127 by Jerome Delattre in ue5-main branch]
2022-12-06 15:49:46 -05:00
bryan sefcik
4b8a83790a Updated to use UE_INLINE_GENERATED_CPP_BY_NAME.
#jira
#preflight 637c388f170bc34a93587526

[CL 23244381 by bryan sefcik in ue5-main branch]
2022-11-22 20:17:33 -05:00
bryan sefcik
0beee50b45 Updated ../Engine/Source/Developer/... to inline gen.cpp files
Before:
Total CPU Time: 53783.640625 s
Total time in Parallel executor: 558.66 seconds
After:
Total CPU Time: 47886.140625 s
Total time in Parallel executor: 498.81 seconds

#jira

[CL 22173145 by bryan sefcik in ue5-main branch]
2022-09-24 13:31:25 -04:00
timrademaker
560e9cecd9 PR #7401: Fix/AutomationCommandLine (Contributed by timrademaker)
#rb Jerome.Delattre
#preflight skip

[CL 22013755 by timrademaker in ue5-main branch]
2022-09-14 15:21:59 -04:00
bryan sefcik
a3dddc6630 Pass 1 on Developer include fixes:
Removed redundant private include paths from build.cs files.
Fixed include paths to be relative to the private or public folders.
Hid or removed includes that reached into other private module folders.
Updated PublicInclude paths when necessary.

#jira
#preflight 631e281694758d0bf2ea1399

[CL 21960082 by bryan sefcik in ue5-main branch]
2022-09-11 18:32:18 -04:00
jerome delattre
76f15ec740 Follow up to 21896012 - change LastPingTime type from float to double
#rnx

[CL 21908291 by jerome delattre in ue5-main branch]
2022-09-08 20:11:58 -04:00
jerome delattre
633b27d9c0 Revert 21824856 (Retry sending a request to run a test if schedule was not confirmed)
#rnx

[CL 21908280 by jerome delattre in ue5-main branch]
2022-09-08 20:11:38 -04:00
jerome delattre
ec6f3a74bc Put back LLM scope and float to double change in test Automation modules
#rnx

[CL 21828531 by jerome delattre in ue5-main branch]
2022-09-06 16:29:09 -04:00
jerome delattre
0998fb6b90 Test Automation - Retry sending a request to run a test if schedule was not confirmed.
#preflight 631767b36431d379928cc011
#rb Chris.Constantinescu
#rnx

[CL 21828390 by jerome delattre in ue5-main branch]
2022-09-06 16:23:26 -04:00
Zak Middleton
84fb0737e0 #ue5 - Fix type conversion warnings in modules: AutomationController, AutomationTest, AVEncoder, AVIWriter.
#jira UE-160830
#rb Andrew.Davidson
#preflight 630d2147556fc14dce527da5

[CL 21690862 by Zak Middleton in ue5-main branch]
2022-08-29 18:32:03 -04:00
Jerome Delattre
2e98fecdba Test Automation - Add Keep PIE open in advance settings
+ add project config settings to change that default.

#jira UE-162059
#preflight 6307d9665a76ca27a8a800d6
#rb Chris.Constantinescu

[CL 21685895 by Jerome Delattre in ue5-main branch]
2022-08-29 15:29:28 -04:00
Jerome Delattre
c6c0e9a2a5 Support individual test exclusion for different RHI when parent suite does not exclude all RHI
+ enhanced management of RHI through the UI: If a RHI is specify, any child test can be excluded on an additional RHI by clicking on edit exclusion
+ disable exclusion editing on remote session

#jira UE-147020
#preflight 62ff9c99086f90bbc401a999
#rb Chris.Constantinescu

[CL 21462884 by Jerome Delattre in ue5-main branch]
2022-08-19 15:29:47 -04:00
bob tellez
410858eb02 #UE Compile fix for when WITH_AUTOMATION_TESTS is false in an editor build
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 21342143 via CL 21342255 via CL 21342279
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21343966 by bob tellez in ue5-main branch]
2022-08-11 16:19:05 -04:00
andrew grant
f34aa9015c Fix for automation changes in shipping editor builds
#p4v-cherrypick 21201897

#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 21201864 via CL 21204054 via CL 21204077 via CL 21204091
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21207498 by andrew grant in ue5-main branch]
2022-07-21 15:37:21 -04:00
andrew grant
f6c96db43f Automation Improvements for running editor-based automation, and specifically profiling
* Added IgnoreLogEvents automation command / cvar that can be used to exclude log events from automation reports. Specifically here this prevents errors/warnings in something like PIE from manigesting as automation events
* Automation Controller Manager now waits for an interactive framerate before executing. This ensures automation doesn't occur when async loading is being flushedcritical to startup or level loading and f
* Renamed FWaitForAverageFrameRate to FWaitForInteractiveFramerate and moved default values to be ini-driven
* Editor now disables throttling when -benchmarking is specified
* FIxed issue where Project.Maps.PIE only worked if the provided map was a full object name (/Game/Path/MyMap.MyMap)

#rb swarm

#ROBOMERGE-OWNER: andrew.grant
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 21201287 via CL 21201301 via CL 21203967 via CL 21203996 via CL 21204009
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21205507 by andrew grant in ue5-main branch]
2022-07-21 14:39:27 -04:00
bryan sefcik
de1956f47b Ran IWYU on Public headers under Engine/Source/Developer/...
Headers are updated to contain any missing #includes needed to compile and #includes are sorted.  Nothing is removed.

#ushell-cherrypick of 21064294 by bryan.sefcik
#jira
#preflight 62d5c2111062f2e63015e598

#ROBOMERGE-OWNER: bryan.sefcik
#ROBOMERGE-AUTHOR: bryan.sefcik
#ROBOMERGE-SOURCE: CL 21155249 via CL 21158121 via CL 21161259
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21182053 by bryan sefcik in ue5-main branch]
2022-07-20 12:03:45 -04:00
Jerome Delattre
41d280fd6d Fix test number sum of sub category in Test Automation window
+ fix internal test sub category names in Test Automation window

#preflight 62d03045dc4397d38403efb5
#jira none
#rnx
#rb Chris.Constantinescu

[CL 21091332 by Jerome Delattre in ue5-main branch]
2022-07-14 11:21:50 -04:00
Jerome Delattre
164e6417b5 Log Test report path only if it was generated.
#jira none
#rb trivial
#preflight 62cd923b492f42e203039507

[CL 21057294 by Jerome Delattre in ue5-main branch]
2022-07-12 11:49:08 -04:00