Commit Graph

661 Commits

Author SHA1 Message Date
jerome delattre
1f9ccfed08 Move Map variable assignement inside condition block
#rnx

[CL 32130343 by jerome delattre in ue5-main branch]
2024-03-08 15:44:14 -05:00
jerome delattre
43322bb6a0 Validate active screenshot id before accepting screenshot comparison completion
#jira UE-202925
#rnx
#rb christopher.fiala, sean.sweeney, sebastian.lewicki

[CL 32122480 by jerome delattre in ue5-main branch]
2024-03-08 11:48:08 -05:00
jerome delattre
ab0e65d674 Introduce UEPerf.EditorGauntletTestController test to allow running editor performance test agnostic to project and Gauntlet Controller
#jira UE-208606
#rnx
#rb sebastian.lewicki
[FYI] matt.breindel

[CL 32121686 by jerome delattre in ue5-main branch]
2024-03-08 11:20:49 -05:00
brendan lienau
66591afe53 [Gauntlet] Implements new launch flow functions for TargetDeviceAndroid
#jira UE-201388
#rb Chris.Cossiah, Chris.Babcock

[CL 32062972 by brendan lienau in ue5-main branch]
2024-03-06 14:41:46 -05:00
brendan lienau
f0a72e06bf [Gauntlet] Implements new launch flow functions for TargetDeviceDesktopCommon
Also implements overrides for each desktop platform (Win64, WinGDK, Linux, Mac)

#jira UE-201386
#rb David.Harvey, Jerome.Delattre

[CL 32056288 by brendan lienau in ue5-main branch]
2024-03-06 11:47:05 -05:00
gary yuan
a382d281a3 [Gauntlet] Fix for basedir command line setting from path containing spaces
#rb Jerome.Delattre

[CL 32040878 by gary yuan in ue5-main branch]
2024-03-05 18:45:49 -05:00
brendan lienau
4db3c0ec18 [Gauntlet] Mark Gauntlet builds with whether or not they have the capability to copy additional files. UnrealSession will only copy files if the build supports it
#rb Andrew.Grant

[CL 32032840 by brendan lienau in ue5-main branch]
2024-03-05 15:15:35 -05:00
jerome delattre
bf92a7b186 Change log severity level for role for better report readability. Info in the header, and an Error in the role summary.
+ Better reflect severity base on role processed status

#rb brendan.lienau, sean.sweeney, sebastian.lewicki

[CL 31735672 by jerome delattre in ue5-main branch]
2024-02-22 16:45:00 -05:00
dorgonman
8430c41472 Fix Unable to locate DeviceSupport directory with suffix 'DeveloperDiskImage.dmg' error when upgrade to xcode15 for iOS 17
PR #11491

#rb zack.neyland

[CL 31732695 by dorgonman in ue5-main branch]
2024-02-22 15:32:38 -05:00
brendan lienau
671a6f3b63 [Gauntlet] Re-order TargetDeviceAndroid members/defintions
#jira UE-201388

[CL 31648546 by brendan lienau in ue5-main branch]
2024-02-20 12:10:44 -05:00
jerome delattre
1d92edcb21 Lower log severy on failing attempt to install application on device.
#jira UE-206758
#rnx
#rb sean.sweeney, sebastian.lewicki

[CL 31563831 by jerome delattre in ue5-main branch]
2024-02-16 09:46:43 -05:00
jerome delattre
f69a080a06 Disable report for Horde on UE.InstallOnly dummy test
#rb rob.huyett

[CL 31489766 by jerome delattre in ue5-main branch]
2024-02-14 15:18:58 -05:00
jerome delattre
816e991357 [Gauntlet] Introduce a new class (UnrealLogStreamParser) to handle Unreal Structure logging output natively and use it during test tick to avoid parsing the output several times.
#jira UE-201653
#rnx
#rb sebastian.lewicki

[CL 31446261 by jerome delattre in ue5-main branch]
2024-02-13 16:19:18 -05:00
brendan lienau
a33d670120 [Gauntlet] Return false when cancelling during TryReserveDevies
#rb chris.constantinescu

[CL 31351037 by brendan lienau in ue5-main branch]
2024-02-09 14:47:57 -05:00
joe kirchoff
f6a2b5e35e Fix some dotnet warnings
#rnx

[CL 31114076 by joe kirchoff in ue5-main branch]
2024-02-01 20:01:12 -05:00
brendan lienau
028130e2dc [Gauntlet] Adds new UnrealSession.LaunchSession flow using new TargetDevice functions
This new flow is disabled by default and requires -ExperimentalLaunchFlow to be present to run

Changes:
- Current implementation of LaunchSession has been moved to Legacy_LaunchSession(). Adding further references should be avoided.
- Exception guarding happens in several steps, improving clarity on which step failures occur in LaunchSession
- Tests that run several iterations will now clean the device artifacts between each run without needing a full re-install of the build
- UnrealDeviceReservation can now choose to release only problem devices
- When a problem device is encountered during LaunchSession, only the problem device(s) will be released to the pool instead of all devices
- Overall improvements to logging

#rb Ryan.Bazinet, Marcelo.Gomes
#jira UE-201402

[CL 30931650 by brendan lienau in ue5-main branch]
2024-01-26 13:22:42 -05:00
jerome delattre
0f828e1340 Override Horde testdata filename through ArtifactName option
#jira UE-204256
#rnx

#rb rob.huyett, sean.sweeney, sebastian.lewicki

[CL 30899891 by jerome delattre in ue5-main branch]
2024-01-25 16:09:30 -05:00
jerome delattre
7d7290ab2b Revert change in conditional copy of log file in Gauntlet UnrealSession
#rnx

[CL 30716967 by jerome delattre in ue5-main branch]
2024-01-19 11:21:00 -05:00
jerome delattre
24ae93d9f3 Remove References to internal Horde server deployment and network path
#jira UE-201978
#rnx

#rb sean.sweeney, sebastian.lewicki

[CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
jerome delattre
996d262734 Fix log output not being human readable
+ Handle setting up the default command line arguments through TargetDeviceDesktopCommon
+ Align log settings across configs

#jira UE-203448
#rnx

#rb brendan.lienau, sebastian.lewicki

[CL 30684372 by jerome delattre in ue5-main branch]
2024-01-18 10:38:15 -05:00
chris constantinescu
4b539c383f Replication tests compilation errors on Linux and other platforms
#rb rob.huyett, Ryan.Gerleve, sebastian.lewicki
#jira UE-203730

[CL 30569736 by chris constantinescu in ue5-main branch]
2024-01-11 11:12:52 -05:00
mark lintott
81b1364824 Fxied utrace default channels for Editor Perf Tests so we enable Insghts Regions in the trace data
[FYI] Francis.Hurteau, ionut.matasaru

[CL 30569284 by mark lintott in ue5-main branch]
2024-01-11 10:56:09 -05:00
brendan lienau
c8e1e58227 [Gauntlet] Update InstallApplication function signature for new ITargetDevice flow by renaming it to InstallBuild
[CL 30485450 by brendan lienau in ue5-main branch]
2024-01-08 13:21:15 -05:00
oleg krasnov
ddfd3bf5e6 Gauntlet - fix screenshots jpeg to gif conversion on Windows
#jira UE-201488
#rb Jerome.Delattre, Sebastian.Lewicki
#rnx

[CL 30388551 by oleg krasnov in ue5-main branch]
2023-12-19 01:17:10 -05:00
brendan lienau
f37b053315 [Gauntlet] Move Configurable device application into DeviceProfileValidator
#jira UE-201401
#rb marcelo.gomes

[CL 30362389 by brendan lienau in ue5-main branch]
2023-12-15 17:14:20 -05:00