Commit Graph

15 Commits

Author SHA1 Message Date
David Harvey
b329453021 LowLevelTest fixes:
- add virtual devices to the pool, for parity with RunUnreal.
  - release devices when the session is destroyed.

#jira UE-139998
#rb Chris.Constantinescu
#preflight 62a1a81644115ef87db55997

[CL 20572593 by David Harvey in ue5-main branch]
2022-06-09 04:05:18 -04:00
David Harvey
76d361df75 Low-Level test runner for windows-based platform extensions.
#jira UE-131865, UE-139998, UE-147194
#rnx
#preflight 6272becc365de864c49eefe8
#rb Eric.McDaniel, Chris.Constantinescu

[CL 20057912 by David Harvey in ue5-main branch]
2022-05-05 10:56:38 -04:00
jonathan adamczewski
c12d99d854 .net6.0 is not supported in VS2019. Suppress warnings about that when using that IDE (with this change, when building UnrealBuildTool & AutomationTool)
#jira none
#rnx
#rb joe.kirchoff
#preflight 624f2c163c2aff69c54ff9eb

[CL 19675097 by jonathan adamczewski in ue5-main branch]
2022-04-07 15:06:02 -04:00
jonathan adamczewski
c1bb6901bf Upgrade to .NET 6.0
#jira UE-119846
#preflight 624cbb2ecc0872e96b0d5181

[CL 19652696 by jonathan adamczewski in ue5-main branch]
2022-04-06 14:46:50 -04:00
jonathan adamczewski
5c68d1d9ef Revert //UE5/Main/... changelist 19531725 - return to NET Core 3.1
#preflight 62422fd0470aff98e946bfce
#jira UE-119846

[CL 19534572 by jonathan adamczewski in ue5-main branch]
2022-03-28 18:25:19 -04:00
jonathan adamczewski
18ac15cbb1 Upgrade to .NET 6.0
#jira UE-119846
#preflight 6241fc06470aff98e943c035

[CL 19531725 by jonathan adamczewski in ue5-main branch]
2022-03-28 15:30:56 -04:00
chris constantinescu
ae281656f2 Tests converted from 18848115 made to work multi-platform.
Not all were converted because they were designed for packaged applications whereas low level tests are designed to run as "native" non-packaged applications.
- reporting support for non-desktop platforms, for the moment Catch2 report type "console" is used that is sent to a .out file
- most number of tests possible running multi platform, slower tests excluded on incremental builds
- slow tests are moved to run on the monolithic build
- Catch2 report failure event listener such that Horde detects them as build errors. Must add new Horde matcher for Catch2 failures

#rb Mark.Lintott
#preflight 623c8de389625f0612dabd64

[CL 19498448 by chris constantinescu in ue5-main branch]
2022-03-24 13:28:25 -04:00
chris constantinescu
598b3a8924 Removed global setup, created common core utilities for non-special cases.
Editor, Engine, CoreUObject etc will have their own separate utility headers for tests that rely on respective special modules.

Replace platform names in catch2 code.

LLT all tests run preflight: 621e3c91f1206ae3ea5b0a66

#preflight 621e3c8bf1206ae3ea5b0872
#rb Jerome.Delattre

[CL 19202751 by chris constantinescu in ue5-main branch]
2022-03-01 13:44:27 -05:00
David Harvey
593065d184 Fix for LowLevelTests crash shutdown when running tests locally, and using -set:TestArgs="-device=<address>" instead of using a device pool
#jira none
#rb Chris.Constantinescu
#rnx
#preflight 62178ce9104496cff8c0c554

[CL 19112837 by David Harvey in ue5-main branch]
2022-02-24 09:01:29 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
chris constantinescu
bb62366170 FN Editor test fail due to it reusing local devices when spawning parallel tests instead of managing them per test session.
UnrealDeviceReservation is causing this because it's storing static device data.
Changed to non-static and associated a test session with a UnrealDeviceReservation instance 1:1

#jira UE-133981
#rb Jerome.Delattre, Josh.Engrebetson

#ROBOMERGE-AUTHOR: chris.constantinescu
#ROBOMERGE-SOURCE: CL 18108024 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v889-18060218)
#ROBOMERGE[STARSHIP]: UE5-Release-Engine-Staging Release-5.0

[CL 18108080 by chris constantinescu in ue5-release-engine-test branch]
2021-11-09 12:47:22 -05:00
chris constantinescu
911e95a6d0 Low level tests - platform fixes and presubmit default compilation to prevent breaking
- Addressed remaining NDA platform code that was present in public facing folders
- Compile LowLevelTests target by default on presubmits and incremental builds for Main and 5.0
- Add dummy test on LowLevelTetsts and run it on consoles daily - this test is called "Self" and it's a sanity check run for Catch2
- Fixed Switch indefinite hang - Self test run successfully on this console
- Added IRunningStateOptions to control app run state: startup and check running state options
- AudioUnitTests run successfully on XboxOneGDK and XSX
- XSX Self and AudioUnitTests run successfully but XSX reports VideoEscape errors - JIRA UE-131334

#jira UEENGQA-52681, UE-127449
#rb Jerome.Delattre

#ROBOMERGE-AUTHOR: chris.constantinescu
#ROBOMERGE-SOURCE: CL 17830364 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v881-17767770)
#ROBOMERGE[STARSHIP]: UE5-Release-Engine-Staging Release-5.0

[CL 17830380 by chris constantinescu in ue5-release-engine-test branch]
2021-10-15 12:17:53 -04:00
chris constantinescu
ebf78fb519 Cleanup useless code
#rnx

#ROBOMERGE-AUTHOR: chris.constantinescu
#ROBOMERGE-SOURCE: CL 17691355 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v875-17642767)

[CL 17691366 by chris constantinescu in ue5-release-engine-test branch]
2021-10-01 09:58:15 -04:00
chris constantinescu
a9fb17c4d4 RunLowLevelTests compilation fix
#ROBOMERGE-AUTHOR: chris.constantinescu
#ROBOMERGE-SOURCE: CL 17667697 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v875-17642767)

[CL 17668631 by chris constantinescu in ue5-release-engine-test branch]
2021-09-29 17:47:23 -04:00
chris constantinescu
72b02c5967 Low Level Tests: code tests built on Catch2 with multi-platform support.
Intended for writing unit, integration, functional and all types of tests.

#jira UEENGQA-49764
#rb Jerome.Delattre


#ROBOMERGE-AUTHOR: chris.constantinescu
#ROBOMERGE-SOURCE: CL 17666358 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v875-17642767)

[CL 17666384 by chris constantinescu in ue5-release-engine-test branch]
2021-09-29 15:50:57 -04:00