Added a high level define (WITH_AUTOMATION_TESTS) that is set when thier WITH_DEV_AUTOMATION_TESTS or WITH_PERF_AUTOMATION_TESTS is set).
This allows support code to be wrapped in a single define and the WITH_DEV / WITH_PERF macros used for simply including/excluding test definitions.
#jira UE-89839
#rb na
#tests compiled UE4Game in dev/test/shipping
#ROBOMERGE-SOURCE: CL 11843115 in //UE4/Release-4.25/... via CL 11843116
#ROBOMERGE-BOT: RELEASE (Release-4.25Plus -> Main) (v656-11643781)
[CL 11843119 by andrew grant in Main branch]
The issue was that the code that captures screenshots on a device and sends them was the editor was setting a 'path' variable that represented what a screenshot *would* be saved at on the local system. (The screenshot was not actually saved, it's returned as raw data in the message).
This meant that the editor would try to save for screenshots to a local path that did not exist (e.g. g:\settings\ on xbox) and fail.
The fixes here are -
1) Add some warnings to the code that tries to save screenshots if that fails
2) Change the names of the screenshot functions in AutomationCommon to clarify what they should be used for.
3) Change the 'path' variable in the message to screenshot name.
4) Calculate the path to use for screenshots on the editor.
#tests ran EngineTest on WIn64, PS4, and XboxOne (which now passes).
#jira UE-69399
#rb swarm
#ROBOMERGE-SOURCE: CL 11733277 in //UE4/Release-4.25/... via CL 11733309
#ROBOMERGE-BOT: RELEASE (Release-4.25Plus -> Main) (v656-11643781)
[CL 11733341 by andrew grant in Main branch]
#rnx
#rb none
#ROBOMERGE-SOURCE: CL 10869240 via CL 10869516 via CL 10869902
#ROBOMERGE-BOT: (v613-10869866)
[CL 10870584 by ryan durand in Main branch]
[at]Ryan.Gerleve, [at]Brian.Bekich
#rb None
#ROBOMERGE-OWNER: jon.nabozny
#ROBOMERGE-AUTHOR: jon.nabozny
#ROBOMERGE-SOURCE: CL 9290108 via CL 9290249
#ROBOMERGE-BOT: (v452-9288972)
[CL 9290520 by jon nabozny in Main branch]
Fixed issue with timeouts not being reported as failures.
#jira UE-78039
#rb na
#ROBOMERGE-SOURCE: CL 7951736 in //UE4/Release-4.23/...
#ROBOMERGE-BOT: RELEASE (Release-4.23 -> Main) (v392-7949540)
[CL 7951741 by andrew grant in Main branch]
#jira UE-68957
#rb na
#ROBOMERGE-SOURCE: CL 7663966 in //UE4/Release-4.23/...
#ROBOMERGE-BOT: RELEASE (Release-4.23 -> Main) (v372-7473910)
[CL 7663974 by andrew grant in Main branch]
#JIRA UE-74226
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: ben.salem
#ROBOMERGE-SOURCE: CL 6344919 via CL 6344926 via CL 6345880 via CL 6346025
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)
[CL 6356798 by ben salem in Dev-Anim branch]
Fix functional test UI screenshot when running with a window dpi scale != 1.
#jira UE-60541
#rb Matt.Kuhlenschmidt
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: dave.belanger
#ROBOMERGE-SOURCE: CL 6327380 in //UE4/Main/...
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)
[CL 6333747 by dave belanger in Dev-Anim branch]
FunctionalTest now implements TreatLogErrorsAsErrors and TreatLogWarningsAsErrors. Default is true and false, but projects and individual tests can override these.
#rb CR'd
[at]josh.engebretson [at]clayton.langford [at]ben.salem
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 6238394 via CL 6242055 via CL 6242098
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)
[CL 6247613 by andrew grant in Dev-Anim branch]
Automation - Adding more options for forcing and waiting for loading and streaming to finish and more utilities for waiting for that to happen entirely for tests.
Lauren.Ridge
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: nick.darnell
#ROBOMERGE-SOURCE: CL 5382989 via CL 5383481 via CL 5383540
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)
[CL 5385045 by nick darnell in Dev-Anim branch]
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: nick.darnell
#ROBOMERGE-SOURCE: CL 4925685 via CL 4925704 via CL 4925990 via CL 4926017 via CL 4927614 via CL 4935842
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)
[CL 5021040 by nick darnell in Dev-Anim branch]
