Commit Graph

3788 Commits

Author SHA1 Message Date
Jerome Delattre
8a01f176d1 Update ImageMagick tps
#jira none
#rnx
#preflight skip
#rb trivial

[CL 21115855 by Jerome Delattre in ue5-main branch]
2022-07-15 15:34:43 -04:00
graeme thornton
9b6693c0e9 Stage project shaders for cooked cookers
#preflight none
[FYI] josh.adams

#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 21108970 via CL 21110432 via CL 21110489 via CL 21110526
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21112668 by graeme thornton in ue5-main branch]
2022-07-15 12:49:24 -04:00
Ryan Hummer
dcb81492ef Use robocopy/rsync to copy temp storage manifests locally before unzipping them, and use them to copy manifests off to the share at the end of a task.
improves platform reliability, m1 macs struggle to update file attributes when copying to an smb share. rsync ensures the attributes are correctly copied.

#rnx
#jira none
#rb none
#preflight 62d170c93b057e72748b9aa8
#author ryan.durand

[CL 21110668 by Ryan Hummer in ue5-main branch]
2022-07-15 11:15:30 -04:00
josh adams
97e4755b10 - Undid a recent backout of CookedEditor changes, with the bug fixed on the FN side
#rb eric.knapik
#preflight 62cf3aeab0763b1910c3031a

#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 21090585 via CL 21090589 via CL 21090592
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21096372 by josh adams in ue5-main branch]
2022-07-14 15:23:24 -04:00
josh adams
125104fca8 - Moved where we stage Mono files so it only happens when targeting Linux
#rb trivial
#preflight 62cf1c6cb90bf539697c29b7

#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 21090530 via CL 21090539 via CL 21090547
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21096363 by josh adams in ue5-main branch]
2022-07-14 15:23:10 -04:00
gary yuan
073328c2e2 #jira: none
Gauntlet implement timestamp in output log messages relative to program start time

[REVIEW] [at]Eric.Knapik [at]Tim.Kennedy
#rb Eric.Knapik Tim.Kennedy
#preflight: 62cef450f30df2b55bfa8bf2

#ROBOMERGE-AUTHOR: gary.yuan
#ROBOMERGE-SOURCE: CL 21076332 via CL 21083608 via CL 21083941 via CL 21084219
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21086545 by gary yuan in ue5-main branch]
2022-07-13 21:25:10 -04:00
andrew grant
1fa8cac756 Made Gauntlet issue with a locked log a warning vs an error
#preflight skip

#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 21066766 via CL 21083532 via CL 21083910 via CL 21084171
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21086518 by andrew grant in ue5-main branch]
2022-07-13 21:24:36 -04:00
Ben Marsh
6ac2c5b01f UAT: Add a systemic error code for Perforce submit failures.
#preflight none

[CL 21078813 by Ben Marsh in ue5-main branch]
2022-07-13 15:59:41 -04:00
josh adams
f133254485 - Fixed up 3 Linux ContentWorker issues that came from the dotnet 6 upgrade (or other recent UE5 changes):
* Staged the wrong Dotnet directory when making CW from Windows (it would stage Dotnet/6.20.00/windows)
* The ScriptModule code that used the Automation.json files to discover the precompiled UAT script dlls didn't handle \'s on Linux in the paths, and since Windows wrote out the files, there are \'s aplenty. I fixed up the known issue, but possibly all paths loaded from the json files should be fixed up, but it's not easy to do automatically
* We moved to using RunUAT.sh instead of calling dotnet directly, however because we make the CW on Windows, dotnet was not executable, and the code in RunUAT.sh to find the dotnet executable and make it executable (chmod `which dotnet`) only works if dotnet is already executable! So, I moved the +x code into SetupDotnet.sh, on Linux and Mac
#rb eric.knapik
#preflight 62ccd2009922f7e512b6e51a

#ROBOMERGE-OWNER: josh.adams
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 21055451 via CL 21055464 via CL 21055478
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)
#ROBOMERGE-CONFLICT from-shelf

[CL 21076349 by josh adams in ue5-main branch]
2022-07-13 14:17:50 -04:00
Joe Kirchoff
58a757c32b Remove unacceptable strings from CopyBuildToStagingDirectory
#jira UE-158633
#rnx
#rb trivial
#preflight 62cc9752ad490b52dadb049e

[CL 21047967 by Joe Kirchoff in ue5-main branch]
2022-07-11 17:42:19 -04:00
Dan Thompson
7c8f356b9a Removing GetNumCookersToSpawn as it hasn't been used in a long long time.
#jira UE-158607
#preflight 62cc784c173a4f340870d564
#rb matt.peters

[CL 21046824 by Dan Thompson in ue5-main branch]
2022-07-11 16:33:40 -04:00
jerome delattre
2652ce1b3f Avoid enforcing Horde Simple Report to all UnrealTestNode.
#preflight 62c8accfb04c766648a41525
#rb none

#ROBOMERGE-AUTHOR: jerome.delattre
#ROBOMERGE-SOURCE: CL 21017400 via CL 21017405 via CL 21017409
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21023880 by jerome delattre in ue5-main branch]
2022-07-09 14:05:05 -04:00
Jerome Delattre
e4d6189679 Remove unacceptable string from Gauntlet
#jira UE-158633
#preflight 62c86a9d756222ced43c39a5
#rb trivial

[CL 21010585 by Jerome Delattre in ue5-main branch]
2022-07-08 13:54:37 -04:00
David Harvey
6d0a8e54a9 LowLevelTests does not allow the command line to be replaced because it is passed to catch2 which fails on unknown arguments.
#preflight 62c6a729557511b126dfa565
#jira UE-151087
#rb Chris.Constantinescu
#rnx

[CL 21003635 by David Harvey in ue5-main branch]
2022-07-08 03:38:58 -04:00
David Harvey
4f8dd1a9b2 Extending windows PGO skeleton to include windows-based platform extensions.
#jira UE-151087
#rnx
#rb Eric.McDaniel
#preflight 62c6f1998558075f424dfe9c

[CL 20984075 by David Harvey in ue5-main branch]
2022-07-07 10:54:28 -04:00
Jerome Delattre
0a0e8e59dc Gauntlet - Re-generate sessionID when restarting test
#jira none
#preflight 62c607b9b47aed4cf125f5f6
#rb Chris.Constantinescu

[CL 20983003 by Jerome Delattre in ue5-main branch]
2022-07-07 09:19:44 -04:00
Leon Huang
5ddef93c5e Added support for preview versions of the localization manifests to be generated and deleted during a preview localization run. This addresses false positives for loclaization warnings that can arise from comparing gathered strings to a stale manifest file.
- Added a preview parameter to the Localization UAT command which allows the command to run in preview mode.
- Localization commandlets now generate *_Preview.manifest files during a run into the destination path specified by the config files.
- The localization automation script will delete all files that end with _Preview.manifest at the end of the gather run.
- Improved checks for manifest filename extensions to ensure no malformed manifest filenames are passed into the commandlet
#jira: none
#rb: Jamie.Dale
#preflight: 62c487352f2d0469188c7d30

[CL 20970061 by Leon Huang in ue5-main branch]
2022-07-06 14:22:26 -04:00
Bryan Johnson
0ba12c9497 Add retry for notary-app calls
#jira UE-155720, UE-157669
#rnx
#rb Ryan.Hummer
#preflight 62c5c25e097ca6afc4f24202

[CL 20968956 by Bryan Johnson in ue5-main branch]
2022-07-06 13:18:50 -04:00
Martin Sevigny
acac1f2e14 BuildCookRun: Fixed the creation of multiple packages\platforms in a single call. The upluginmanifest file needs to be platform specific. It will prevent some of the packages from running otherwise.
Also added the name of the platform when dumping the Manifest into FinalCopy_XXX.txt

#rb David.harbey
#preflight none

[CL 20965427 by Martin Sevigny in ue5-main branch]
2022-07-06 08:50:39 -04:00
justin marcus
e489d8065b Unzip optimization for archives with lots of small files
- Remove redunant exists check when creating directories.  Directory.CreateDirectory already does that.
- Use streams directly instead of calling ZipFileExtensions.ExtractToFile.


[REVIEW] [at]Mitchell.Fisher [at]Graeme.Thornton
#preflight https://horde.devtools.epicgames.com/job/62bf34b2b024a2608c89b606

#ROBOMERGE-OWNER: justin.marcus
#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 20919800 via CL 20919810 via CL 20919999 via CL 20920500
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20923415 by justin marcus in ue5-main branch]
2022-07-01 19:42:38 -04:00
Ryan Hummer
cc00a96d2e Update MacPlatform.ProcessArchivedProject to use safer file IO operations
Added a SafeRenameDirectory similar to SafeReaname file that uses Directory.Move

#rnx
#jira none
#rb none
#preflight 62bf48388d5e6787591b3f8e

[CL 20922943 by Ryan Hummer in ue5-main branch]
2022-07-01 18:52:43 -04:00
Ben Marsh
38f3bc55ef BuildGraph: Various VM improvements.
* Added support for deserializing BgObject types directly into native classes.
* Removed opcodes for creating graph structures. These are now created in user code from BgObject types.
* Removed BgNodeSpecBuilder. BgNode objects can now be modified directly (returning a modified copy).
* Added concrete types for option parameters. The VM now keeps track of any parameters for evaluated options, allowing them to be added into the graph definition.
* Order dependencies now take nodes rather than outputs.
* Added explicit support for native thunks, whose bindings are saved to a sideband channel during compilation and referenced in bytecode as an index. This generalizes code that was previously specific to node definitions.
* Added a name table to bytecode, to optimize situations where we reference the same string mulitple times.

#preflight 62bf3c583f0d6beee2e8f4a6

[CL 20918762 by Ben Marsh in ue5-main branch]
2022-07-01 14:47:54 -04:00
graeme thornton
7f3dae9023 Stop cooked cooker staging code from including the -Cmd executables PDB from being staged
[FYI] josh.adams

#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 20913320 via CL 20913321 via CL 20913323 via CL 20913328 via CL 20913338
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20914121 by graeme thornton in ue5-main branch]
2022-07-01 10:25:56 -04:00
ryan hummer
f91cb75ed7 Add retrying to potential network share failure points in temp storage.
#rnx
#jira UE-156108, UE-158088
#rb ryan.hummer
#preflight 62bdeccded35ee71a70ee5a5

#ushell-cherrypick of 20574535 by Ryan.Durand

#ROBOMERGE-AUTHOR: ryan.hummer
#ROBOMERGE-SOURCE: CL 20901486 in //UE5/Release-5.0/... via CL 20902831
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v971-20777995)

[CL 20905677 by ryan hummer in ue5-main branch]
2022-06-30 18:10:24 -04:00
chris constantinescu
1b1fb1ce98 Change Tcp Messaging log level to Verbose on Horde
#rb Jerome.Delattre
#preflight 62bccb3fd94b57687c9e037f

[CL 20886061 by chris constantinescu in ue5-main branch]
2022-06-29 19:07:32 -04:00