Commit Graph

4578 Commits

Author SHA1 Message Date
ben marsh
7dac926f00 Horde: Query the server API version before uploading tool data, and fall back to using older storage formats if the server requires it.
[CL 30762520 by ben marsh in ue5-main branch]
2024-01-21 13:52:05 -05:00
ben marsh
68fb925251 Horde: Add a singleton IHordeClient object which allows constructing new HordeHttpClient instances. Allows keeping all the configuration/state in one place.
[CL 30761845 by ben marsh in ue5-main branch]
2024-01-21 10:33:11 -05:00
jerome delattre
7d7290ab2b Revert change in conditional copy of log file in Gauntlet UnrealSession
#rnx

[CL 30716967 by jerome delattre in ue5-main branch]
2024-01-19 11:21:00 -05:00
jerome delattre
24ae93d9f3 Remove References to internal Horde server deployment and network path
#jira UE-201978
#rnx

#rb sean.sweeney, sebastian.lewicki

[CL 30715888 by jerome delattre in ue5-main branch]
2024-01-19 10:19:49 -05:00
leon huang
e081b22abe Localization:
Allow multiple localization batches to run with a single invocation of the Editor.
- Previously, when plugins are added each plugin will be gathered by a new Editor process. This change collapses all the batches to be gathered by a single Editor.
- This consolidation is done by writing all of the config files needed for the gather into a .txt file and passed to the GatherText commandlet
- GatherTextCommandlet now supports the -ConfigList parameter which will load a .txt file with 1 config file per line to be executed.
- Introduced the ConsolidateConfigFiles parameter to the Localize UAT command. This consolidates all of the config files across the various localization batches into a single .txt file. This file is then passed to the GatherText commandlet to be run.

#rb: Jamie.Dale
#jira: FORT-697905
#test: Ran this locally to verify that localizing 2 plugins in batches and in consolidated form yield the same result. Non-unity of preflight also passed

[CL 30703287 by leon huang in ue5-main branch]
2024-01-18 19:28:00 -05:00
mattias jansson
eba1214cf5 Avoid waiting for std streams timeout in consecutive calls if WaitForExit is called multiple times on the process result object
#rb Yuriy.ODonnell

[CL 30695273 by mattias jansson in ue5-main branch]
2024-01-18 15:46:51 -05:00
jerome delattre
996d262734 Fix log output not being human readable
+ Handle setting up the default command line arguments through TargetDeviceDesktopCommon
+ Align log settings across configs

#jira UE-203448
#rnx

#rb brendan.lienau, sebastian.lewicki

[CL 30684372 by jerome delattre in ue5-main branch]
2024-01-18 10:38:15 -05:00
edwin maynard
095a90ad86 [Backout] - CL30679846
[FYI] Leon.Huang
Original CL Desc
-----------------------------------------------------------------
Localization:
Allow multiple localization batches to run with a single invocation of the Editor.
- Previously, when plugins are added each plugin will be gathered by a new Editor process. This change collapses all the batches to be gathered by a single Editor.
- This consolidation is done by writing all of the config files needed for the gather into a .txt file and passed to the GatherText commandlet
- GatherTextCommandlet now supports the -ConfigList parameter which will load a .txt file with 1 config file per line to be executed.
- Introduced the ConsolidateConfigFiles parameter to the Localize UAT command. This consolidates all of the config files across the various localization batches into a single .txt file. This file is then passed to the GatherText commandlet to be run.

#rb: Jamie.Dale
#jira: FORT-697905
#test: Ran this locally to verify that localizing 2 plugins in batches and in consolidated form yield the same result

[CL 30681015 by edwin maynard in ue5-main branch]
2024-01-18 07:07:19 -05:00
leon huang
cc4f2e613f Localization:
Allow multiple localization batches to run with a single invocation of the Editor.
- Previously, when plugins are added each plugin will be gathered by a new Editor process. This change collapses all the batches to be gathered by a single Editor.
- This consolidation is done by writing all of the config files needed for the gather into a .txt file and passed to the GatherText commandlet
- GatherTextCommandlet now supports the -ConfigList parameter which will load a .txt file with 1 config file per line to be executed.
- Introduced the ConsolidateConfigFiles parameter to the Localize UAT command. This consolidates all of the config files across the various localization batches into a single .txt file. This file is then passed to the GatherText commandlet to be run.

#rb: Jamie.Dale
#jira: FORT-697905
#test: Ran this locally to verify that localizing 2 plugins in batches and in consolidated form yield the same result

[CL 30680047 by leon huang in ue5-main branch]
2024-01-18 05:02:14 -05:00
will brown
cd95976e6b UAT - Extending ICustomStageCopyHandler to support overriding of the plugin manifest file creation. Allows game projects to have control over how plugin descriptors are added to the manifest
#rb Josh.Adams, robert.millar

[CL 30668433 by will brown in ue5-main branch]
2024-01-17 16:09:07 -05:00
ben marsh
f0e4c496ae Horde: Merge IStorageWriter and IBlobWriter.
[CL 30667967 by ben marsh in ue5-main branch]
2024-01-17 15:55:37 -05:00
josh adams
980ffe3ce7 - Allow for code to set ProjectParams.UnrealExe (not used in Main, but this restores functionality that was removed)
#rb josh.adams

[CL 30661384 by josh adams in ue5-main branch]
2024-01-17 12:15:06 -05:00
josh adams
8de5dde4df - Added support for UAT to cook with a specific project's editor .exe for projects that use a Unique BuildEnvironment (this will cook with the game's editor, so it will use the game's uniquely compiled engine modules (useful for per-project SDKs that have different targetplatform dlls)
- The target receipt already listed the proper exe to run, taking unique/shared into account, so this change delayed-looks-up the path from the receipt on first use (like when running the editor to cook)
#rb david.harvey

[CL 30658383 by josh adams in ue5-main branch]
2024-01-17 10:07:42 -05:00
ben marsh
a4265b060a Horde: Refactor of IStorageClient/IStorageBackend.
* IStorageBackend now includes methods for manipulating aliases and refs. All interaction with blobs is done through BlobLocators. This is the level of abstraction that the HTTP backend / controllers operate at.
* IStorageClient only manipulates blobs via handles, which abstracts any packing/compression/buffering that BundleStorageClient does.
* IBlobHandles no longer needs to include methods for partial reads, nesting, etc... Nesting of blobs within packets/bundles is now an implementation detail within the bundle storage client.

[CL 30648868 by ben marsh in ue5-main branch]
2024-01-16 18:08:13 -05:00
mattias jansson
08e098801d Add command line option to control stdout/stderr read timeout in child processes of AutomationTool. Needed for workaround in Wine where stderr is not always properly closed, causing a minute delay on some operations. Patching Wine is cumbersome at this point, and this command line option introduces a workaround while maintaining current behaviour by default.
Tested by running AutomationTool under Wine using Linux and noticing a one minute delay as process exit is waiting for stderr to close. Then re-running the test with -WaitForStdStreams=100 and verifying the exit happens within 100ms and no output is lost.

#rb Ben.Marsh

[CL 30648254 by mattias jansson in ue5-main branch]
2024-01-16 17:48:35 -05:00
ben marsh
9ccdc40f9c Horde: Allow customizing blob serializers to use in different contexts, allowing us to lock serialization formats when talking to remote agents of a particular version.
To support this, the Node base class and serialization methods have been removed, and serialization is performed through a BlobConverter<T> instance created and cached according to a BlobSerializationOptions object. Custom instances of serializers with different configurations may be registered with this object, allowing different code paths to use different serialization settings.

#jira UE-203605

[CL 30591420 by ben marsh in ue5-main branch]
2024-01-12 08:59:27 -05:00
chris constantinescu
4b539c383f Replication tests compilation errors on Linux and other platforms
#rb rob.huyett, Ryan.Gerleve, sebastian.lewicki
#jira UE-203730

[CL 30569736 by chris constantinescu in ue5-main branch]
2024-01-11 11:12:52 -05:00
mark lintott
81b1364824 Fxied utrace default channels for Editor Perf Tests so we enable Insghts Regions in the trace data
[FYI] Francis.Hurteau, ionut.matasaru

[CL 30569284 by mark lintott in ue5-main branch]
2024-01-11 10:56:09 -05:00
ben marsh
29a209ea4d Add an option to output a CSV containing all packages and license files from the NuGet-LicenseCheck task.
[CL 30567778 by ben marsh in ue5-main branch]
2024-01-11 09:50:17 -05:00
ben marsh
041a1c1196 Horde: Fix license check job step for Horde server after NET 8 upgrade.
[CL 30561146 by ben marsh in ue5-main branch]
2024-01-10 21:42:16 -05:00
brendan lienau
c8e1e58227 [Gauntlet] Update InstallApplication function signature for new ITargetDevice flow by renaming it to InstallBuild
[CL 30485450 by brendan lienau in ue5-main branch]
2024-01-08 13:21:15 -05:00
justin marcus
b43cbb53f2 GenerateStreamingInstallManifest - Add AllowPerChunkCompressionWildcard to allow pak files to opt into or out of being compressed through CompressedChunkWildcard.
CopyBuildToStagingDirectory - Use bAllowPerChunkCompression to enable bCompressed to override global compression settings.

This will correctly allow chunks to opt in and out of being compressed.
NOTE: If DDPI specifies a hardware compression setting of 'None', this won't work as expected because there will be no global compression settings to opt in to. In this case,
set bForceUseProjectCompressionFormatIgnoreHardwareOverride=true and bCompressed=False in [/Script/UnrealEd.ProjectPackagingSettings], then setup whatever project compression settings you would like chunks to
be able to opt in to.

#rb Daniel.Lamb

[CL 30412862 by justin marcus in ue5-main branch]
2023-12-20 11:01:36 -05:00
paul chipchase
3a42001e9c Fix the use of 'AdditionalPakOptions' when '-Upload=LocalZen' is set during staging
#rb Per.Larsson
#rnx

- We need to add a whitespace before appending 'AdditionalPakOptions' aotherwise they will be merged with the previous '-WriteTocToDisk' argument.
- We should only do this if we actually have additional pak options to avoid adding a pointless additional ' ' if there are no additional options.

[CL 30410640 by paul chipchase in ue5-main branch]
2023-12-20 07:59:58 -05:00
oleg krasnov
ddfd3bf5e6 Gauntlet - fix screenshots jpeg to gif conversion on Windows
#jira UE-201488
#rb Jerome.Delattre, Sebastian.Lewicki
#rnx

[CL 30388551 by oleg krasnov in ue5-main branch]
2023-12-19 01:17:10 -05:00
marc audy
1650901674 Fix single character overconsuming
[CL 30385309 by marc audy in ue5-main branch]
2023-12-18 18:39:14 -05:00