Commit Graph

1266 Commits

Author SHA1 Message Date
Daniel Lamb
01fb1e902c Added support for diffing generated cooked content against supplied cooked pak file.
[CL 2651863 by Daniel Lamb in Main branch]
2015-08-11 17:11:41 -04:00
Ben Marsh
89432f444b Separate Rocket builds from Git promotions. A separate trigger email will be sent for making Rocket builds from now on.
[CL 2651000 by Ben Marsh in Main branch]
2015-08-11 08:14:46 -04:00
Ben Marsh
7f9774d740 Make it clearer that TargetReceipt.Read can fail if the file doesn't exist or is formatted incorrectly.
[CL 2649965 by Ben Marsh in Main branch]
2015-08-10 16:07:05 -04:00
James Moran
2a1ba3ccad Packaging HTML5 deploys double-click script for HTML5LaunchHelper to avoid using the command line.
Fixes UE-19637

[CL 2647934 by James Moran in Main branch]
2015-08-07 11:00:13 -04:00
Bob Tellez
5507cb9604 [AUTOMERGE]
Excluding the editor for a platform no longer excludes the Tools node, which includes tools used for non-editor targets

--------
Integrated using branch Ue4-To-UE4-Fortnite-Simple (reversed) of change#2647003 by Bob.Tellez on 2015/08/06 16:52:16.

[CL 2647005 by Bob Tellez in Main branch]
2015-08-06 16:52:45 -04:00
Marcus Wassmer
9f9a6ba80a Set up stagedir even in skipstage so the run command can find the proper executable
#codereview james.moran

[CL 2646930 by Marcus Wassmer in Main branch]
2015-08-06 16:19:18 -04:00
Wes Hunt
cefa87e4b7 Ionic.zip code import
* Moving Ionic.Zip source code into UE4 from UE4 source.
* Only one left should be in Binaries/DotNET.
* Moving TPS info to source location.
* Deleting several copies that were floating around.

Assembly Resolve Refactor
* Added AssemblyUtils.InstallAssemblyResolver to handle resolving of known assemblies that may not exist in the same folder as the referencing assembly.
* This is now installed by UAT and UBT, which should handle all needs to load Ionic.Zip and RPCUtility.exe from scripts that install into subfolders of Binaries/DotNET.
* Other assemblies can be added easily as necesary, centralizing the location where this is handled.
* Removed AssemblyResolver from RPCUtilHelper as UBT handles it automatically now.
* Removed Ionic.Zip references from projects that weren't really using it.
#codereview:ben.marsh

[CL 2646891 by Wes Hunt in Main branch]
2015-08-06 15:55:44 -04:00
Wes Hunt
e2783d981e Add additional telemetry to TempStorage. Moved TelemetryStopwatch out of CommandUtils. Added DateTimeStopwatch to make timing things easier.
[CL 2646031 by Wes Hunt in Main branch]
2015-08-05 22:16:45 -04:00
Josh Markiewicz
57eb560a93 #Integration FN->Main from CL#2644336
actual vetted build from QA

[CL 2646006 by Josh Markiewicz in Main branch]
2015-08-05 21:54:43 -04:00
Wes Hunt
6a80229042 Turn off all automation tests by default. This will need to get propagated to all branches, so I will just update the branch hacker in the two remaining branches that weren't already turning it off: LauncherDev and Fortnite.
#codereview:ben.marsh,adric.worley,bob.ferreira

[CL 2645709 by Wes Hunt in Main branch]
2015-08-05 18:31:03 -04:00
Josh Markiewicz
f8d83447e1 #Integration FN->Main from CL#2642868
Engine Source changes

[CL 2645403 by Josh Markiewicz in Main branch]
2015-08-05 15:54:57 -04:00
Wes Hunt
8a216453ea SetUATLocation uses the EntryAssembly instead of the executing assembly.
[CL 2645374 by Wes Hunt in Main branch]
2015-08-05 15:31:36 -04:00
Wes Hunt
585af51d15 TempStorage Refactor
GUBP High Level
* Temp Storage is zipped into a single archive per node now. This results in ~75% reduction in temp storage usage and network traffic, not to mention the per-file overhead.
* Temp Storage is in P:\\Builds\\{Game}\\TmpStore instead of P:\\Builds\\{Game}\\GUBP (to facilitate easier cleaning of this new structure).
* Temp Storage nodes are in subdirectories of {Branch}\\{CL}\\{NodeName} now instead of a flat directory structure that was hard to manually sift through.

GUBP Mid Level
* Removed -Store= and -StoreSuffix= test parameters.
* Added -NoZipTempStorage parameter to turn off temp storage zipping if necessary.
* Created GUBP.JobInfo class that collects info about the job as a whole to be passed around by GUBP. Mostly used by any code that need to interact with TempStorage.
* Created TempStorageNodeInfo that describes the necessary parameters to find the temp storage location for a node.
* Fully XML commented TempStorage.cs, and commented internals all major functions.
* Added a bunch of telemetry data for storing, retrieving, and cleaning shared temp storage.

UAT Mid Level
* Fixed a bug in Ionic.Zip that make ExtractAll() not work on Mono, checked in new DLLs.
* Added UAT parameter -UseLocalBuildStorage that allows you to test build storage stuff completely locally. Writes to Engine\\Saved\\LocalBuilds\\...

GUBP Low Level
* Refactored some GUBP startup code so temp vars would be limited in scope. Makes it easier to track the impact of refactoring these things.
* CullNodesForPreflight is only called for preflight builds.
* Refactored TempStorage.FindTempStorageManifests to use new TmpStore structure and harden the brittle string/path parsing it was doing. See the new TempStorage FindMatchingSharedTempStorageNodeCLs().
* Refactored TempStorage Saving and Loading to use XDocument instead of older XmlDocument. Removed a bunch of redundant checks.
* Use StripBaseDirectory and MakeRerootedFilePath to remove the brittle directory manipulation code. Directories no longer require a '/' at the end.
* Removed a few redundant caching layers in cleaning temp storage that try to ensure we don't clean a folder twice. None of them were necessary.
* Removed unused single-threaded copy code from temp storage.
* Updated Temp Storage unit test, and fully commented the logic behind it.

UAT Low Level
* UAT top level exception handler is now a single log line now to help parsers find the error.
* Removed several uses of FormatException as it doesn't display the entire exception chain, and is not as good as the default exception formatter.
* Removed ExceptionToString as it used FormatException, which was not a good precedent.
* Fixed several cases of exception propagation that was not properly chaining the inner exception.
* Refactored ThreadedCopyFiles to use Parallel.For because it was just as fast (if not faster) and much simpler to maintain.
* Removed the suffix from Robust_FileExists_NoExceptions because it's sole purpose in life WAS to throw exceptions!
* Added a bunch of XML doc comments to CommandUtils.
* Modernized some container manipulation and iteration to use IEnumerable and extension methods more appropriately.
* Added several @todos for other minor cleanup stuff that should happen eventually.
* Fixed some uses of String.Compare to use invariant culture.
#codereview:ben.marsh

[CL 2644846 by Wes Hunt in Main branch]
2015-08-05 10:22:11 -04:00
Ankit Khare
08ec877c77 Always copy web server during packaging itself too for html5. #jira UE-19556
[CL 2643992 by Ankit Khare in Main branch]
2015-08-04 16:19:39 -04:00
Timothy Reynolds
fae6a68b46 Added missing Source folder to zipping filter list.
UE-19560

[CL 2643666 by Timothy Reynolds in Main branch]
2015-08-04 13:36:36 -04:00
Ben Marsh
3fb12c7ee6 Call out segmentation fault errors (and other signals) when the editor commandlet terminates abnormally, as well as printing out the exit code.
[CL 2643513 by Ben Marsh in Main branch]
2015-08-04 11:25:24 -04:00
Wes Hunt
b54e1e418b #jira UE-19582
Re-added ambiguous Automation ctor that was removed in CL2605826. It is now marked with [Obsolete], and will be removed in the future. CL2643334 already fixed the instances that were mistakenly being routed to the varargs version.
#codereview:richard.fawcett, leigh.swift, ben.marsh

[CL 2643482 by Wes Hunt in Main branch]
2015-08-04 11:05:28 -04:00
Richard Fawcett
95a659a830 Fix up calls to construct AutomationException(string Message, Exception Ex), as this overloaded constructor has been removed.
The overloaded constructor was removed in CL 2605826, so all existing calls are being interpreted as AutomationException(string Message, object[] Params), causing runtime failures when Message does not contain a replacement placeholder "{0}", and potential unwanted behavior if it does.

#jira OPP-3951
#codereview Wes.Hunt, Leigh.Swift

[CL 2643334 by Richard Fawcett in Main branch]
2015-08-04 09:33:03 -04:00
Ben Marsh
9daf29ce73 Prevent using the dedicated network share for ShooterGame from now on. Will be removed in the next few days.
[CL 2643301 by Ben Marsh in Main branch]
2015-08-04 08:47:24 -04:00
Ben Marsh
dbde9c8964 Store the full list of input and ordering dependenices for each node, rather than just the ones which are referenced explicitly.
[CL 2641487 by Ben Marsh in Main branch]
2015-08-02 11:30:07 -04:00
Ben Marsh
28771d37c4 Fix a couple of annoying variable names with spelling mistakes ("FullNamesOfPseudosependencies" and "OrdereredToDo")
[CL 2641397 by Ben Marsh in Main branch]
2015-08-01 16:05:47 -04:00
Ben Marsh
d30033495c Remove some GUBPNode dependencies from GUBP.cs.
[CL 2641394 by Ben Marsh in Main branch]
2015-08-01 15:55:12 -04:00
Wes Hunt
0fff2b2d6f Added additional build telemetry when storing to shared temp storage. Outputs the total file count and total size in bytes.
* ie: UAT.StoreToTempStorage.5.1024
* this can be pulled about by downstream telemetry to measure temp storage performance across the system, and how it's being used in general.

Misc
* Fixed CommanUtils.WriteToFile to add a Newline to match old behavior.
* Added a new feature to the telemetry stopwatch to allow setting a dynamically generated string when finishing the timing.
#codereview:ben.marsh

[CL 2640845 by Wes Hunt in Main branch]
2015-07-31 15:51:24 -04:00
Wes Hunt
9f10de8554 Remove unnecessary var
[CL 2640726 by Wes Hunt in Main branch]
2015-07-31 14:49:46 -04:00
Ben Marsh
4750f0a876 Fix game aggregate nodes being added after the translation to new nodes, and causing game triggers to fail.
[CL 2640237 by Ben Marsh in Main branch]
2015-07-31 09:42:45 -04:00