Commit Graph

655 Commits

Author SHA1 Message Date
Jeff Campeau
37c192be08 Don't try to expant empty architectures, only missing one.
Several platforms have empty architectures and we shouldn't call build code when staging if we can avoid it.

[CL 2672679 by Jeff Campeau in Main branch]
2015-08-28 14:37:12 -04:00
Matthew Griffin
ccd90b10b4 Listing runtime dependencies in module rules instead of InstalledEngineFilters.ini
Added code when filtering rocket files to search through build products for target files and add their runtime dependencies to the filter rules.

#jira UEB-372

[CL 2672116 by Matthew Griffin in Main branch]
2015-08-28 06:22:07 -04:00
Peter Knepley
0d3a5d6e41 Dedicated servers should stage needed engine content for crash reporter
Merging 2671465

//depot/UE4-UT/...

to //depot/UE4/...

#codereview James.Golding

[CL 2671550 by Peter Knepley in Main branch]
2015-08-27 17:11:21 -04:00
Peter Sauerbrei
5e0ec6c322 UE-20341 - fixed issues with needing to cook server when cooking client
[CL 2669593 by Peter Sauerbrei in Main branch]
2015-08-26 14:17:28 -04:00
Ben Marsh
7aee54313a Merging UAT stream support from //UE4/Main.
[CL 2669186 by Ben Marsh in Main branch]
2015-08-26 10:00:34 -04:00
Ben Marsh
a30bc8ed00 Switch path parsing to use the system path separator, rather than hard-coding ';'.
[CL 2667385 by Ben Marsh in Main branch]
2015-08-25 09:12:56 -04:00
Peter Sauerbrei
f0b94ddbec properly utilize the same editor as running in for cooking
UE-20061

[CL 2666816 by Peter Sauerbrei in Main branch]
2015-08-24 17:43:34 -04:00
Josh Adams
7146feb687 - Added "-UploadSymbols" which can be done while packaging (well, you don't actually need to package, but it's usually done alongisde packaging)
#codereview marcus.wassmer

[CL 2665010 by Josh Adams in Main branch]
2015-08-21 17:27:15 -04:00
Peter Sauerbrei
34146c450d refactored Log to LogLog and LogConsole to Log
#uat

[CL 2662556 by Peter Sauerbrei in Main branch]
2015-08-20 09:37:11 -04:00
Ben Marsh
47c58ec57c Rename the ErrorCodes enum to ExitCode, and ErrorCodes.Error_Success to ExitCode.Success.
[CL 2662478 by Ben Marsh in Main branch]
2015-08-20 08:38:09 -04:00
Ben Marsh
582b132551 Add a BuildLocalization node, which runs the UAT Localise script.
#codereview Matt.Kuhlenschmidt, Justin.Sargent

[CL 2661758 by Ben Marsh in Main branch]
2015-08-19 17:27:34 -04:00
Ben Marsh
08a11f1fc9 Move RequireFilesToExist out of target receipts; it's just internal state for UAT, and doesn't belong there.
[CL 2661231 by Ben Marsh in Main branch]
2015-08-19 13:35:56 -04:00
Matthew Griffin
a393ec848d Added potential location for third party binaries to the build plugin command
[CL 2661043 by Matthew Griffin in Main branch]
2015-08-19 11:27:49 -04:00
Daniel Lamb
6bde4efe64 Changed the directory which failed diffed content is saved to.
[CL 2659998 by Daniel Lamb in Main branch]
2015-08-18 16:58:49 -04:00
Daniel Lamb
0b97633583 Enabled diffing cooked builds for orion to help find deterministic cook issues.
[CL 2659995 by Daniel Lamb in Main branch]
2015-08-18 16:56:56 -04:00
Daniel Lamb
48d55868bc Fixed chunking issue where secondary chunks wouldn't be generated because file paths didn't, because they were compaired with / without extensions.
#codereview James.Moran

[CL 2655108 by Daniel Lamb in Main branch]
2015-08-13 15:47:02 -04:00
Ben Marsh
e3c8fb17fa Remove precompiled binaries for BootstrapPackagedGame, and build it automatically whenever it's needed to package. Also fix CrashReportClient being built in Development rather than Shipping, and remove binaries for that.
[CL 2654738 by Ben Marsh in Main branch]
2015-08-13 11:31:24 -04:00
Ben Marsh
3bb5d71d68 Remove promotion build nodes, aggregate nodes, and triggers.
[CL 2653116 by Ben Marsh in Main branch]
2015-08-12 13:58:01 -04:00
Ben Marsh
599a3fcae0 Include the Templates/TemplateResources folder when filtering the engine to use for generating DDC.
[CL 2652697 by Ben Marsh in Main branch]
2015-08-12 10:05:08 -04:00
Daniel Lamb
01fb1e902c Added support for diffing generated cooked content against supplied cooked pak file.
[CL 2651863 by Daniel Lamb in Main branch]
2015-08-11 17:11:41 -04:00
Ben Marsh
89432f444b Separate Rocket builds from Git promotions. A separate trigger email will be sent for making Rocket builds from now on.
[CL 2651000 by Ben Marsh in Main branch]
2015-08-11 08:14:46 -04:00
Ben Marsh
7f9774d740 Make it clearer that TargetReceipt.Read can fail if the file doesn't exist or is formatted incorrectly.
[CL 2649965 by Ben Marsh in Main branch]
2015-08-10 16:07:05 -04:00
Marcus Wassmer
9f9a6ba80a Set up stagedir even in skipstage so the run command can find the proper executable
#codereview james.moran

[CL 2646930 by Marcus Wassmer in Main branch]
2015-08-06 16:19:18 -04:00
Wes Hunt
585af51d15 TempStorage Refactor
GUBP High Level
* Temp Storage is zipped into a single archive per node now. This results in ~75% reduction in temp storage usage and network traffic, not to mention the per-file overhead.
* Temp Storage is in P:\\Builds\\{Game}\\TmpStore instead of P:\\Builds\\{Game}\\GUBP (to facilitate easier cleaning of this new structure).
* Temp Storage nodes are in subdirectories of {Branch}\\{CL}\\{NodeName} now instead of a flat directory structure that was hard to manually sift through.

GUBP Mid Level
* Removed -Store= and -StoreSuffix= test parameters.
* Added -NoZipTempStorage parameter to turn off temp storage zipping if necessary.
* Created GUBP.JobInfo class that collects info about the job as a whole to be passed around by GUBP. Mostly used by any code that need to interact with TempStorage.
* Created TempStorageNodeInfo that describes the necessary parameters to find the temp storage location for a node.
* Fully XML commented TempStorage.cs, and commented internals all major functions.
* Added a bunch of telemetry data for storing, retrieving, and cleaning shared temp storage.

UAT Mid Level
* Fixed a bug in Ionic.Zip that make ExtractAll() not work on Mono, checked in new DLLs.
* Added UAT parameter -UseLocalBuildStorage that allows you to test build storage stuff completely locally. Writes to Engine\\Saved\\LocalBuilds\\...

GUBP Low Level
* Refactored some GUBP startup code so temp vars would be limited in scope. Makes it easier to track the impact of refactoring these things.
* CullNodesForPreflight is only called for preflight builds.
* Refactored TempStorage.FindTempStorageManifests to use new TmpStore structure and harden the brittle string/path parsing it was doing. See the new TempStorage FindMatchingSharedTempStorageNodeCLs().
* Refactored TempStorage Saving and Loading to use XDocument instead of older XmlDocument. Removed a bunch of redundant checks.
* Use StripBaseDirectory and MakeRerootedFilePath to remove the brittle directory manipulation code. Directories no longer require a '/' at the end.
* Removed a few redundant caching layers in cleaning temp storage that try to ensure we don't clean a folder twice. None of them were necessary.
* Removed unused single-threaded copy code from temp storage.
* Updated Temp Storage unit test, and fully commented the logic behind it.

UAT Low Level
* UAT top level exception handler is now a single log line now to help parsers find the error.
* Removed several uses of FormatException as it doesn't display the entire exception chain, and is not as good as the default exception formatter.
* Removed ExceptionToString as it used FormatException, which was not a good precedent.
* Fixed several cases of exception propagation that was not properly chaining the inner exception.
* Refactored ThreadedCopyFiles to use Parallel.For because it was just as fast (if not faster) and much simpler to maintain.
* Removed the suffix from Robust_FileExists_NoExceptions because it's sole purpose in life WAS to throw exceptions!
* Added a bunch of XML doc comments to CommandUtils.
* Modernized some container manipulation and iteration to use IEnumerable and extension methods more appropriately.
* Added several @todos for other minor cleanup stuff that should happen eventually.
* Fixed some uses of String.Compare to use invariant culture.
#codereview:ben.marsh

[CL 2644846 by Wes Hunt in Main branch]
2015-08-05 10:22:11 -04:00
Timothy Reynolds
fae6a68b46 Added missing Source folder to zipping filter list.
UE-19560

[CL 2643666 by Timothy Reynolds in Main branch]
2015-08-04 13:36:36 -04:00