Commit Graph

952 Commits

Author SHA1 Message Date
jeff williams
4466037b02 Throwing exception on failed shared cook installs. Cleaning up output on failure
#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 6377435 via CL 6383904 via CL 6384006
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6389688 by jeff williams in Dev-Build branch]
2019-05-08 21:17:50 -04:00
daniel lamb
345541e654 Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.


#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210 via CL 6287835
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6302275 by daniel lamb in Dev-Build branch]
2019-05-03 21:13:25 -04:00
Josh Adams
1e4b186150 - Big update to platforms: PlatformExtensions
- This allows for Confidential platforms to exist outside of the engine, and insert themselves in as needed
- Directory structure is, where .... mirrors the directory structure for Engine and projects
     - /Platforms/XXX/....
- Moving to more data driven approach for ShaderPlatforms and PlatformInfo, where they can be read from DataDrivenPlatformInfo.ini files that live in the platform config folders
- Removed platform mentions from UBT, by way of changing some enums to partial classes with static members (see UnrealTargetPlatform)
- Various other UBT/UAT modifications to allow for looking in other locations for files
- THIS IS NOT A COMPLETE AND FINAL SOLUTION. WE WILL CONTINUE WORK IN DEV-BUILD BEFORE ITS READY FOR PRIMETIME
#rb ben.marsh

[CL 6271418 by Josh Adams in Dev-Build branch]
2019-05-03 08:03:23 -04:00
ryan durand
25e7f9d4f0 Updating general ExportMcpTemplates command to support overriding the default commandlet to use.
#rb none

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 6258607 via CL 6258665 via CL 6258669
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6262446 by ryan durand in Dev-Build branch]
2019-05-02 17:09:44 -04:00
ryan durand
af1f4e4804 Adding Fortnite_ExportMcpTemplates to Localisation.Automation in a generic manner for use with other projects.
#rb none

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 6192328 via CL 6192767 via CL 6194102
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6221532 by ryan durand in Dev-Build branch]
2019-05-01 19:04:40 -04:00
david harvey
963a3ec27c update CSV tool path in automation tools.
#jira UE-66046
#rb gil.gribb

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 6172805 via CL 6173263 via CL 6178732
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6209446 by david harvey in Dev-Build branch]
2019-05-01 18:12:52 -04:00
jeff williams
2840338297 Switching SharedCookedBuild to be stateful
Support multiple simultaneous platform targets
Fix to use CookPlatform correctly


#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 6083456 via CL 6088205 via CL 6088231
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6117733 by jeff williams in Dev-Build branch]
2019-04-26 21:14:17 -04:00
Ben Marsh
b8622b1fec Add support for creating client and server targets from installed builds. Use the -set:WithClient=true and -set:WithServer=true arguments to BuildGraph to enable.
#rb none
#jira UE-37315

[CL 6033088 by Ben Marsh in Dev-Build branch]
2019-04-22 09:49:05 -04:00
Ben Marsh
fcb2b8a7cd Move the FinalizeInstalledBuild command into a file by the same name, to make it easier to find.
#rb none
#rnx

[CL 6011948 by Ben Marsh in Dev-Build branch]
2019-04-19 09:32:02 -04:00
ben marsh
9340265194 Merging fixes to ListThirdPartySoftware script.
#jira

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5993027 via CL 5993031 via CL 5994993 via CL 5995112
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 6011095 by ben marsh in Dev-Build branch]
2019-04-19 08:16:25 -04:00
ben marsh
ab30e11554 Fixes to ListThirdPartySoftware script.
* Switched to use JsonExport mode in UBT.
* Added runtime dependencies into the output file.

#rb none
#rnx
#jira

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5959015 in //UE4/Release-4.22/... via CL 5959017
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5964247 by ben marsh in Dev-Build branch]
2019-04-17 21:09:35 -04:00
ben marsh
93c6ee9226 Prevent packaged plugins getting a hot reload suffix if the editor is running.
#rb none
#jira UE-72487

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5915309 in //UE4/Release-4.22/... via CL 5915310
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5925306 by ben marsh in Dev-Build branch]
2019-04-16 17:10:22 -04:00
ben woodhouse
ad3ac145cb Add -fallbackOrderForNonUassetFiles option for ordering uexp and ubulk files if order is not specified (e.g for the secondary/cooker open order). Previously this was non-optional, but this caused a regression in patch sizes on some platforms
#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5772400 via CL 5795133 via CL 5795152 via CL 5795156 via CL 5799600 via CL 5799704
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5802192 by ben woodhouse in Dev-Build branch]
2019-04-08 21:06:01 -04:00
ben woodhouse
417a6a34c9 UnrealPak patch pak seek optimization v2
- Add support for incremental gap filling. Does gap filling in multiple passes, allows us to limit patch size growth to some fixed percentage
- Fixed cooker order UEXP files (previously these were unordered, which could actually result in patches increasing in size after gap filling)
- Added better method for measuring fragmentation - reports as a percentage, takes order index into account
- Refactored OrderMapping via new FPakOrderMap class which knows about primary/secondary mappings
- Added various schemes for defragmentation, including OnePass method which matches legacy behaviour, and various incremental schemes. Incremental_PrimaryFirst seems to give best results
#rb hongyi.yu

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5688530 via CL 5688536 via CL 5688538 via CL 5690113 via CL 5694330 via CL 5694501
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5699568 by ben woodhouse in Dev-Build branch]
2019-04-02 21:04:55 -04:00
jeff williams
9747eb20e7 Adding support for shared iterative cooks from manifests.
Fall back path to loose staged builds.
Fall back path to existing synced builds.


#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5681890 via CL 5681938 via CL 5681948
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5683745 by jeff williams in Dev-Build branch]
2019-04-02 05:59:51 -04:00
daniel lamb
fd8abed8e0 Made the pak file binary compatible with previous version to reduce patch sizes.
Reenabled oodle compression in 8.30 for android, ios and switch.
Cleaned up unrealpak commandline when run from UAT.
#rb Josh.Adams
[FYI] Ben.Marsh, Andrew.Grant

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 5619788 via CL 5619815 via CL 5619821 via CL 5619827 via CL 5623747 via CL 5623814
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5627517 by daniel lamb in Dev-Build branch]
2019-03-28 01:11:43 -04:00
hongyi yu
58f05e6027 Move patchSeekOptMaxGapSize to ini file Part 1
[FYI] Ben.Woodhouse

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: hongyi.yu
#ROBOMERGE-SOURCE: CL 5554945 via CL 5556720 via CL 5556826
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5579957 by hongyi yu in Dev-Build branch]
2019-03-27 01:02:32 -04:00
ben marsh
d51562c109 Fix log output showing CL being synced for iterative cooks.
#jira
[FYI] Jeff.Williams

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5491806 via CL 5492141 via CL 5492157
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5510537 by ben marsh in Dev-Build branch]
2019-03-22 17:29:35 -04:00
andrew grant
69b40b6e50 Fixed issue with UBTArgs including quotes.
#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5460234 via CL 5462256 via CL 5462315
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5477227 by andrew grant in Dev-Build branch]
2019-03-20 13:30:47 -04:00
andrew grant
ec91c3666f Use case-insensitive comparison for package names
#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5435243 via CL 5438956 via CL 5439032
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5457822 by andrew grant in Dev-Build branch]
2019-03-19 14:48:48 -04:00
Ben Marsh
07e535411b Merging //UE4/Dev-Main to Dev-Build (//UE4/Dev-Build)
#rb none
#rnx

[CL 5435186 by Ben Marsh in Dev-Build branch]
2019-03-18 16:38:36 -04:00
justin marcus
5bbcb799d6 Merging //Fortnite/Dev-Kairos to Main (//Fortnite/Main)
CL 5287635

Fix memory mapped bulk data files all being put in chunk0 because they have a wierd compound extension.

review-5287636 [at]Daniel.Lamb

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 5296981 via CL 5307598 via CL 5307724
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5323703 by justin marcus in Dev-Build branch]
2019-03-06 18:08:44 -05:00
graeme thornton
03983935c3 Minor unrealpak refactor
- Added a "-sign" parameter to enable signing for the given pak. The cached settings in the crypto.json file aren't used to enable signing any more.
 - Encapsulated all signing and encryption keys in a single keychain object which is passed around, rather than individual keys
 - Added some validation to UBT/UAT encryption config parsing so that if you enable any signing or encryption stuff but haven't generated a key, it'll warn and disable everything.

#jira

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 5237725 via CL 5237726 via CL 5240337 via CL 5240343
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5252097 by graeme thornton in Dev-Build branch]
2019-02-28 17:50:33 -05:00
joe conley
e4c6183942 #jira UE-69839 Lumin fails to launch with assert: ICU data directory was not discovered
NonUFSDebugFiles were getting copied to the staging directory first, but did not respect the "DeployLowerCaseFilenames" setting, and were incorrectly determining the captalization of the Engine/Content directory. Copy them after we copy UFSFiles.

#rb Ben.Marsh

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: joe.conley
#ROBOMERGE-SOURCE: CL 5235658 in //UE4/Release-4.22/... via CL 5235659
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5250199 by joe conley in Dev-Build branch]
2019-02-28 17:37:24 -05:00
anthony bills
2574d9222e [AutomationTool] Add support to override the launch command line per platform.
#rb david.harvey
[FYI] andrew.grant

#ROBOMERGE-OWNER: ben.marsh
#ROBOMERGE-AUTHOR: anthony.bills
#ROBOMERGE-SOURCE: CL 5206466 via CL 5211320 via CL 5230557
#ROBOMERGE-BOT: BUILD (Main -> Dev-Build)

[CL 5245946 by anthony bills in Dev-Build branch]
2019-02-28 17:13:40 -05:00