Commit Graph

950 Commits

Author SHA1 Message Date
jeff williams
ad8676f19b Fix for discovering loose file shared cooked builds
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 6545373 via CL 6545673 via CL 6545748
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR) (v350-6578747)

[CL 6579492 by jeff williams in Dev-VR branch]
2019-05-20 14:33:05 -04:00
ben marsh
7afa45e03a Only check for hacks in the engine directory.
#rb none
#jira UE-74650

#ROBOMERGE-VERSION: 348-6547088
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 6533634 in //UE4/Main/...
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6561324 by ben marsh in Dev-VR branch]
2019-05-18 10:25:49 -04:00
jeff williams
dd5b6312fd Throwing exception on failed shared cook installs. Cleaning up output on failure
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 6377435 via CL 6383904 via CL 6384006
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6388993 by jeff williams in Dev-VR branch]
2019-05-08 21:15:11 -04:00
daniel lamb
517bcc9908 Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.


#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210 via CL 6287835
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6304218 by daniel lamb in Dev-VR branch]
2019-05-03 21:20:53 -04:00
ryan durand
c72f32eb0a Updating general ExportMcpTemplates command to support overriding the default commandlet to use.
#rb none

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 6258607 via CL 6258665 via CL 6258669
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6263820 by ryan durand in Dev-VR branch]
2019-05-02 17:16:51 -04:00
ryan durand
94ee0bdd6e Adding Fortnite_ExportMcpTemplates to Localisation.Automation in a generic manner for use with other projects.
#rb none

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 6192328 via CL 6192767 via CL 6194102
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6233545 by ryan durand in Dev-VR branch]
2019-05-01 20:24:05 -04:00
david harvey
215cb87d93 update CSV tool path in automation tools.
#jira UE-66046
#rb gil.gribb

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 6172805 via CL 6173263 via CL 6178732
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6217237 by david harvey in Dev-VR branch]
2019-05-01 18:45:49 -04:00
jeff williams
bf14116372 Switching SharedCookedBuild to be stateful
Support multiple simultaneous platform targets
Fix to use CookPlatform correctly


#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 6083456 via CL 6088205 via CL 6088231
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6119367 by jeff williams in Dev-VR branch]
2019-04-26 21:25:16 -04:00
ben marsh
83b56b2198 Merging fixes to ListThirdPartySoftware script.
#jira

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5993027 via CL 5993031 via CL 5994993 via CL 5995112
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 6004409 by ben marsh in Dev-VR branch]
2019-04-18 21:53:48 -04:00
ben marsh
bbb38cec28 Fixes to ListThirdPartySoftware script.
* Switched to use JsonExport mode in UBT.
* Added runtime dependencies into the output file.

#rb none
#rnx
#jira

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5959015 in //UE4/Release-4.22/... via CL 5959017
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5965188 by ben marsh in Dev-VR branch]
2019-04-17 21:17:28 -04:00
ben marsh
c5e151e718 Prevent packaged plugins getting a hot reload suffix if the editor is running.
#rb none
#jira UE-72487

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5915309 in //UE4/Release-4.22/... via CL 5915310
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5925986 by ben marsh in Dev-VR branch]
2019-04-16 17:14:02 -04:00
ben woodhouse
6141d2d29b Add -fallbackOrderForNonUassetFiles option for ordering uexp and ubulk files if order is not specified (e.g for the secondary/cooker open order). Previously this was non-optional, but this caused a regression in patch sizes on some platforms
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5772400 via CL 5795133 via CL 5795152 via CL 5795156 via CL 5799600 via CL 5799704
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5803267 by ben woodhouse in Dev-VR branch]
2019-04-08 21:10:32 -04:00
ben woodhouse
8cc3ca16fc UnrealPak patch pak seek optimization v2
- Add support for incremental gap filling. Does gap filling in multiple passes, allows us to limit patch size growth to some fixed percentage
- Fixed cooker order UEXP files (previously these were unordered, which could actually result in patches increasing in size after gap filling)
- Added better method for measuring fragmentation - reports as a percentage, takes order index into account
- Refactored OrderMapping via new FPakOrderMap class which knows about primary/secondary mappings
- Added various schemes for defragmentation, including OnePass method which matches legacy behaviour, and various incremental schemes. Incremental_PrimaryFirst seems to give best results
#rb hongyi.yu

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5688530 via CL 5688536 via CL 5688538 via CL 5690113 via CL 5694330 via CL 5694501
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5700575 by ben woodhouse in Dev-VR branch]
2019-04-02 21:08:43 -04:00
jeff williams
b3ae3776a5 Adding support for shared iterative cooks from manifests.
Fall back path to loose staged builds.
Fall back path to existing synced builds.


#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5681890 via CL 5681938 via CL 5681948
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5683782 by jeff williams in Dev-VR branch]
2019-04-02 06:00:35 -04:00
daniel lamb
ca3f5b9ec6 Made the pak file binary compatible with previous version to reduce patch sizes.
Reenabled oodle compression in 8.30 for android, ios and switch.
Cleaned up unrealpak commandline when run from UAT.
#rb Josh.Adams
[FYI] Ben.Marsh, Andrew.Grant

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 5619788 via CL 5619815 via CL 5619821 via CL 5619827 via CL 5623747 via CL 5623814
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5627830 by daniel lamb in Dev-VR branch]
2019-03-28 01:14:59 -04:00
hongyi yu
e5d9d71448 Move patchSeekOptMaxGapSize to ini file Part 1
[FYI] Ben.Woodhouse

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: hongyi.yu
#ROBOMERGE-SOURCE: CL 5554945 via CL 5556720 via CL 5556826
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5580088 by hongyi yu in Dev-VR branch]
2019-03-27 01:03:19 -04:00
ben marsh
8246d5a1df Fix log output showing CL being synced for iterative cooks.
#jira
[FYI] Jeff.Williams

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5491806 via CL 5492141 via CL 5492157
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5514730 by ben marsh in Dev-VR branch]
2019-03-22 17:57:13 -04:00
andrew grant
eae72658e7 Fixed issue with UBTArgs including quotes.
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5460234 via CL 5462256 via CL 5462315
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5480498 by andrew grant in Dev-VR branch]
2019-03-20 13:56:15 -04:00
andrew grant
26fae5a901 Use case-insensitive comparison for package names
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5435243 via CL 5438956 via CL 5439032
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5442222 by andrew grant in Dev-VR branch]
2019-03-18 21:25:09 -04:00
jeff williams
f13f406cd5 Allow iterate shared cooked builds to re-stage non-UFS files over the base build
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5400125 via CL 5401608 via CL 5403246
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5412264 by jeff williams in Dev-VR branch]
2019-03-15 06:21:50 -04:00
jeff williams
42b4ea562c Allow for selection of shared cooked builds within the most recent code CL
#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5400074 via CL 5401504 via CL 5402283
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5412255 by jeff williams in Dev-VR branch]
2019-03-15 06:21:26 -04:00
Ryan Vance
35eb0041ab Merging //UE4/Dev-Main to Dev-VR (//UE4/Dev-VR)
#rb integration

[CL 5387703 by Ryan Vance in Dev-VR branch]
2019-03-13 15:19:08 -04:00
justin marcus
711dd86f40 Merging //Fortnite/Dev-Kairos to Main (//Fortnite/Main)
CL 5287635

Fix memory mapped bulk data files all being put in chunk0 because they have a wierd compound extension.

review-5287636 [at]Daniel.Lamb

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 5296981 via CL 5307598 via CL 5307724
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5326474 by justin marcus in Dev-VR branch]
2019-03-06 18:20:06 -05:00
graeme thornton
1a551d6144 Minor unrealpak refactor
- Added a "-sign" parameter to enable signing for the given pak. The cached settings in the crypto.json file aren't used to enable signing any more.
 - Encapsulated all signing and encryption keys in a single keychain object which is passed around, rather than individual keys
 - Added some validation to UBT/UAT encryption config parsing so that if you enable any signing or encryption stuff but haven't generated a key, it'll warn and disable everything.

#jira

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 5237725 via CL 5237726 via CL 5240337 via CL 5240343
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5257171 by graeme thornton in Dev-VR branch]
2019-02-28 18:38:20 -05:00
joe conley
2ec2d4738f #jira UE-69839 Lumin fails to launch with assert: ICU data directory was not discovered
NonUFSDebugFiles were getting copied to the staging directory first, but did not respect the "DeployLowerCaseFilenames" setting, and were incorrectly determining the captalization of the Engine/Content directory. Copy them after we copy UFSFiles.

#rb Ben.Marsh

#ROBOMERGE-OWNER: ryan.vance
#ROBOMERGE-AUTHOR: joe.conley
#ROBOMERGE-SOURCE: CL 5235658 in //UE4/Release-4.22/... via CL 5235659
#ROBOMERGE-BOT: DEVVR (Main -> Dev-VR)

[CL 5254738 by joe conley in Dev-VR branch]
2019-02-28 18:12:05 -05:00