Commit Graph

937 Commits

Author SHA1 Message Date
ben woodhouse
6118509190 Add -fallbackOrderForNonUassetFiles option for ordering uexp and ubulk files if order is not specified (e.g for the secondary/cooker open order). Previously this was non-optional, but this caused a regression in patch sizes on some platforms
#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5772400 via CL 5795133 via CL 5795152 via CL 5795156 via CL 5799600 via CL 5799704
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5804606 by ben woodhouse in Dev-Networking branch]
2019-04-08 21:21:11 -04:00
ben woodhouse
d6a97e386a UnrealPak patch pak seek optimization v2
- Add support for incremental gap filling. Does gap filling in multiple passes, allows us to limit patch size growth to some fixed percentage
- Fixed cooker order UEXP files (previously these were unordered, which could actually result in patches increasing in size after gap filling)
- Added better method for measuring fragmentation - reports as a percentage, takes order index into account
- Refactored OrderMapping via new FPakOrderMap class which knows about primary/secondary mappings
- Added various schemes for defragmentation, including OnePass method which matches legacy behaviour, and various incremental schemes. Incremental_PrimaryFirst seems to give best results
#rb hongyi.yu

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5688530 via CL 5688536 via CL 5688538 via CL 5690113 via CL 5694330 via CL 5694501
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5702180 by ben woodhouse in Dev-Networking branch]
2019-04-02 21:15:51 -04:00
jeff williams
adb6982b77 Adding support for shared iterative cooks from manifests.
Fall back path to loose staged builds.
Fall back path to existing synced builds.


#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5681890 via CL 5681938 via CL 5681948
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5683742 by jeff williams in Dev-Networking branch]
2019-04-02 05:59:51 -04:00
daniel lamb
2ca51f821b Made the pak file binary compatible with previous version to reduce patch sizes.
Reenabled oodle compression in 8.30 for android, ios and switch.
Cleaned up unrealpak commandline when run from UAT.
#rb Josh.Adams
[FYI] Ben.Marsh, Andrew.Grant

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 5619788 via CL 5619815 via CL 5619821 via CL 5619827 via CL 5623747 via CL 5623814
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5628267 by daniel lamb in Dev-Networking branch]
2019-03-28 01:27:11 -04:00
hongyi yu
13b62dc7ad Move patchSeekOptMaxGapSize to ini file Part 1
[FYI] Ben.Woodhouse

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: hongyi.yu
#ROBOMERGE-SOURCE: CL 5554945 via CL 5556720 via CL 5556826
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5580096 by hongyi yu in Dev-Networking branch]
2019-03-27 01:03:21 -04:00
ben marsh
4942378a8b Fix log output showing CL being synced for iterative cooks.
#jira
[FYI] Jeff.Williams

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5491806 via CL 5492141 via CL 5492157
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5510538 by ben marsh in Dev-Networking branch]
2019-03-22 17:29:35 -04:00
andrew grant
d978938e38 Fixed issue with UBTArgs including quotes.
#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5460234 via CL 5462256 via CL 5462315
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5477345 by andrew grant in Dev-Networking branch]
2019-03-20 13:31:23 -04:00
andrew grant
47dabd0b61 Use case-insensitive comparison for package names
#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: andrew.grant
#ROBOMERGE-SOURCE: CL 5435243 via CL 5438956 via CL 5439032
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5441756 by andrew grant in Dev-Networking branch]
2019-03-18 21:14:03 -04:00
jeff williams
c23e05b7f0 Allow iterate shared cooked builds to re-stage non-UFS files over the base build
#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5400125 via CL 5401608 via CL 5403246
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5417816 by jeff williams in Dev-Networking branch]
2019-03-15 12:56:27 -04:00
jeff williams
046841c32e Allow for selection of shared cooked builds within the most recent code CL
#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: jeff.williams
#ROBOMERGE-SOURCE: CL 5400074 via CL 5401504 via CL 5402283
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5417776 by jeff williams in Dev-Networking branch]
2019-03-15 12:56:07 -04:00
cosmin sulea
8158613257 UE-70358 - Failure to sign when packaging for iOS Distribution when using Remote Compile from a code project on Windows
#jira UE-70358
#rb Ben.Marsh

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: cosmin.sulea
#ROBOMERGE-SOURCE: CL 5382950 in //UE4/Release-4.22/... via CL 5383321
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5415572 by cosmin sulea in Dev-Networking branch]
2019-03-15 12:02:29 -04:00
bob tellez
00b1798655 Unshelved from Hongyi.Yu
Fix numbering for patch paks when skipping a patch tier on new files

[FYI] Hongyi.Yu

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: Hongyi.Yu
#ROBOMERGE-SOURCE: CL 5377129 via CL 5377234 via CL 5378975
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5406696 by bob tellez in Dev-Networking branch]
2019-03-14 19:54:07 -04:00
ben marsh
2657778a26 Add some FileReference/DirectoryReference overloads to CommandUtils.
#rb none
#jira

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5357972 in //UE4/Release-4.22/... via CL 5367811
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5405690 by ben marsh in Dev-Networking branch]
2019-03-14 19:08:45 -04:00
justin marcus
acd21e74bc Merging //Fortnite/Dev-Kairos to Main (//Fortnite/Main)
CL 5287635

Fix memory mapped bulk data files all being put in chunk0 because they have a wierd compound extension.

review-5287636 [at]Daniel.Lamb

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 5296981 via CL 5307598 via CL 5307724
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5324274 by justin marcus in Dev-Networking branch]
2019-03-06 18:11:02 -05:00
graeme thornton
6a3327e900 Minor unrealpak refactor
- Added a "-sign" parameter to enable signing for the given pak. The cached settings in the crypto.json file aren't used to enable signing any more.
 - Encapsulated all signing and encryption keys in a single keychain object which is passed around, rather than individual keys
 - Added some validation to UBT/UAT encryption config parsing so that if you enable any signing or encryption stuff but haven't generated a key, it'll warn and disable everything.

#jira

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 5237725 via CL 5237726 via CL 5240337 via CL 5240343
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5256133 by graeme thornton in Dev-Networking branch]
2019-02-28 18:27:59 -05:00
joe conley
564511face #jira UE-69839 Lumin fails to launch with assert: ICU data directory was not discovered
NonUFSDebugFiles were getting copied to the staging directory first, but did not respect the "DeployLowerCaseFilenames" setting, and were incorrectly determining the captalization of the Engine/Content directory. Copy them after we copy UFSFiles.

#rb Ben.Marsh

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: joe.conley
#ROBOMERGE-SOURCE: CL 5235658 in //UE4/Release-4.22/... via CL 5235659
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5254816 by joe conley in Dev-Networking branch]
2019-02-28 18:13:09 -05:00
anthony bills
94e85713db [AutomationTool] Add support to override the launch command line per platform.
#rb david.harvey
[FYI] andrew.grant

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: anthony.bills
#ROBOMERGE-SOURCE: CL 5206466 via CL 5211320 via CL 5230557
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5250817 by anthony bills in Dev-Networking branch]
2019-02-28 17:41:16 -05:00
josh adams
86071fdfce - Merging Dev-Kairos/Engine/... to Main/Engine/...
- Brings over the necessary engine changes for embedding UE4 mobile as a dylib/so in native mobile app
- Various changes for facial animation, screen recording, others
- ARKit and ARCore plugins were removed, as deemed "not ready"
#rb many people

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 5201138 via CL 5203024 via CL 5226277
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5246044 by josh adams in Dev-Networking branch]
2019-02-28 17:14:17 -05:00
ben marsh
ee55e0d236 Remove RPCUtility.
#rb none
#jira UE-70509
[FYI] Peter.Sauerbrei

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 5174514 in //UE4/Release-4.22/... via CL 5207569
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5235370 by ben marsh in Dev-Networking branch]
2019-02-27 18:57:01 -05:00
cosmin sulea
9d2343c6bb UE-63767 - iOS Device Output Log console does not work
#jira UE-63767
#rb Jack.Porter

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: cosmin.sulea
#ROBOMERGE-SOURCE: CL 5036543 in //UE4/Release-4.22/... via CL 5036544
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5122266 by cosmin sulea in Dev-Networking branch]
2019-02-22 00:59:10 -05:00
josh adams
2296cd5d48 - Final fix now for merge issue (I had compiled wrong program to test my fix, oops)
#jira none
#rb none

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 4975198 in //UE4/Main/...
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5077462 by josh adams in Dev-Networking branch]
2019-02-19 18:12:20 -05:00
josh adams
26db8ffee8 - Proper fix to merge conflicts
#jira nojira
[FYI] bob.tellez
#rb none

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 4974522 in //UE4/Main/...
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5077348 by josh adams in Dev-Networking branch]
2019-02-19 18:11:13 -05:00
bob tellez
36928a7c13 Back out revision 103 from CopyBuildToStagingDirectory.Automation.cs to fix CIS
#jira nojira
[FYI] Josh.Adams
#rb none

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 4974353 in //UE4/Main/...
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5077336 by bob tellez in Dev-Networking branch]
2019-02-19 18:11:07 -05:00
arciel rekman
cc0ff9c477 PhysX: change v13 Linux toolchain to v12 one (for real).
- There are issues when the libraries are compiled with clang 7.0.1 (tracked as UE-69848).

#rb Ben.Marsh
#rnx
[FYI] [at]Bob.Tellez

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: arciel.rekman
#ROBOMERGE-SOURCE: CL 4963477 via CL 4963480 via CL 4964321 via CL 4969377
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5074136 by arciel rekman in Dev-Networking branch]
2019-02-19 17:30:11 -05:00
arciel rekman
0440bc8e10 PhysX: change v13 Linux toolchain to v12 one.
- There are issues when the libraries are compiled with clang 7.0.1 (tracked as UE-69848).

#rb Ben.Marsh
#rnx
[FYI] [at]Bob.Tellez

#ROBOMERGE-OWNER: ryan.gerleve
#ROBOMERGE-AUTHOR: arciel.rekman
#ROBOMERGE-SOURCE: CL 4963367 via CL 4963372 via CL 4964207 via CL 4969343
#ROBOMERGE-BOT: ENGINE (Main -> Dev-Networking)

[CL 5074128 by arciel rekman in Dev-Networking branch]
2019-02-19 17:29:55 -05:00