Commit Graph

65 Commits

Author SHA1 Message Date
daniel lamb
f7405b2aa3 Added validation to patch generation to detect when unsupported files are changed.
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 7937403 via CL 7937406 via CL 7937407 via CL 7940721 via CL 7940816
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v393-7951996)

[CL 7969712 by daniel lamb in Dev-Core branch]
2019-08-13 01:28:37 -04:00
daniel lamb
e59eda4aec Added validation to patch generation to detect when unsupported files are changed.
#ROBOMERGE-SOURCE: CL 7937403 via CL 7937406 via CL 7937407 via CL 7940721
#ROBOMERGE-BOT: (v391-7919777)

[CL 7940816 by daniel lamb in Main branch]
2019-08-09 20:38:31 -04:00
graeme thornton
ccb1ecf5fc UnrealPak: Only print out "adding entries" message when we're actually creating a pak file
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 7648160 via CL 7648161 via CL 7648295 via CL 7648369
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v385-7708028)

[CL 7741570 by graeme thornton in Dev-Core branch]
2019-08-05 09:43:50 -04:00
Steve Robb
c0074f3627 TAutoPtr and TScopedPointer smart pointers removed.
#rb none

[CL 7674630 by Steve Robb in Dev-Core branch]
2019-07-31 15:34:19 -04:00
graeme thornton
9a3d7dcf99 UnrealPak: Only print out "adding entries" message when we're actually creating a pak file
#ROBOMERGE-SOURCE: CL 7648160 via CL 7648161 via CL 7648295
#ROBOMERGE-BOT: (v372-7473910)

[CL 7648369 by graeme thornton in Main branch]
2019-07-29 05:10:56 -04:00
bob tellez
345027453c Merging CL#7257773
Back out changelist 7256178. This was a bad merge


#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7258012 via CL 7266926 via CL 7266952
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v371-7306989)

[CL 7339383 by bob tellez in Dev-Core branch]
2019-07-16 23:57:39 -04:00
bob tellez
bc9a0b5ffe Merging //Fortnite/Release-10.0 to Dev-Main (//Fortnite/Dev-Main)
Merging CL#7251132 from //Fortnite/Release-Competitive.9.40

Merging in all missing changes from Release-9.40 to Release-Competitive.9.40 to try to make RoboMerge happy.

#rnx
#rb none

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7256432 via CL 7266483 via CL 7266503
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v371-7306989)

[CL 7338442 by bob tellez in Dev-Core branch]
2019-07-16 23:50:36 -04:00
bob tellez
452aeba28e Merging CL#7257773
Back out changelist 7256178. This was a bad merge



#ROBOMERGE-OWNER: bob.tellez
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7258012 via CL 7266926
#ROBOMERGE-BOT: (v369-7254125)

[CL 7266952 by bob tellez in Main branch]
2019-07-10 17:05:15 -04:00
bob tellez
97e9932675 Merging //Fortnite/Release-10.0 to Dev-Main (//Fortnite/Dev-Main)
Merging CL#7251132 from //Fortnite/Release-Competitive.9.40

Merging in all missing changes from Release-9.40 to Release-Competitive.9.40 to try to make RoboMerge happy.

#rnx
#rb none


#ROBOMERGE-OWNER: bob.tellez
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7256432 via CL 7266483
#ROBOMERGE-BOT: (v369-7254125)

[CL 7266503 by bob tellez in Main branch]
2019-07-10 16:41:03 -04:00
graeme thornton
cfce5e8c22 UnrealPak - Added "TestMemoryOptimization" mode which attempts to unload filenames and shrink pak entries across every pak in a directory, making sure there are no collisons and that everything works correctly
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 7227149 via CL 7227151 via CL 7227434 via CL 7227472
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v367-6836689)

[CL 7236686 by graeme thornton in Dev-Core branch]
2019-07-09 00:17:28 -04:00
graeme thornton
51cfbaef7d UnrealPak - Added "TestMemoryOptimization" mode which attempts to unload filenames and shrink pak entries across every pak in a directory, making sure there are no collisons and that everything works correctly
#ROBOMERGE-SOURCE: CL 7227149 via CL 7227151 via CL 7227434
#ROBOMERGE-BOT: (v367-6836689)

[CL 7227472 by graeme thornton in Main branch]
2019-07-08 10:23:53 -04:00
david harvey
6e89d17d50 Adding internal -CalcCompressionBlockCRCs command line option to UnrealPak to try and track down the rare FPakAsyncReadFileHandle::DoProcessing issue + a bit more logging when it fails.
#rb gil.gribb

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 6953229 via CL 6953341 via CL 6953356
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v367-6836689)

[CL 6997030 by david harvey in Dev-Core branch]
2019-06-14 14:22:30 -04:00
david harvey
58c25dd385 Adding internal -CalcCompressionBlockCRCs command line option to UnrealPak to try and track down the rare FPakAsyncReadFileHandle::DoProcessing issue + a bit more logging when it fails.
#rb gil.gribb


#ROBOMERGE-SOURCE: CL 6953229 via CL 6953341
#ROBOMERGE-BOT: (v366-6836689)

[CL 6953356 by david harvey in Main branch]
2019-06-12 07:11:50 -04:00
Stefan Boberg
8607ecb30d Copying //UE4/Dev-Core to Dev-Main (//UE4/Dev-Main)
#rb none

[CL 6815521 by Stefan Boberg in Main branch]
2019-06-03 15:32:00 -04:00
Stefan Boberg
87e98b9573 Merging //UE4/Main @ 6763475 to //UE4/Dev-Core (sbo182_DevCore)
(peafour-mergedown)

#rb none

[CL 6782584 by Stefan Boberg in Dev-Core branch]
2019-06-03 04:06:29 -04:00
graeme thornton
54c0741d48 Hardening of pak index loading
- If a corrupt index is detected, do a retry but collect and log more information along the way to help diagnose the issue.

#rb stefan.boberg


#ROBOMERGE-SOURCE: CL 6685180 via CL 6685186 via CL 6751170
#ROBOMERGE-BOT: (v365-6733468)

[CL 6751664 by graeme thornton in Main branch]
2019-05-31 18:22:01 -04:00
Graeme Thornton
6359d2b6c7 PlatformCrypto based RSA support for the engine
- RSA lib now redirects through a modular feature interface to find a crypto provider

#jira UE-68086
#rb ben.marsh

[CL 6655503 by Graeme Thornton in Dev-Core branch]
2019-05-28 14:50:25 -04:00
daniel lamb
bfae378499 Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.


#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210 via CL 6287835
#ROBOMERGE-BOT: CORE (Main -> Dev-Core)

[CL 6302329 by daniel lamb in Dev-Core branch]
2019-05-03 21:13:34 -04:00
daniel lamb
04d57e57cf Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.



#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210

[CL 6287835 by daniel lamb in Main branch]
2019-05-03 17:47:05 -04:00
ben woodhouse
f442eb9f19 Disable GUARANTEE_UASSET_AND_UEXP_IN_SAME_PAK for patch pak generation, since it's not necessary with delete records. Lifing this restriction makes pak seek optimization a lot more efficient.
Profiling in suggests it improves streaming performance, and the paks are smaller
#rb none
[FYI] hongyi.yu

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5810432 via CL 5810437 via CL 5810648 via CL 5813653 via CL 5813762
#ROBOMERGE-BOT: CORE (Main -> Dev-Core)

[CL 5843937 by ben woodhouse in Dev-Core branch]
2019-04-12 13:04:38 -04:00
ben woodhouse
e741450957 Add -fallbackOrderForNonUassetFiles option for ordering uexp and ubulk files if order is not specified (e.g for the secondary/cooker open order). Previously this was non-optional, but this caused a regression in patch sizes on some platforms
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5772400 via CL 5795133 via CL 5795152 via CL 5795156 via CL 5799600 via CL 5799704
#ROBOMERGE-BOT: CORE (Main -> Dev-Core)

[CL 5818691 by ben woodhouse in Dev-Core branch]
2019-04-10 03:07:09 -04:00
ben woodhouse
76d99dbc1f Disable GUARANTEE_UASSET_AND_UEXP_IN_SAME_PAK for patch pak generation, since it's not necessary with delete records. Lifing this restriction makes pak seek optimization a lot more efficient.
Profiling in suggests it improves streaming performance, and the paks are smaller
#rb none
[FYI] hongyi.yu


#ROBOMERGE-SOURCE: CL 5810432 via CL 5810437 via CL 5810648 via CL 5813653

[CL 5813762 by ben woodhouse in Main branch]
2019-04-09 17:12:14 -04:00
ben woodhouse
5d0b3cfc55 Add -fallbackOrderForNonUassetFiles option for ordering uexp and ubulk files if order is not specified (e.g for the secondary/cooker open order). Previously this was non-optional, but this caused a regression in patch sizes on some platforms
#ROBOMERGE-SOURCE: CL 5772400 via CL 5795133 via CL 5795152 via CL 5795156 via CL 5799600

[CL 5799704 by ben woodhouse in Main branch]
2019-04-08 18:22:18 -04:00
ben woodhouse
b52d87ce16 Fix bug caught by static analysis in AuditPakFiles()
#jira UE-72242
[FYI] marc.audy

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 5708883 via CL 5708886 via CL 5708887 via CL 5708891 via CL 5709641 via CL 5709794
#ROBOMERGE-BOT: CORE (Main -> Dev-Core)

[CL 5718872 by ben woodhouse in Dev-Core branch]
2019-04-03 21:05:57 -04:00
ben woodhouse
9a133b9de3 Fix bug caught by static analysis in AuditPakFiles()
#jira UE-72242
[FYI] marc.audy


#ROBOMERGE-SOURCE: CL 5708883 via CL 5708886 via CL 5708887 via CL 5708891 via CL 5709641

[CL 5709794 by ben woodhouse in Main branch]
2019-04-03 10:50:33 -04:00