Commit Graph

71 Commits

Author SHA1 Message Date
daniel lamb
11d5cc7a03 Fixed alignment of non compressed files in pak files.
Also removed DDC config file.  Will need to figure out another way to do this when we enable DDC.
Graeme.Thornton

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 8240468 via CL 8240483 via CL 8243394 via CL 8243494
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v401-8057353)

[CL 8286809 by daniel lamb in Dev-Core branch]
2019-08-24 15:57:24 -04:00
daniel lamb
09429eee8e Fixed crash in unrealpak in uncompressed non async code path.
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 8223513 via CL 8223514 via CL 8229913 via CL 8230750
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v401-8057353)

[CL 8284003 by daniel lamb in Dev-Core branch]
2019-08-24 15:23:18 -04:00
bob tellez
b669c34a21 Merging CL#8215904 from //Fortnite/Release-10.30
Multithreaded file compression in unrealpak CreatePak.  Local testing shows 50% improvement.
Added compressed files to the DDC this doesn't improve performance when using Oodle Optimal2 but does improve when using Oodle Optimal3.

#test preflight switch builds.
Graeme.Thornton

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: Daniel.Lamb
#ROBOMERGE-SOURCE: CL 8216871 via CL 8229351 via CL 8230264
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v401-8057353)

[CL 8283328 by bob tellez in Dev-Core branch]
2019-08-24 15:16:46 -04:00
daniel lamb
20429a57b7 Fixed alignment of non compressed files in pak files.
Also removed DDC config file.  Will need to figure out another way to do this when we enable DDC.
Graeme.Thornton


#ROBOMERGE-SOURCE: CL 8240468 via CL 8240483 via CL 8243394
#ROBOMERGE-BOT: (v401-8057353)

[CL 8243494 by daniel lamb in Main branch]
2019-08-23 19:57:51 -04:00
daniel lamb
cee443cc76 Fixed crash in unrealpak in uncompressed non async code path.
#ROBOMERGE-SOURCE: CL 8223513 via CL 8223514 via CL 8229913
#ROBOMERGE-BOT: (v401-8057353)

[CL 8230750 by daniel lamb in Main branch]
2019-08-23 12:04:28 -04:00
bob tellez
696d945a82 Merging CL#8215904 from //Fortnite/Release-10.30
Multithreaded file compression in unrealpak CreatePak.  Local testing shows 50% improvement.
Added compressed files to the DDC this doesn't improve performance when using Oodle Optimal2 but does improve when using Oodle Optimal3.

#test preflight switch builds.
Graeme.Thornton


#ROBOMERGE-AUTHOR: Daniel.Lamb
#ROBOMERGE-SOURCE: CL 8216871 via CL 8229351
#ROBOMERGE-BOT: (v401-8057353)

[CL 8230264 by bob tellez in Main branch]
2019-08-23 11:56:05 -04:00
daniel lamb
f7405b2aa3 Added validation to patch generation to detect when unsupported files are changed.
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 7937403 via CL 7937406 via CL 7937407 via CL 7940721 via CL 7940816
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v393-7951996)

[CL 7969712 by daniel lamb in Dev-Core branch]
2019-08-13 01:28:37 -04:00
daniel lamb
e59eda4aec Added validation to patch generation to detect when unsupported files are changed.
#ROBOMERGE-SOURCE: CL 7937403 via CL 7937406 via CL 7937407 via CL 7940721
#ROBOMERGE-BOT: (v391-7919777)

[CL 7940816 by daniel lamb in Main branch]
2019-08-09 20:38:31 -04:00
graeme thornton
ccb1ecf5fc UnrealPak: Only print out "adding entries" message when we're actually creating a pak file
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 7648160 via CL 7648161 via CL 7648295 via CL 7648369
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v385-7708028)

[CL 7741570 by graeme thornton in Dev-Core branch]
2019-08-05 09:43:50 -04:00
Steve Robb
c0074f3627 TAutoPtr and TScopedPointer smart pointers removed.
#rb none

[CL 7674630 by Steve Robb in Dev-Core branch]
2019-07-31 15:34:19 -04:00
graeme thornton
9a3d7dcf99 UnrealPak: Only print out "adding entries" message when we're actually creating a pak file
#ROBOMERGE-SOURCE: CL 7648160 via CL 7648161 via CL 7648295
#ROBOMERGE-BOT: (v372-7473910)

[CL 7648369 by graeme thornton in Main branch]
2019-07-29 05:10:56 -04:00
bob tellez
345027453c Merging CL#7257773
Back out changelist 7256178. This was a bad merge


#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7258012 via CL 7266926 via CL 7266952
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v371-7306989)

[CL 7339383 by bob tellez in Dev-Core branch]
2019-07-16 23:57:39 -04:00
bob tellez
bc9a0b5ffe Merging //Fortnite/Release-10.0 to Dev-Main (//Fortnite/Dev-Main)
Merging CL#7251132 from //Fortnite/Release-Competitive.9.40

Merging in all missing changes from Release-9.40 to Release-Competitive.9.40 to try to make RoboMerge happy.

#rnx
#rb none

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7256432 via CL 7266483 via CL 7266503
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v371-7306989)

[CL 7338442 by bob tellez in Dev-Core branch]
2019-07-16 23:50:36 -04:00
bob tellez
452aeba28e Merging CL#7257773
Back out changelist 7256178. This was a bad merge



#ROBOMERGE-OWNER: bob.tellez
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7258012 via CL 7266926
#ROBOMERGE-BOT: (v369-7254125)

[CL 7266952 by bob tellez in Main branch]
2019-07-10 17:05:15 -04:00
bob tellez
97e9932675 Merging //Fortnite/Release-10.0 to Dev-Main (//Fortnite/Dev-Main)
Merging CL#7251132 from //Fortnite/Release-Competitive.9.40

Merging in all missing changes from Release-9.40 to Release-Competitive.9.40 to try to make RoboMerge happy.

#rnx
#rb none


#ROBOMERGE-OWNER: bob.tellez
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 7256432 via CL 7266483
#ROBOMERGE-BOT: (v369-7254125)

[CL 7266503 by bob tellez in Main branch]
2019-07-10 16:41:03 -04:00
graeme thornton
cfce5e8c22 UnrealPak - Added "TestMemoryOptimization" mode which attempts to unload filenames and shrink pak entries across every pak in a directory, making sure there are no collisons and that everything works correctly
#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 7227149 via CL 7227151 via CL 7227434 via CL 7227472
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v367-6836689)

[CL 7236686 by graeme thornton in Dev-Core branch]
2019-07-09 00:17:28 -04:00
graeme thornton
51cfbaef7d UnrealPak - Added "TestMemoryOptimization" mode which attempts to unload filenames and shrink pak entries across every pak in a directory, making sure there are no collisons and that everything works correctly
#ROBOMERGE-SOURCE: CL 7227149 via CL 7227151 via CL 7227434
#ROBOMERGE-BOT: (v367-6836689)

[CL 7227472 by graeme thornton in Main branch]
2019-07-08 10:23:53 -04:00
david harvey
6e89d17d50 Adding internal -CalcCompressionBlockCRCs command line option to UnrealPak to try and track down the rare FPakAsyncReadFileHandle::DoProcessing issue + a bit more logging when it fails.
#rb gil.gribb

#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 6953229 via CL 6953341 via CL 6953356
#ROBOMERGE-BOT: CORE (Main -> Dev-Core) (v367-6836689)

[CL 6997030 by david harvey in Dev-Core branch]
2019-06-14 14:22:30 -04:00
david harvey
58c25dd385 Adding internal -CalcCompressionBlockCRCs command line option to UnrealPak to try and track down the rare FPakAsyncReadFileHandle::DoProcessing issue + a bit more logging when it fails.
#rb gil.gribb


#ROBOMERGE-SOURCE: CL 6953229 via CL 6953341
#ROBOMERGE-BOT: (v366-6836689)

[CL 6953356 by david harvey in Main branch]
2019-06-12 07:11:50 -04:00
Stefan Boberg
8607ecb30d Copying //UE4/Dev-Core to Dev-Main (//UE4/Dev-Main)
#rb none

[CL 6815521 by Stefan Boberg in Main branch]
2019-06-03 15:32:00 -04:00
Stefan Boberg
87e98b9573 Merging //UE4/Main @ 6763475 to //UE4/Dev-Core (sbo182_DevCore)
(peafour-mergedown)

#rb none

[CL 6782584 by Stefan Boberg in Dev-Core branch]
2019-06-03 04:06:29 -04:00
graeme thornton
54c0741d48 Hardening of pak index loading
- If a corrupt index is detected, do a retry but collect and log more information along the way to help diagnose the issue.

#rb stefan.boberg


#ROBOMERGE-SOURCE: CL 6685180 via CL 6685186 via CL 6751170
#ROBOMERGE-BOT: (v365-6733468)

[CL 6751664 by graeme thornton in Main branch]
2019-05-31 18:22:01 -04:00
Graeme Thornton
6359d2b6c7 PlatformCrypto based RSA support for the engine
- RSA lib now redirects through a modular feature interface to find a crypto provider

#jira UE-68086
#rb ben.marsh

[CL 6655503 by Graeme Thornton in Dev-Core branch]
2019-05-28 14:50:25 -04:00
daniel lamb
bfae378499 Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.


#ROBOMERGE-OWNER: robert.manuszewski
#ROBOMERGE-AUTHOR: daniel.lamb
#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210 via CL 6287835
#ROBOMERGE-BOT: CORE (Main -> Dev-Core)

[CL 6302329 by daniel lamb in Dev-Core branch]
2019-05-03 21:13:34 -04:00
daniel lamb
04d57e57cf Content build label update now errors if the build is not on prod, instead of trying to upload it again.
Added new content only build node  and now generates pak patch files for pak files not in original build.
Also merges manifest with original build
Also posts build to gamedev and prod
GenerateChunkDBs now takes in two additional parameters specifying how many rollback labels to process and which ones to optimize (preparation for future change where we process more chunkdbs).
Added support for generating buildinfo.ini for ps4.



#ROBOMERGE-SOURCE: CL 6278253 via CL 6287210

[CL 6287835 by daniel lamb in Main branch]
2019-05-03 17:47:05 -04:00