Commit Graph

39 Commits

Author SHA1 Message Date
dan thompson
89f184e47f string helper functions for oodle enums.
#rb Fabien.Giesen
#preflight 61ae76ab2b3384289ad5be91

#ROBOMERGE-AUTHOR: dan.thompson
#ROBOMERGE-SOURCE: CL 18387813 in //UE5/Release-5.0/... via CL 18387899
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v896-18170469)

[CL 18387935 by dan thompson in ue5-release-engine-test branch]
2021-12-06 16:26:55 -05:00
devin doucette
bedf259d3e CompressedBuffer: Added const to params on virtual functions now that it is not an error on certain platforms
#rb none
#rnx
#preflight 61ae2b21fc3f6823e81897dc

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18383097 in //UE5/Release-5.0/... via CL 18383105
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v896-18170469)

[CL 18383123 by devin doucette in ue5-release-engine-test branch]
2021-12-06 11:18:42 -05:00
devin doucette
27c1393427 CompressedBuffer: Removed partial decompression from FCompressedBuffer now that FCompressedBufferReader is available
Requiring the use of a separate reader type makes it more likely that readers will be reused, and makes it easier to audit reader usage going forward. Reusing readers is desirable to reduce the number of large temporary allocations made during partial decompression of a buffer.

- Added FCompressedBuffer::Save(FArchive&) and renamed FromCompressed(FArchive&) to Load(FArchive&).
- Added FCompressedBufferReaderSourceScope to set a buffer source within a scope.
- Added proper bounds checks to FNoneDecoder.
- Store the header checksum on the decoder context to allow raw blocks to be reused across sources.
- Decode the header on the fly to avoid a temporary header allocation when the header is in contiguous memory.

#rb Zousar.Shaker
#rnx
#preflight 61a98d53800738dbfbc84c73

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18382211 in //UE5/Release-5.0/... via CL 18382310
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v896-18170469)

[CL 18382377 by devin doucette in ue5-release-engine-test branch]
2021-12-06 10:16:05 -05:00
mark lintott
50ba1392be Made DecompressToComposite pure virtual as there was no specific definition for the FDecoder class.
#jira none
[FYI] devin.doucette

#ROBOMERGE-AUTHOR: mark.lintott
#ROBOMERGE-SOURCE: CL 18340031 in //UE5/Release-5.0/... via CL 18340044
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18340051 by mark lintott in ue5-release-engine-test branch]
2021-12-01 11:25:33 -05:00
devin doucette
c26bedd2fa CompressedBuffer: Added FCompressedBufferReader to store decoder buffers and allow streaming from seekable archives
#rb Zousar.Shaker
#rnx
#preflight 61a5acc4ee100b68faabeecc

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 18325071 in //UE5/Release-5.0/... via CL 18325078
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18325081 by devin doucette in ue5-release-engine-test branch]
2021-11-30 10:34:57 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
aurel cordonnier
fc542f6cfd Merge from Release-Engine-Staging @ 18081189 to Release-Engine-Test
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971

[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
2021-11-07 23:43:01 -05:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
per larsson
59ff132987 CompressedBuffer - decompress at offset
#rb Devin.Doucette, Paul.Chipchase
#rnx

#ROBOMERGE-OWNER: Devin.Doucette
#ROBOMERGE-AUTHOR: per.larsson
#ROBOMERGE-COMMAND: _robomerge UE5-Main
#ROBOMERGE-SOURCE: CL 17797770 in //UE5/Release-5.0/... via CL 17797780
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v883-17842818)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 17859847 by per larsson in ue5-release-engine-test branch]
2021-10-19 09:38:07 -04:00
devin doucette
ec3fa9680f CompositeBuffer: Renamed Flatten() to ToShared()
#rb none
#rnx
[FYI] Zousar.Shaker
#preflight 613f872b3bbb48000114081d

#ROBOMERGE-AUTHOR: devin.doucette
#ROBOMERGE-SOURCE: CL 17495384 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17495398 by devin doucette in ue5-release-engine-test branch]
2021-09-13 15:16:06 -04:00
charles bloom
4d7bcb6e04 OodleCompressDLL config option needs to be read in CopyBuildToStagingDirectory and passed on the command line
because UnrealPak as a program can't read project config hierarchy

#rb dan.thompson,josh.adams

#ROBOMERGE-AUTHOR: charles.bloom
#ROBOMERGE-SOURCE: CL 17464507 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)

[CL 17464538 by charles bloom in ue5-release-engine-test branch]
2021-09-08 17:53:21 -04:00
carlmagnus nordin
4d924fbd4a Restore Oodle allocator hooks
#rnx
#jira UE-124678
#rb charles.bloom

#ROBOMERGE-SOURCE: CL 17405626 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17405629 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-02 13:41:10 -04:00
devin doucette
3d262ca7f0 CompressedBuffer: Removed the FormatName functionality and update its last remaining callers
#rb Paul.Chipchase, Zousar.Shaker
#rnx
#preflight 612feb940380e700016fc8e5

#ROBOMERGE-SOURCE: CL 17403021 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)

[CL 17403035 by devin doucette in ue5-release-engine-test branch]
2021-09-02 10:30:25 -04:00
charles bloom
9a5487c8dd OodleDataCompression fix 64 bit size cast to int
#rb none

#ROBOMERGE-SOURCE: CL 17089616 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17089636 by charles bloom in ue5-release-engine-test branch]
2021-08-06 18:35:37 -04:00
devin doucette
996bacd58d CompressedBuffer: Removed calls to Ar.TotalSize() to fix loading from a text-format archive
#rb Paul.Chipchase
#rnx

#ROBOMERGE-SOURCE: CL 17082464 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17082472 by devin doucette in ue5-release-engine-test branch]
2021-08-06 09:16:42 -04:00
dan thompson
5074a8efce Move replay compression functions only used in fortnite back to fortnite
Clarify interface to Oodle compressed array functions
Add support for >2gb buffers
#preflight 6109e3ff4cd793000191470d
#rb charles.bloom

#ROBOMERGE-SOURCE: CL 17075612 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)

[CL 17075735 by dan thompson in ue5-release-engine-test branch]
2021-08-05 16:59:34 -04:00
charles bloom
c7a68a0830 fix Unity stress with LogCompression
#rb none

#ROBOMERGE-SOURCE: CL 17019220 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)

[CL 17019249 by charles bloom in ue5-release-engine-test branch]
2021-08-02 15:15:56 -04:00
stefan boberg
6ea989d0af Added copyright boilerplate to fix CIS
#rb trivial

#ROBOMERGE-SOURCE: CL 17017606 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)

[CL 17017610 by stefan boberg in ue5-release-engine-test branch]
2021-08-02 13:03:25 -04:00
charles bloom
1ecb02670e Archive support CompressionFormat other than NAME_Zlib
v2 header tag to indicate format is serialized in data
writes new data, continues to load old data

#rb devin.doucette

#ROBOMERGE-SOURCE: CL 17017219 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)

[CL 17017233 by charles bloom in ue5-release-engine-test branch]
2021-08-02 12:28:00 -04:00
dan thompson
3a36a98489 readd decompress to existing buffer - dropped when removing test stuff. #pf 60fae49ed3905c0001f20dc7
#ROBOMERGE-SOURCE: CL 16941086 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16941090 by dan thompson in ue5-release-engine-test branch]
2021-07-23 15:53:55 -04:00
dan thompson
7884ae0b8a Convenience class for compressing/decompressing with Oodle #rb charles.bloom #pf 60f9ddad391d460001d39660
#ROBOMERGE-SOURCE: CL 16932166 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v838-16927207)

[CL 16932178 by dan thompson in ue5-release-engine-test branch]
2021-07-22 18:37:49 -04:00
devin doucette
a149477819 CompressedBuffer: Added Oodle as a compression method
#rb Charles.Bloom, Zousar.Shaker
#rnx
#preflight 60f85a18a6959a000176686e

#ROBOMERGE-SOURCE: CL 16913054 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16913063 by devin doucette in ue5-release-engine-test branch]
2021-07-21 14:55:45 -04:00
charles bloom
df3497d089 OodleDataCompression fixing namespace convention
#rb none

#ROBOMERGE-SOURCE: CL 16912164 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16912187 by charles bloom in ue5-release-engine-test branch]
2021-07-21 14:05:39 -04:00
charles bloom
e0987b11a6 Compression Flags add ForPackaging to differentiate packaging compression usage
add OodleDataCompression CommonUsage to translate Flags

#rb dan.thompson

#ROBOMERGE-SOURCE: CL 16908872 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16908880 by charles bloom in ue5-release-engine-test branch]
2021-07-21 09:52:44 -04:00
charles bloom
813938151e change OodleCompressDLL option to come from Engine.ini of the platform you are running on
instead of the game.ini of the platform you are packaging for

#rb none

#ROBOMERGE-SOURCE: CL 16900626 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16900642 by charles bloom in ue5-release-engine-test branch]
2021-07-20 15:24:44 -04:00