matt peters
bd9ec84b79
ZenStoreWriter: Make oplog keys case insensitive, to remove the possiblity of two oplog entries for the same packagename.
...
#rb CarlMagnus.Nordin
#rnx
#ROBOMERGE-AUTHOR: matt.peters
#ROBOMERGE-SOURCE: CL 17458021 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17458033 by matt peters in ue5-release-engine-test branch]
2021-09-08 09:51:13 -04:00
matt peters
56274a7640
ZenStoreWriter - Make CommitPackage take an array of attachments; remove separate variables for TargetDomainDependencies and send them in as an attachment.
...
ZenStoreHttpClient - Add IsConnected.
#rb CarlMagnus.Nordin, Stefan.Boberg
#rnx
#ROBOMERGE-AUTHOR: matt.peters
#ROBOMERGE-SOURCE: CL 17456396 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[bot1]: dev-enginemerge-test
[CL 17456510 by matt peters in ue5-release-engine-test branch]
2021-09-08 07:04:39 -04:00
zousar shaker
8c80e5a866
Change Compact Binary Package API to represent binary attachments as compressed buffers identified by their raw hash.
...
Change Compact Binary Package serialization for binary attachments, compressed binary attachments and objects.
#rb devin.doucette
#ROBOMERGE-AUTHOR: zousar.shaker
#ROBOMERGE-SOURCE: CL 17450533 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v870-17433530)
[CL 17450587 by zousar shaker in ue5-release-engine-test branch]
2021-09-07 18:07:00 -04:00
carlmagnus nordin
2d97f9667e
IoStore: Added support for storing compressed chunks in DDC
...
#rb pj.kack
#rnx
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 17444267 via CL 17444348 via CL 17444353 via CL 17444359
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[STARSHIP]: UE5-Main
[CL 17444366 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-07 10:11:43 -04:00
carlmagnus nordin
7ee4d35b7e
IoStore: Fix log spam caused by localized packages without a corresponding source package
...
#rb pj.kack
#rnx
#ROBOMERGE-AUTHOR: carlmagnus.nordin
#ROBOMERGE-SOURCE: CL 17441505 via CL 17441516 via CL 17441524 via CL 17441527
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v870-17433530)
#ROBOMERGE[STARSHIP]: UE5-Main
[CL 17441530 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-07 01:31:40 -04:00
aurel cordonnier
7f517562d5
Merge from Release-Engine-Staging @ 17438845 to Release-Engine-Test
...
This represents UE4/Main @17430120 and Dev-PerfTest @17437669
[CL 17439044 by aurel cordonnier in ue5-release-engine-test branch]
2021-09-06 12:23:53 -04:00
carlmagnus nordin
0a58a09ea1
Removed functionality to cook to an IoStore container file, it has been superseded by cooking to Zen.
...
#rb pj.kack
#rnx
#ROBOMERGE-SOURCE: CL 17401028 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17401029 by carlmagnus nordin in ue5-release-engine-test branch]
2021-09-02 07:53:29 -04:00
matt peters
f00e13c26c
Change cleanbuild -> fullbuild to match our public-facing terminology for clean aka full aka noniterative builds.
...
#rb Zousar.Shaker
#rnx
#ROBOMERGE-SOURCE: CL 17378218 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v865-17346139)
[CL 17378244 by matt peters in ue5-release-engine-test branch]
2021-08-31 17:28:15 -04:00
carlmagnus nordin
42b9699fa0
AsyncLoading2:
...
Remove limit on pending package size since request buffers are no longer allocated up front.
Rely on the iodispatcher to sort requests instead of using the global load order for each package.
No longer store export bundle size and load order in the package store.
#jira FROST-4677
#rb per.larsson
#rnx
#ROBOMERGE-SOURCE: CL 17267090 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v858-17259218)
[CL 17267107 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-23 10:50:32 -04:00
matt peters
d09fe9658b
CookOnTheFlyServer: Create FLooseCookedPackageWriter and refactor UCookOnTheFlyServer to use ICookedPackageWriter in all cases rather than having a separate path for writing cooked files to disk.
...
#rb CarlMagnus.Nordin
#rnx
#ROBOMERGE-SOURCE: CL 17247861 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17247875 by matt peters in ue5-release-engine-test branch]
2021-08-20 10:57:45 -04:00
matt peters
dc0db90119
PackageStoreWriter: Split IPackageStoreWriter into IPackageWriter, IPackageCookWrite, IPackageStoreWriter.
...
We plan to implement an IPackageWriter for workspace domain editor files to reduce duplication in SavePackage, and implementations for that purpose do not need to handle cook functionality.
IOStore-specific functionality is not needed by the cooker, and is pushed into IPackageStoreWriter.
#rb Per.Larsson, CarlMagnus.Nordin
#rnx
#ROBOMERGE-SOURCE: CL 17247188 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17247191 by matt peters in ue5-release-engine-test branch]
2021-08-20 10:02:58 -04:00
stefan boberg
85a811cb21
Refactored the UE-side Zen project store interface so that we now use a common HTTP interface implementation across cache / project store classes. No functional impact, tested with ShooterGame
...
#rb none
#ROBOMERGE-SOURCE: CL 17234463 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17234464 by stefan boberg in ue5-release-engine-test branch]
2021-08-19 11:13:10 -04:00
per larsson
65502f9636
Zen: Changed file chunk ID to be based on filename hash instead of a monotonically increasing index
...
#rb CarlMagnus.Nordin
#rnx
#jira none
#ROBOMERGE-SOURCE: CL 17230621 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17230626 by per larsson in ue5-release-engine-test branch]
2021-08-19 06:42:05 -04:00
per larsson
a06fd5d5d3
PVS Studio analysis fix
...
#rb CarlMagnus.Nordin
#rnx
#ROBOMERGE-SOURCE: CL 17213385 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17213387 by per larsson in ue5-release-engine-test branch]
2021-08-18 07:59:06 -04:00
charles bloom
0d2aca2169
log warning instead of check for packages not in clusters
...
#rb carlmagnus.nordin
#preflight skip
#ROBOMERGE-SOURCE: CL 17176780 via CL 17176803
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17176812 by charles bloom in ue5-release-engine-test branch]
2021-08-16 11:52:07 -04:00
matt peters
fbf9ac29ea
ZenStoreWriter: Fix missing function definition in the non-windows version of the class.
...
#rb None, Trivial
#rnx
[FYI] CarlMagnus.Nordin
#ROBOMERGE-SOURCE: CL 17153556 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17153561 by matt peters in ue5-release-engine-test branch]
2021-08-12 12:11:10 -04:00
matt peters
eb280403be
PackageStore: Add IPackageStoreWriter::GetTargetDomainDependencies and FZenStoreHttpClient::ReadOplogAttachment.
...
#rb CarlMagnus.Nordin
#rnx
#ROBOMERGE-SOURCE: CL 17152232 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)
[CL 17152248 by matt peters in ue5-release-engine-test branch]
2021-08-12 10:51:31 -04:00
julien stjean
e3fb173774
Fixed Static analysis issues in interchange (fbxmesh.h) by changing the function GetMeshUniqueID from FbxHelper to return a empty string when the mesh is empty.
...
[FYI] Richard.TalbotWatkings
Fixed Static analysis in AnimationModifier.cpp the CurrentAnimSequence ptr can't be null since it was deferenced at the line 75.
Fixed Static analysis in PackageStoreOptimizer for some reason the static analysis did like the way the check was presented.
Fixed Static analysis in SComponentClassCombo.cpp and SDisplayClusterConfiguratorComponentCombo.cpp changed the code so that the static analyser should understand it better.
#jira UE-120410
#rb Jean.MichelDignard
#ROBOMERGE-SOURCE: CL 17071360 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v853-17066230)
[CL 17071396 by julien stjean in ue5-release-engine-test branch]
2021-08-05 13:15:23 -04:00
matt peters
46d56ee762
Cooking: Store build dependencies, runtime dependencies, and TargetDomainKey in an attachment in the oplog.
...
#rb Per.Larsson
#rnx
#ROBOMERGE-SOURCE: CL 17016596 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
[CL 17016635 by matt peters in ue5-release-engine-test branch]
2021-08-02 11:41:29 -04:00
matt peters
64eb24ccec
SavePackage PackageStoreWriter with EditorDomain: fix offsets written into the BulkDatas to be relative to the end of the Linker's archive as expected, rather than relative to some number of bytes before the end of the archive because we were copying Linker->Tell at a point before AppendAdditionalData and the Package Post Tag were written to the archive.
...
Also add the writing of AppendAdditionalData to a callback on the PackageStoreWriter, so that FVirtualizedUntypedBulkDatas can be separated out into separate archives in the same way FUntypedBaseData are.
#rnx
#rb Paul.Chipchase
#ROBOMERGE-SOURCE: CL 17015164 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
[CL 17015166 by matt peters in ue5-release-engine-test branch]
2021-08-02 08:36:21 -04:00
carlmagnus nordin
41da001048
IoStore:
...
Add more flexibility to the redirects/localization functionality by moving redirect information away from the package summaries and import tables
Changed import references from global import hashes to package local export hashes
#rb pj.kack
#rnx
#jira none
#ROBOMERGE-SOURCE: CL 17014898 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v839-17012307)
#ROBOMERGE[bot1]: dev-enginemerge-test
[CL 17014905 by carlmagnus nordin in ue5-release-engine-test branch]
2021-08-02 07:21:44 -04:00
charles bloom
a883ccc35c
iostore fix crash in logging error
...
#rb none
#ROBOMERGE-SOURCE: CL 16834540 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)
[CL 16834544 by charles bloom in ue5-release-engine-test branch]
2021-07-12 22:29:08 -04:00
per larsson
998e1d47b2
Iterative cooking support when using Zen loader/storage server
...
Zen: af7ff3f1c6
2021-06-23 09:01:23 -04:00
carlmagnus nordin
8cd803a1c5
IoStore: Added some missing cpu scopes and fixed very poor performance when creating the disk layout
...
#rnx
#rb none
#ROBOMERGE-SOURCE: CL 16755050 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v835-16672529)
[CL 16755059 by carlmagnus nordin in ue5-release-engine-test branch]
2021-06-23 06:16:26 -04:00
carlmagnus nordin
a97ca8ebaa
IoStore: Improved warning message for missing shader maps
...
#jira UE-118586
#rb none
#rnx
#ROBOMERGE-SOURCE: CL 16754980 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v835-16672529)
[CL 16754993 by carlmagnus nordin in ue5-release-engine-test branch]
2021-06-23 06:12:47 -04:00
