Commit Graph

122 Commits

Author SHA1 Message Date
james doverspike
90c0ddf9ba [Backout] - CL24328738
[FYI] james.doverspike
Original CL Desc
-----------------------------------------------------------------
Cosmetic bulk asset streaming

Adds support for marking skeletal meshes and textures as optional files that stream from the cloud, typically used for cosmetics. Meshes and textures will now upload all of their non-inlined LODs as optional bulk files to the cloud, removing them from the pak files. The client will download into the VirtualFileCache in PersistentDownloadDir/VFC, which evicts least recently used LODs. These assets will have a longer delay to update to the higher quality LOD when their LODs are not in cache because they are now downloaded on-demand.

[CL 24373261 by james doverspike in ue5-main branch]
2023-02-22 19:19:46 -05:00
james doverspike
6a8a19a4b7 Cosmetic bulk asset streaming
Adds support for marking skeletal meshes and textures as optional files that stream from the cloud, typically used for cosmetics. Meshes and textures will now upload all of their non-inlined LODs as optional bulk files to the cloud, removing them from the pak files. The client will download into the VirtualFileCache in PersistentDownloadDir/VFC, which evicts least recently used LODs. These assets will have a longer delay to update to the higher quality LOD when their LODs are not in cache because they are now downloaded on-demand.

[CL 24331735 by james doverspike in ue5-main branch]
2023-02-20 20:22:07 -05:00
bob tellez
79d7201510 [Backout] - CL24230614
[FYI] james.doverspike
Original CL Desc
-----------------------------------------------------------------
Cosmetic bulk asset streaming

Adds support for marking skeletal meshes and textures as optional files that stream from the cloud, typically used for cosmetics. Meshes and textures will now upload all of their non-inlined LODs as optional bulk files to the cloud, removing them from the pak files. The client will download into the VirtualFileCache in PersistentDownloadDir/VFC, which evicts least recently used LODs. These assets will have a longer delay to update to the higher quality LOD when their LODs are not in cache because they are now downloaded on-demand.

[CL 24253381 by bob tellez in ue5-main branch]
2023-02-16 04:15:55 -05:00
james doverspike
4e78faf0de Cosmetic bulk asset streaming
Adds support for marking skeletal meshes and textures as optional files that stream from the cloud, typically used for cosmetics. Meshes and textures will now upload all of their non-inlined LODs as optional bulk files to the cloud, removing them from the pak files. The client will download into the VirtualFileCache in PersistentDownloadDir/VFC, which evicts least recently used LODs. These assets will have a longer delay to update to the higher quality LOD when their LODs are not in cache because they are now downloaded on-demand.

[CL 24251508 by james doverspike in ue5-main branch]
2023-02-16 01:47:06 -05:00
justin marcus
1fcd75e8a7 Dump relevant cache info on a failed cache reserve
Fix GFP state lex to string macro
[REVIEW] [at]Daniel.Lamb
#preflight 63d7e5e8ba4fadeef003f837

[CL 23922371 by justin marcus in ue5-main branch]
2023-01-31 00:54:38 -05:00
henrik karlsson
0da5962f86 Removed lots of includes in UE based on compile profiling
#preflight 6356cb02ae33b04ec1e358ac
#rb none

[CL 22786278 by henrik karlsson in ue5-main branch]
2022-10-26 15:02:30 -04:00
marc audy
9f5443d9ef * More removal of includes to reduce compile times (FortTypes.h, FortPersistentTypes.h, etc etc)
#rb self
#preflight 6344ac456e400a8e200e4a44

[CL 22451800 by marc audy in ue5-main branch]
2022-10-11 02:52:57 -04:00
justin marcus
f1c95e94ab Fix analytics provider not being available during install bundle source initialization.
This prevented some analytics events from being sent.

[REVIEW] [at]David.Harvey [at]Thomas.Ross
#preflight 633afd73ba39998ce83644b8

[CL 22323980 by justin marcus in ue5-main branch]
2022-10-03 21:33:33 -04:00
thomas ross
717e0175c2 Allow for not removing dependencies in bundle manager RequestRemoveContent through new EInstallBundleReleaseRequestFlags::ExplicitRemoveList
Add support for this and other Release Flags into InstallBundle protocol GameFeaturePlugins
#rb swarm
#tests none

[CL 22217710 by thomas ross in ue5-main branch]
2022-09-27 23:59:17 -04:00
bryan sefcik
df13e400e4 Renamed private pch headers in InstallBundleManager and fixed -NoPCH -DisableUnity compile issues.
#jira
#preflight 6307d6ebaa0fda29197d3f0f

[CL 21585132 by bryan sefcik in ue5-main branch]
2022-08-26 01:45:41 -04:00
Bryan sefcik
b4a6e947d8 Ran IWYU on Public headers under Engine/Source/Runtime/...
Headers are updated to contain any missing #includes needed to compile and #includes are sorted.  Nothing is removed.

#ushell-cherrypick of 21065896 by bryan.sefcik
#preflight 62d4b1a5a6141b6adfb0c892
#jira

#ROBOMERGE-OWNER: Bryan.sefcik
#ROBOMERGE-AUTHOR: bryan.sefcik
#ROBOMERGE-SOURCE: CL 21150156 via CL 21151754 via CL 21154719
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)
#ROBOMERGE-CONFLICT from-shelf

[CL 21181076 by Bryan sefcik in ue5-main branch]
2022-07-20 11:31:36 -04:00
bryan sefcik
9be15506ad Removed InstallBundleManager private pch.
Timing when compiling module with PCH(including compiling PCH): 5.64 secs
Timing using shared PCH: 4.44s secs
#preflight 62a0dfeefc5ffe569a72fb6a

[CL 20561720 by bryan sefcik in ue5-main branch]
2022-06-08 14:44:56 -04:00
justin marcus
44ac0beb67 Add a diff field when dumping installbundle cache using CSV format.
#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 20286942 via CL 20286947 via CL 20286953 via CL 20286965
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v948-20297126)

[CL 20304766 by justin marcus in ue5-main branch]
2022-05-20 18:47:04 -04:00
david harvey
0e5d779438 Added a new query to determine whether the install bundle manager can handle early startup patching.
- will eventually be replaced with a better system

#jira UE-146398
#rb Justin.Marcus
#rnx

#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 20258363 via CL 20258366 via CL 20258372
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20262878 by david harvey in ue5-main branch]
2022-05-18 12:51:35 -04:00
justin marcus
cfa6e00116 Add Contains() accessor.
#preflight

#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 19440850 via CL 19442818 via CL 19445302 via CL 19446074 via CL 19446282
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v933-19451510)

[CL 19453460 by justin marcus in ue5-main branch]
2022-03-21 12:48:24 -04:00
justin marcus
6734507c9f Install Bundle Cache
- Add CSV format option for GetStats()


[REVIEW] [at]Dave.Belanger [at]Josh.Adams

#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 19118955 via CL 19118975 via CL 19119009 via CL 19119047 via CL 19123211
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v921-19075845)

[CL 19154043 by justin marcus in ue5-main branch]
2022-02-25 15:02:33 -05:00
thomas ross
a49434ceea Add and Utilize UseChunkDB setting on bundle config to no longer generate chunkDBs on any flagged bundles
#rb swarm
#swarm 18391661
#preflight 61aece940e3f453820506dae
#tests Android / Switch preflight

#ROBOMERGE-AUTHOR: thomas.ross
#ROBOMERGE-SOURCE: CL 18449824 via CL 18449842 via CL 18449853 via CL 18449862 via CL 18450175 via CL 18450186
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18450195 by thomas ross in ue5-release-engine-test branch]
2021-12-13 18:32:58 -05:00
justin marcus
f4309b159e Improve GetCacheStats
- Now dumps bundle info in eviction order.
 - Add verbosity control
 - Add version that dumps stats for all caches
#rb [at]Thomas.Ross [at]Graem.Thornton [at]Daniel.Lamb
#preflight https://horde.devtools.epicgames.com/job/61b11466643ecfe8b07c0588

#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 18418637 via CL 18419371 via CL 18419377 via CL 18419381 via CL 18435066 via CL 18437375
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18437653 by justin marcus in ue5-release-engine-test branch]
2021-12-10 20:58:04 -05:00
justin marcus
b7d5e4615a Prep for combined bundle cache - Add age scalar so we can have different cache eviction rates for different bundle sources.
Fix for crash if manifest is missing from an installed bundle - this mostly affects bundles that were installed from a <redacted> since they don't get manifests.
When pruning no longer relevant bundles, remove from any associated caches.
Add a console command to flush install bundle caches.
[at]Thomas.Ross [at]Graeme.Thornton
#preflight https://horde.devtools.epicgames.com/job/61a8f77d832ebaf94860db6c

#ROBOMERGE-AUTHOR: justin.marcus
#ROBOMERGE-SOURCE: CL 18355451 via CL 18364417 via CL 18364466 via CL 18364513 via CL 18434150 via CL 18435480
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18436244 by justin marcus in ue5-release-engine-test branch]
2021-12-10 18:32:36 -05:00
aurel cordonnier
7f517562d5 Merge from Release-Engine-Staging @ 17438845 to Release-Engine-Test
This represents UE4/Main @17430120 and Dev-PerfTest @17437669

[CL 17439044 by aurel cordonnier in ue5-release-engine-test branch]
2021-09-06 12:23:53 -04:00
andriy tylychko
6bf3101dcd deprecated FTicker and family and replaced by thread-safe FTSTicker
#jira UE-120090
#rb francis.hurteau


#ROBOMERGE-SOURCE: CL 17176325 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v855-17104924)

[CL 17176374 by andriy tylychko in ue5-release-engine-test branch]
2021-08-16 11:09:22 -04:00
aurel cordonnier
02c0f425e8 Copy up from Release-Engine-Staging @ 16738359
This represents UE4/Main @ 16738161 and Dev-PerfTest @ 16737719

[CL 16738582 by aurel cordonnier in ue5-release-engine-test branch]
2021-06-22 00:27:54 -04:00
aurel cordonnier
25a11deeac Merge from Release-Engine-Staging @ 16579919
This represents UE4/Main @ 16579691 and Dev-PerfTest @ 16579576

[CL 16581170 by aurel cordonnier in ue5-release-engine-test branch]
2021-06-07 20:09:45 -04:00
Marc Audy
e80ea6b959 Merge from Release-Engine-Staging @ 16444985
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16445122 by Marc Audy in ue5-release-engine-test branch]
2021-05-25 02:43:26 -04:00
Marc Audy
f02d489290 Update Release-Engine-Test from Release-Engine-Staging @ 16264272
[CL 16264458 by Marc Audy in ue5-release-engine-test branch]
2021-05-11 01:10:20 -04:00