Commit Graph

104 Commits

Author SHA1 Message Date
tomasz obrebski
5cce972555 Zen pak file streaming:
- -ZenPak used to indicate streaming using pak files instead of Zen loose file streaming
 - added pak file hardware decompression on supported platforms

#jira UE-221577
#rb David.Harvey, daniele.pieroni

[CL 36761256 by tomasz obrebski in 5.5 branch]
2024-10-01 20:04:53 -04:00
tomasz obrebski
54a30bd892 IFileHandle seekless ReadAt
#jira UE-213809
#rb brian.white, daniele.pieroni, David.Harvey, Josie.Yang
#rnx

[CL 36757440 by tomasz obrebski in 5.5 branch]
2024-10-01 19:29:48 -04:00
david harvey
4818431979 Use shared cache for storage server platform file.
#jira UE-222485
#rnx
#rb tomasz.obrebski

[CL 35891369 by david harvey in ue5-main branch]
2024-08-29 04:19:21 -04:00
zousar shaker
364c1c9163 Ensure that a missing oplog doesn't prevent us from starting editor/cooker when using zen as cook store and reader.
#rb matt.peters

[CL 35758634 by zousar shaker in ue5-main branch]
2024-08-22 18:47:37 -04:00
david harvey
94c3a90ee0 [Trivial] fix for missing return value for LowerLevel OpenWrite calls
[CL 35694390 by david harvey in ue5-main branch]
2024-08-21 07:08:18 -04:00
david harvey
fc642d297b [Trivial] fix copy/paste storage server error message
#rnx

[CL 35653762 by david harvey in ue5-main branch]
2024-08-20 09:52:45 -04:00
david harvey
d661487e40 [Trivial] fix for some zen file reads not being properly reported in insights I/O
#jira UE-221612
#rnx

[CL 35599048 by david harvey in ue5-main branch]
2024-08-16 13:11:06 -04:00
zousar shaker
3ec2eaac3a Ensure that a null lower level platform file doesn't cause StorageServerPlatformFile to crash with a null dereference.
[CL 35586407 by zousar shaker in ue5-main branch]
2024-08-15 22:33:11 -04:00
david harvey
939dbf8352 New stats & debugging for Zen:
New Insights stats:
 - File I/O trace for storage server files (requires running with -trace=default,file)
 - Throughput counters, matching the on-screen display (requires -trace=default,counters)

Debug refactor:
 - Main stat processing moved to ticker
 - Startup stats processed by background thread

CVar changes:
 - On-screen graphs now toggled via zen.showgraphs
 - Added zen.showstats to toggle the on-screen throughput messages

#jira UE-221612
#rnx
#rb daniele.pieroni

[CL 35562191 by david harvey in ue5-main branch]
2024-08-15 10:01:59 -04:00
zousar shaker
e4a1796ece Fix for shipping build breakage.
[CL 35343061 by zousar shaker in ue5-main branch]
2024-08-06 11:54:26 -04:00
zousar shaker
3d20fe9de5 Reorganize StorageServerClient module into the base module and a sibling module for debug functionality. Also expose an API for creation of storage server platform file usage outside of the default platform hierarchy.
#rb daniele.pieroni

[CL 35341386 by zousar shaker in ue5-main branch]
2024-08-06 11:00:25 -04:00
david harvey
e75af68a7b Added the option to specify file extensions that will be assumed to be immutable, and their timestamps will always be constant.
- only .uplugin at the moment
 - fixes the GFP plugin data caching when using Zen

#rnx
#jira UE-219872
#rb tomasz.obrebski, Zousar.Shaker

[CL 35266503 by david harvey in ue5-main branch]
2024-08-02 05:15:03 -04:00
pj kack
c7e041ef02 FPackageId: Deprecate and replace ValueForDebugging with LexToString.
#rb per.larsson
#rnx

[CL 34702722 by pj kack in ue5-main branch]
2024-06-27 04:15:42 -04:00
steve robb
f40be2d759 Fixed some 'deprecated' FString usage.
#rb james.hopkin

[CL 34603027 by steve robb in ue5-main branch]
2024-06-24 09:25:50 -04:00
steve robb
7e54d6b019 Fixed wrong FString constructor being used to construct from a range.
#rb james.hopkin

[CL 34600674 by steve robb in ue5-main branch]
2024-06-24 06:49:39 -04:00
danny couture
0c471d7a6e [HttpClient]
- Fix crash when dealing with empty content

#rb dmytro.ivanov, tomasz.obrebski

[CL 34465678 by danny couture in ue5-main branch]
2024-06-18 12:27:16 -04:00
wojciech krywult
fa24de91ec Zen: Fix for crashes when looking for the server address on platforms that don't support IP6.
#rb dmytro.ivanov, tomasz.obrebski

[CL 34442303 by wojciech krywult in ue5-main branch]
2024-06-17 17:44:04 -04:00
ben woodhouse
2ea61ce0c6 Switch to CSV_PROFILER_STATS instead of CSV_PROFILER for various profiling subsystems. This allows them to be compiled out when CSV_PROFILER_MINIMAL is defined.
As part of this change we also promote dynamic resolution and IO/PackageQueueDepth stats to Minimal since they're important for high level performance reporting.
Also fix up a few places that were redundantly using #if CSV_PROFILER around CSV macros.

#rb mickael.gilabert

[CL 34386798 by ben woodhouse in ue5-main branch]
2024-06-14 18:16:47 -04:00
dmytro ivanov
7cc8ba51b4 Refactor Zen storage module to be able to use other HTTP clients
#jira UE-189687
#rb tomasz.obrebski

[CL 34336030 by dmytro ivanov in ue5-main branch]
2024-06-13 07:54:06 -04:00
dan engelbrecht
ba5d026298 Add support for specifying BaseURI when connecting to zenserver to read cooked/paked data
#rb tomasz.obrebski
#jira UE-213809

[CL 34265531 by dan engelbrecht in ue5-main branch]
2024-06-11 01:27:00 -04:00
zousar shaker
d580cf94bd Restore file size caching on the client when using StorageServer (zen streaming).
[CL 34180571 by zousar shaker in ue5-main branch]
2024-06-06 19:05:45 -04:00
zousar shaker
499d460e3b Whitespace fix (spaces/tabs).
[CL 34021945 by zousar shaker in ue5-main branch]
2024-05-30 20:04:44 -04:00
zousar shaker
40a38d0858 Rollback (as p4 edits) file size caching changes until the zenserver side issue is addressed.
[CL 33846932 by zousar shaker in ue5-main branch]
2024-05-22 18:14:43 -04:00
zousar shaker
d97697831a Temporarily disable the caching of file sizes until an issue with CookOnTheFly mode is addressed.
[CL 33821730 by zousar shaker in ue5-main branch]
2024-05-22 01:57:07 -04:00
daniele pieroni
3eddcd4a4d Remove temporary check from FStorageServerResponse::Serialize
[CL 33760495 by daniele pieroni in ue5-main branch]
2024-05-19 20:05:01 -04:00