Commit Graph

144 Commits

Author SHA1 Message Date
yuriy odonnell
d3052b8198 unsync - Use current time if file in the manifest doesn't have a valid timestamp
[CL 34220430 by yuriy odonnell in ue5-main branch]
2024-06-07 20:30:08 -04:00
yuriy odonnell
19fa4207c8 unsync - Fix directory separators when syncing from Horde
* Also handle some more errors that may be encountered during unsuccessful sync

[CL 34220309 by yuriy odonnell in ue5-main branch]
2024-06-07 20:17:08 -04:00
yuriy odonnell
703013dc43 unsync - Basic implementation of Horde blob download
[CL 34218083 by yuriy odonnell in ue5-main branch]
2024-06-07 18:21:05 -04:00
yuriy odonnell
fbd81d0c69 unsync - Add --protocol argument to explicitly specify the server protocol flavor to use
[CL 34207269 by yuriy odonnell in ue5-main branch]
2024-06-07 13:00:34 -04:00
yuriy odonnell
82f4423109 unsync - Remove leftover dev comment
[CL 34191467 by yuriy odonnell in ue5-main branch]
2024-06-07 02:08:54 -04:00
yuriy odonnell
c3f2a984c2 unsync - Groundwork for downloading Horde artifacts
* Recognize Horde artifact URLs
* Download and decode manifest from Horde

[CL 34189213 by yuriy odonnell in ue5-main branch]
2024-06-07 00:03:58 -04:00
yuriy odonnell
5e75c65ac5 unsync - Reduce chunking test buffer to from 1GB to 128MB, add validation for number of generated chunks and report median chunk size
[CL 34171426 by yuriy odonnell in ue5-main branch]
2024-06-06 16:01:58 -04:00
yuriy odonnell
608ab7041f unsync - Add unit tests for chunking algorithm, add utility function to compute rolling window hash threshold to achieve specific average block size
[CL 34144345 by yuriy odonnell in ue5-main branch]
2024-06-05 19:22:24 -04:00
yuriy odonnell
0bc836c31d unsync - Use deferred open mechanism for base files
* Avoid opening base files unnecessarily

[CL 34126244 by yuriy odonnell in ue5-main branch]
2024-06-05 11:21:32 -04:00
yuriy odonnell
d5e9515dd3 unsync - Send strong hash algorithm id with the block requests
[CL 34112795 by yuriy odonnell in ue5-main branch]
2024-06-04 20:45:07 -04:00
yuriy odonnell
b8f9bff026 unsync - Undo accidental debug code
[CL 34108749 by yuriy odonnell in ue5-main branch]
2024-06-04 17:55:54 -04:00
yuriy odonnell
5eee19aea6 unsync - Add experimental support for pure HTTP proxy server API, instead of custom binary protocol
[CL 34107282 by yuriy odonnell in ue5-main branch]
2024-06-04 17:15:24 -04:00
yuriy odonnell
d8ac614d60 unsync - Add a command to decode binary manifest to Json
[CL 34079955 by yuriy odonnell in ue5-main branch]
2024-06-03 18:26:41 -04:00
yuriy odonnell
02bac68ee6 unsync - Detect and report errros when downloading pack index files
[CL 34068576 by yuriy odonnell in ue5-main branch]
2024-06-03 12:28:21 -04:00
Yuriy ODonnell
d0e30d27ab unsync - Fix compile error on Linux
#jira none

[CL 33955096 by Yuriy ODonnell in ue5-main branch]
2024-05-28 17:55:18 -04:00
Yuriy ODonnell
3ee01ac3cc unsync - Use pack files when downloading blocks from server when possible
#jira none

[CL 33954792 by Yuriy ODonnell in ue5-main branch]
2024-05-28 17:45:20 -04:00
Yuriy ODonnell
0979b26d4a unsync - Add an abstraction for remote file system listing and manifest file downloads
#jira none

[CL 33925622 by Yuriy ODonnell in ue5-main branch]
2024-05-27 12:44:20 -04:00
Yuriy ODonnell
8812f02854 unsync - Further split utility code into dedicated modules
#jira none

[CL 33917971 by Yuriy ODonnell in ue5-main branch]
2024-05-26 13:37:37 -04:00
Yuriy ODonnell
81ab3f820c unsync - Move various utility code from UnsyncCore to separate modules
#jira none

[CL 33917087 by Yuriy ODonnell in ue5-main branch]
2024-05-26 02:04:36 -04:00
Yuriy ODonnell
8bb904ef62 unsync - Store uncompressed blocks by in packs by default
#jira none

[CL 33915306 by Yuriy ODonnell in ue5-main branch]
2024-05-25 12:06:28 -04:00
Yuriy ODonnell
50f882f5ec unsync - Groundwork for packing small files into a custom container during manifest generation
#jira none

[CL 33912288 by Yuriy ODonnell in ue5-main branch]
2024-05-24 20:21:04 -04:00
Yuriy ODonnell
653914f80b unsync - Move file open operation to worker threads during manifest generation
#jira none

[CL 33909316 by Yuriy ODonnell in ue5-main branch]
2024-05-24 18:16:24 -04:00
gary yuan
face91930a [Unsync] Fix null termination issue in memory buffer of decoded login token that was causing garbage bytes to be printed.
#rb Yuriy.ODonnell
[REVIEW]
#rnx

[CL 33632440 by gary yuan in ue5-main branch]
2024-05-14 13:00:49 -04:00
Yuriy ODonnell
ad086b7e64 unsync - Remove ConcRT/PPL, use custom scheduler by default
#jira none

[CL 33595690 by Yuriy ODonnell in ue5-main branch]
2024-05-11 20:20:25 -04:00
Yuriy ODonnell
7eddfa8553 unsync - Redirect warning and error log to stderr by default
#jira none

[CL 33579343 by Yuriy ODonnell in ue5-main branch]
2024-05-10 12:58:25 -04:00