Commit Graph

40 Commits

Author SHA1 Message Date
yuriy odonnell
b247041845 unsync - Implement support for overlays when syncing from Horde
[CL 34948454 by yuriy odonnell in ue5-main branch]
2024-07-19 18:21:08 -04:00
yuriy odonnell
c65a2c0128 unsync - Add query http-get <url> command to easily issue use Horde and Unsync HTTP APIs
* Add extended error messages to various places

[CL 34701319 by yuriy odonnell in ue5-main branch]
2024-06-27 00:49:36 -04:00
yuriy odonnell
8a833fe9ff unsync - Add Horde artifact listing syntax backwards-compatible with filesystem based paths
* Specify artifact filters using `KeyA=ValueA;KeyB=ValueB` syntax
* Specify artifact listing formating and directory structure using `{FieldA}{dir}{FieldB}` syntax, where {FieldA/B} are substituted with artifact metadata and {dir} creates a virtual sub-directory
* Missing fields are substituted with `[unknown]`

[CL 34660906 by yuriy odonnell in ue5-main branch]
2024-06-25 18:31:35 -04:00
yuriy odonnell
653714087b unsync - Implement experimental mechanism to list Horde artifacts as a virtual directory structure
* Use 5 minute threshold by default for triggering auth token refresh

[CL 34549235 by yuriy odonnell in ue5-main branch]
2024-06-20 18:37:09 -04:00
yuriy odonnell
7a8cebabab unsync - Use common implementation of server directory listing for query list and search commands
[CL 34518988 by yuriy odonnell in ue5-main branch]
2024-06-19 20:06:19 -04:00
yuriy odonnell
accfc7e7fe unsync - Improve error checking and handling
* Handle most errors during Horde block download as non-fatal (allow other files to be downloaded if one file hits an error)
* Account for block cache creation time when logging individual file download rate
* Add explicit EDownloadRetryMode::Disconnect code to prevent subsequent server requests, distinct from from Abort code
* Propagate errors from few more places when decoding auth tokens

[CL 34514495 by yuriy odonnell in ue5-main branch]
2024-06-19 17:14:41 -04:00
yuriy odonnell
19fa4207c8 unsync - Fix directory separators when syncing from Horde
* Also handle some more errors that may be encountered during unsuccessful sync

[CL 34220309 by yuriy odonnell in ue5-main branch]
2024-06-07 20:17:08 -04:00
yuriy odonnell
703013dc43 unsync - Basic implementation of Horde blob download
[CL 34218083 by yuriy odonnell in ue5-main branch]
2024-06-07 18:21:05 -04:00
yuriy odonnell
c3f2a984c2 unsync - Groundwork for downloading Horde artifacts
* Recognize Horde artifact URLs
* Download and decode manifest from Horde

[CL 34189213 by yuriy odonnell in ue5-main branch]
2024-06-07 00:03:58 -04:00
yuriy odonnell
d5e9515dd3 unsync - Send strong hash algorithm id with the block requests
[CL 34112795 by yuriy odonnell in ue5-main branch]
2024-06-04 20:45:07 -04:00
yuriy odonnell
5eee19aea6 unsync - Add experimental support for pure HTTP proxy server API, instead of custom binary protocol
[CL 34107282 by yuriy odonnell in ue5-main branch]
2024-06-04 17:15:24 -04:00
yuriy odonnell
02bac68ee6 unsync - Detect and report errros when downloading pack index files
[CL 34068576 by yuriy odonnell in ue5-main branch]
2024-06-03 12:28:21 -04:00
Yuriy ODonnell
3ee01ac3cc unsync - Use pack files when downloading blocks from server when possible
#jira none

[CL 33954792 by Yuriy ODonnell in ue5-main branch]
2024-05-28 17:45:20 -04:00
Yuriy ODonnell
0979b26d4a unsync - Add an abstraction for remote file system listing and manifest file downloads
#jira none

[CL 33925622 by Yuriy ODonnell in ue5-main branch]
2024-05-27 12:44:20 -04:00
Yuriy ODonnell
ad086b7e64 unsync - Remove ConcRT/PPL, use custom scheduler by default
#jira none

[CL 33595690 by Yuriy ODonnell in ue5-main branch]
2024-05-11 20:20:25 -04:00
Yuriy ODonnell
a63405040e unsync - Add a basic custom thread scheduler for Mac/Linux
#jira none

[CL 33556179 by Yuriy ODonnell in ue5-main branch]
2024-05-09 15:37:00 -04:00
Yuriy ODonnell
833acc62ca unsync - Groundwork for a cross-platform scheduler
#jira none

[CL 33531808 by Yuriy ODonnell in ue5-main branch]
2024-05-08 18:13:41 -04:00
Yuriy ODonnell
926e87e4bd unsync - ListDirectory and DownloadFile helpers now take FHttpConnection
#jira none

[CL 33487910 by Yuriy ODonnell in ue5-main branch]
2024-05-07 13:10:40 -04:00
Yuriy ODonnell
ca60aac7fc unsync - Fix downloading uncompressed blocks, tweak direct file download connection limit and chunk size
#jira none

[CL 33418009 by Yuriy ODonnell in ue5-main branch]
2024-05-02 20:46:49 -04:00
yuriy odonnell
351f099b51 unsync - Attempt to establish TLS connections by default and allow fallback unless explicitly connecting to HTTPS port or using authentication
[CL 33127126 by yuriy odonnell in ue5-main branch]
2024-04-19 22:35:37 -04:00
yuriy odonnell
4ba5f8d39d unsync - Automatically enable TLS when server port is standard https/443
[CL 33095223 by yuriy odonnell in ue5-main branch]
2024-04-18 22:55:33 -04:00
yuriy odonnell
257f18b5b6 unsync - Split OpenID config out of FAuthDesc into a separate structure and use auth desc to generate token cache key instead of just server address
* Avoids unnecessary login steps when using different proxy servers that share auth config

[CL 29877767 by yuriy odonnell in ue5-main branch]
2023-11-21 18:25:48 -05:00
yuriy odonnell
cc9c8ca84c unsync - Move code related to building the target file into a separate .h/cpp
[CL 29701697 by yuriy odonnell in ue5-main branch]
2023-11-13 19:34:29 -05:00
yuriy odonnell
149778ff91 unsync - Always use the specified proxy server for performing authentication instead of auto-selected closest, fix few other minor issues
* Use correct TLS subject after auto-selecting a proxy (previously the root proxy address was used)

[CL 29051065 by yuriy odonnell in ue5-main branch]
2023-10-24 15:07:43 -04:00
yuriy odonnell
3cf6f9a0c0 unsync - Add search query to discover available builds through proxy
#rb none

[CL 28166018 by yuriy odonnell in ue5-main branch]
2023-09-22 20:13:26 -04:00