Commit Graph

61 Commits

Author SHA1 Message Date
yuriy odonnell
a3bd8e9bb6 unsync - Add messages in addition to error codes in various places, fix CLI11 non-ascii printing, add --version argument
#rb none

[CL 27781280 by yuriy odonnell in ue5-main branch]
2023-09-11 22:49:17 -04:00
yuriy odonnell
a55c31dfe4 unsync - Fix new ParallelForEach helper
* Pass container in by reference to allow mutation

#rb none

[CL 27715295 by yuriy odonnell in ue5-main branch]
2023-09-08 12:27:41 -04:00
yuriy odonnell
a02ea83d83 unsync - Use multiple concurrent connections during file download query
* Bump version to 1.0.54

#rb none

[CL 27714879 by yuriy odonnell in ue5-main branch]
2023-09-08 12:19:57 -04:00
yuriy odonnell
f455aaecc7 unsync - Add support for HTTP HEAD requests
Also minor fixes and improvements:

* Fix error code handling when connecting a socket
* Fix some of the naming convention violations
* Add --print-http-header option to login command

#rb none

[CL 27702511 by yuriy odonnell in ue5-main branch]
2023-09-07 23:20:15 -04:00
yuriy odonnell
7a75fdfe69 unsync - Trim old cached manifest files during sync
#rb none

[CL 27541251 by yuriy odonnell in ue5-main branch]
2023-08-31 18:07:30 -04:00
yuriy odonnell
01b2df4dba unsync - Add quick login option
* Skip remote token validation in --quick mode, just check expiry locally

#rb none

[CL 27538554 by yuriy odonnell in ue5-main branch]
2023-08-31 17:15:46 -04:00
yuriy odonnell
8c7bdecb04 unsync - Add support for direct manifest download from proxy server (bypassing SMB)
* Add --login flag to sync command
* Add in-process token cache
* Add auth token when quering server features
* Use direct download path when supported by server

#jira UE-192913
#rb none

[CL 27535921 by yuriy odonnell in ue5-main branch]
2023-08-31 16:20:09 -04:00
yuriy odonnell
c9dc86cb37 unsync - Add dedicated login command and make output more machine-friendly
* Make TLS a mandatory required library
* Redirect human-readable log messages of login and query commands to stderr, while only directing machine-readable messages to stdout

#rb none

[CL 27471298 by yuriy odonnell in ue5-main branch]
2023-08-29 19:18:18 -04:00
yuriy odonnell
c33f84e382 unsync - Groundwork for list query
#jira UE-192913
#rb none

[CL 27341587 by yuriy odonnell in ue5-main branch]
2023-08-24 10:44:55 -04:00
yuriy odonnell
0cb9903591 unsync - Automatically refresh access token only when it's close to expiration
- Add FHttpRequest::BearerToken field
- Validate credentials using login endpoint

#jira UE-192913
#rb none

[CL 27233166 by yuriy odonnell in ue5-main branch]
2023-08-20 19:45:21 -04:00
yuriy odonnell
37b1da7fde unsync - Groundwork for user authentication
#jira UE-192913
#rb none

[CL 27227985 by yuriy odonnell in ue5-main branch]
2023-08-18 21:41:29 -04:00
yuriy odonnell
74e05813ad unsync - Skip automatic proxy selection for query command, use dedicated ping endpoint, refactor query helpers and download result mechanism
#rb none

[CL 27153277 by yuriy odonnell in ue5-main branch]
2023-08-16 16:34:36 -04:00
yuriy odonnell
c45fdca170 unsync - Automatically find closest proxy server by default
* Use --no-proxy-select to skip server selection
* Bump version to 1.0.52

#rb none

[CL 26157514 by yuriy odonnell in ue5-main branch]
2023-06-21 15:01:35 -04:00
yuriy odonnell
bec1e643ac unsync - Groundwork for mount command
#rb none

[CL 26154100 by yuriy odonnell in ue5-main branch]
2023-06-21 13:12:26 -04:00
Yuriy ODonnell
f4a7dc800b unsync - Improved manifest info command
* Allow --include and --exclude options
* Compute approximate patch size from manifest A to B

#rb none
#preflight skip

[CL 25437799 by Yuriy ODonnell in ue5-main branch]
2023-05-11 18:34:56 -04:00
Yuriy ODonnell
bb51087f42 unsync - Finish up --scavenge mode implementation, bump version to 1.0.51
* Count scavenged blocks as "base" data for stats/telemetry
* Gracefully handle missing/invalid scavenge root path
* Cancel reading blocks from a particular source if a hash mismatch was found

#rb none
#jira UE-178864
#preflight skip

[CL 25326911 by Yuriy ODonnell in ue5-main branch]
2023-05-03 17:28:38 -04:00
Yuriy ODonnell
60599e72d0 unsync - Fix missing copyright boilerplate
#rb none
#preflight skip

[CL 25248491 by Yuriy ODonnell in ue5-main branch]
2023-04-28 20:53:50 -04:00
Yuriy ODonnell
eca8ba2215 unsync - Deduplicate blocks within the same file while building scavenge database
* Log progress when scavenging blocks from local files
* Move prorress logging helper code to dedicated files

#rb none
#preflight skip

[CL 25247737 by Yuriy ODonnell in ue5-main branch]
2023-04-28 20:35:07 -04:00
Yuriy ODonnell
74997a586f unsync - Cleanup scavenged manifest paths
* Remve UNC prefixes on Windows

#rb none
#preflight skip

[CL 25198195 by Yuriy ODonnell in ue5-main branch]
2023-04-26 10:40:29 -04:00
Yuriy ODonnell
7389b826b6 unsync - Initial implementation of the "scavenge" mode which aims to reduce download times by reusing data outside of the final sync directory
This is useful for people who want to download each data set into a uniquely named directory, instead of always patching the last downloaded version.

Current implementation is highly experimental and should only be used for testing purposes.

#jira UE-178864
#rb none
#preflight skip

[CL 25190443 by Yuriy ODonnell in ue5-main branch]
2023-04-25 17:41:49 -04:00
Yuriy ODonnell
ee7d1f6a92 unsync - Fix global progress reporting
#rb none
#preflight skip

[CL 25153462 by Yuriy ODonnell in ue5-main branch]
2023-04-21 16:54:22 -04:00
Yuriy ODonnell
788c8102f6 unsync - Fix resolving mapped network drive paths
Explicitly specify UNIVERSAL_NAME_INFOW instead of UNIVERSAL_NAME_INFO that depends on the compiler flags

#rb none
#preflight skip

[CL 25152835 by Yuriy ODonnell in ue5-main branch]
2023-04-21 16:29:05 -04:00
Yuriy ODonnell
40d4991232 unsync - Download small files in batches to reduce amount of network requests
* This improves download performance of data sets with large numbers of small files due to reduced impact of latency
* Small files are grouped into ~4MB batches

#jira UE-175966
#preflight skip
#rb robert.millar

[CL 25150472 by Yuriy ODonnell in ue5-main branch]
2023-04-21 14:43:23 -04:00
ionut matasaru
3d7c0e8440 UBT: Removed deprecated TargetInfo::bUseMallocProfiler toggle in Source/Programs.
#jira UE-141779
#rb Joe.Kirchoff
#rb Johan.Berg
#preflight 64380aea7a00790bfd116430

[CL 25101875 by ionut matasaru in ue5-main branch]
2023-04-19 04:15:59 -04:00
Yuriy ODonnell
7820db9550 unsync - Bump version to 1.0.50
#rb none
#preflight skip

[CL 24903755 by Yuriy ODonnell in ue5-main branch]
2023-04-03 19:10:25 -04:00