Commit Graph

43 Commits

Author SHA1 Message Date
Ben Marsh
356fd72d85 Remove exclusion for HTML5 folders if you don't have the EMSCRIPTEN environment variable set.
[CL 2611121 by Ben Marsh in Main branch]
2015-07-06 11:14:14 -04:00
zorbathut
5f4f2cfa76 PR #1131: Support prefix matching for gitdependencies' --exclude parameter. (Contributed by zorbathut)
[CL 2581576 by Ben Marsh in Main branch]
2015-06-09 14:19:59 -04:00
Ben Marsh
b1fd4a7d68 Fix count for number of downloaded files; each IncomingFile now have multiple target files.
[CL 2536331 by Ben Marsh in Main branch]
2015-05-04 16:18:16 -04:00
Ben Marsh
4c15ef5ad1 Fix running out of file handles on Mac when decompressing ICU datafiles. Same file is written many times from the same hashed data, so it keeps lots of file handles open at once. Download the file to one location first, then copy it to the others instead. Also fix the number of idle threads not being correctly updated, causing the download to keep restarting even though nothing else is succeeding (making the downloader keep looping around 99% when it threw an exception for running out of handles, rather than writing an error and quitting).
[CL 2534996 by Ben Marsh in Main branch]
2015-05-02 18:13:26 -04:00
zorbathut
f17e6e93b6 PR #1073: Hacky fix so GitDependencies can exclude files in the root directory. (Contributed by zorbathut)
[CL 2520567 by Ben Marsh in Main branch]
2015-04-21 22:37:44 -04:00
Ben Marsh
1b41af5d32 Add validation for integer and float arguments to GitDependencies.
[CL 2515688 by Ben Marsh in Main branch]
2015-04-17 07:58:08 -04:00
Ben Marsh
f9eec8d67b Allow setting default parameters for GitDependencies through the UE4_GITDEPS_ARGS environment variable. Related to #1036, #1051.
[CL 2514397 by Ben Marsh in Main branch]
2015-04-16 11:55:37 -04:00
Ben Marsh
36ff266d5a Increase cache minimum time to 7 days.
[CL 2494144 by Ben Marsh in Main branch]
2015-03-27 14:05:56 -04:00
bozaro
c6b0faa290 PR #928: Add GitDependencies cache size limit (LRU) (Contributed by bozaro)
[CL 2494134 by Ben Marsh in Main branch]
2015-03-27 14:03:35 -04:00
Ben Marsh
2f9a5eb14a Fix cache files being full of zeroes when syncing dependencies.
#lockdown Zachary.EdgertonJones

[CL 2492544 by Ben Marsh in Main branch]
2015-03-26 16:08:17 -04:00
Ben Marsh
728ddf4871 Exclude Linux folders when syncing Git dependencies on Windows if LINUX_ROOT is not set.
#codereview Dmitry.Rekman

[CL 2481580 by Ben Marsh in Main branch]
2015-03-17 10:52:33 -04:00
Ben Marsh
5c17862687 PR #927: GitDependencies: reduce file fragmentation (usefull for HDD). (Contributed by bozaro)
[CL 2481456 by Ben Marsh in Main branch]
2015-03-17 09:00:50 -04:00
Ben Marsh
89b91ebcce Remove unnecessary call to ReadToEnd(); ExtractFilesFromRawStream will now read the whole file if it's being hashed.
[CL 2474014 by Ben Marsh in Main branch]
2015-03-10 13:20:24 -04:00
Ben Marsh
8709c61b23 Minor changes to GitDependencies:
* Manually push data through SHA1 transform; Mono's implementation of CryptoStream seems to suffer from some crazy performance issues, causing download speed to be reduced by *two thirds*.
* Use default implementation of SHA1 transform rather than forcing SHA1Managed.
* Fixed error message not being displayed correctly on exit.
* Target framework is now 4.0 rather than 4.5 to fix Linux issue.

#codereview Dmitry.Rekman

[CL 2473969 by Ben Marsh in Main branch]
2015-03-10 12:59:45 -04:00
Ben Marsh
1e36cf058e PR #867: Small fix for GitDependencies.exe ans HTTP_PROXY env. variables. (Contributed by yaakuro)
https://github.com/EpicGames/UnrealEngine/pull/867

[CL 2466231 by Ben Marsh in Main branch]
2015-03-02 09:07:29 -05:00
Ben Marsh
39499bb4b9 Clamp status messages to the size of the console buffer, and add missing MiB/s text.
[CL 2453813 by Ben Marsh in Main branch]
2015-02-20 15:19:27 -05:00
Ben Marsh
82928f6867 Change status message to match the format Git uses, for consistency.
[CL 2453783 by Ben Marsh in Main branch]
2015-02-20 15:10:17 -05:00
Ben Marsh
1729b53ea1 Avoid race conditions with poisoned cache files.
[CL 2453454 by Ben Marsh in Main branch]
2015-02-20 12:58:34 -05:00
Ben Marsh
a17adc33b4 Add separate classes for incoming pack/file data and calculate everything up-front, rather than passing through all the worker threads. Put the default base URL in the dependency manifest to prevent needing to special-case it.
[CL 2453428 by Ben Marsh in Main branch]
2015-02-20 12:37:35 -05:00
Ben Marsh
7edef8717d Fix ugly rounding errors in GitDependencies status message (always shows 0.1 instead of 0.0). Calculate it using integers instead.
[CL 2453311 by Ben Marsh in Main branch]
2015-02-20 11:24:57 -05:00
Ben Marsh
48c9eac6d1 Use a lockless method of getting things into the cache. Relies on file system moves being atomic; should allow using a cache on a shared or network drive.
[CL 2453248 by Ben Marsh in Main branch]
2015-02-20 10:46:31 -05:00
Ben Marsh
0f3f468601 Rename InvalidCacheException to CorruptPackFileException, since it isn't necessarily caused by an invalid cache entry. Other minor housekeeping.
[CL 2453182 by Ben Marsh in Main branch]
2015-02-20 09:51:05 -05:00
Ben Marsh
3686c074c4 PR #749: Added cache support for GitDependencies. (Contributed by bozaro)
https://github.com/EpicGames/UnrealEngine/pull/749

[CL 2453105 by Ben Marsh in Main branch]
2015-02-20 08:59:03 -05:00
Ben Marsh
3eb524e1fc Condense the proxy server settings into a single parameter.
[CL 2450340 by Ben Marsh in Main branch]
2015-02-18 12:12:47 -05:00
Ben Marsh
70fc486484 Clean up help messages for GitDependencies to fit within 80 character wide terminals.
[CL 2450182 by Ben Marsh in Main branch]
2015-02-18 10:43:00 -05:00