Commit Graph

38 Commits

Author SHA1 Message Date
henrik karlsson
955a26ecbf [UBA]
* Fixed so visualizer can visualize traces coming from UbaCli without needing restart
* Added some more logging to cache server maintenance
* Fixed scroll wheel zoom in visualizer
* Fixed so network server DisconnectClients does not put server in a bad state

[CL 34213980 by henrik karlsson in ue5-main branch]
2024-06-07 16:29:55 -04:00
henrik karlsson
bbe78dfb31 [UBA]
* Added code to make cache server return result without waiting for unmapview of file being done

[CL 34132357 by henrik karlsson in ue5-main branch]
2024-06-05 14:00:34 -04:00
henrik karlsson
7900c5c3bc [UBA]
* Fixed so Cache server saves cas in parallel with buckets

[CL 34081088 by henrik karlsson in ue5-main branch]
2024-06-03 19:22:50 -04:00
henrik karlsson
8135bb5221 [UBA]
* Added so cache server can handle StoreEntryDone messages with bool saying if it succeeded or not

[CL 34072414 by henrik karlsson in ue5-main branch]
2024-06-03 14:32:06 -04:00
henrik karlsson
5c693e5f22 [UBA]
* Added support for adding high priorty work
* Changed so cache server puts bucket maintenance work at high priority

[CL 34058891 by henrik karlsson in ue5-main branch]
2024-06-02 18:15:45 -04:00
henrik karlsson
9ba008c8b4 [UBA]
* Optimized cache entry matching
* Added StoreCasKey and changed some StoreCasFile to StoreCasKey in CacheClient which does not need to store cas files
* Changed some parts of the code to use string keys instead of strings since the keys are designed to have correct casing

[CL 34027529 by henrik karlsson in ue5-main branch]
2024-05-31 02:18:27 -04:00
henrik karlsson
886c959948 [UBA]
* Added so empty cache buckets are deleted on save

[CL 34020490 by henrik karlsson in ue5-main branch]
2024-05-30 19:37:55 -04:00
henrik karlsson
ac61ff6dac [UBA]
* Add more logging for ubacacheserver to try to figure out why cas files that are inputs to cache entries are deleted.

[CL 33986590 by henrik karlsson in ue5-main branch]
2024-05-29 16:57:56 -04:00
henrik karlsson
a8baa8a38d [UBA]
* Fixed macos compile error

[CL 33980473 by henrik karlsson in ue5-main branch]
2024-05-29 13:59:57 -04:00
henrik karlsson
d6ec293bf8 [UBA]
* Optimizations in UbaCacheService maintenance code

[CL 33976668 by henrik karlsson in ue5-main branch]
2024-05-29 12:07:26 -04:00
henrik karlsson
d7750bf1bc [UBA]
* Fixed bug where cache service was showing cas entries that doesn't exist

[CL 33965028 by henrik karlsson in ue5-main branch]
2024-05-29 02:20:36 -04:00
henrik karlsson
1273801622 [UBA]
* Added -expiration=<seconds> to UbaCacheService.. This controls when cache entries should be deleted. If an entry has been unused for more than <expiration> time it gets deleted. Defaults to two days.
* Added reason why cache entries are deleted
* Changed so cas database is always checked in startup.

[CL 33963630 by henrik karlsson in ue5-main branch]
2024-05-29 01:07:06 -04:00
henrik karlsson
33cf643173 [UBA]
* Store cas file lookup after first call and then reuse it since we know no cas files go away while we're running

[CL 33960475 by henrik karlsson in ue5-main branch]
2024-05-28 20:07:10 -04:00
henrik karlsson
ba5047cc60 [UBA]
* Made sure buckets are saved on version change

[CL 33958105 by henrik karlsson in ue5-main branch]
2024-05-28 19:07:31 -04:00
henrik karlsson
0799091ec5 [UBA]
* Changed so when fetching cache entries we only calculate cas for localized files once

[CL 33955441 by henrik karlsson in ue5-main branch]
2024-05-28 18:03:47 -04:00
henrik karlsson
e8bc193abc [UBA]
* Changed so cache server has one file per bucket since we are planning to have lots of buckets

[CL 33952969 by henrik karlsson in ue5-main branch]
2024-05-28 16:55:11 -04:00
henrik karlsson
b4dd48e03b [UBA]
* Changed algorithm for updating input offsets on cache entries in an attempt to make it faster when there are lots of entries on the same key
* Added unit tests

[CL 33948602 by henrik karlsson in ue5-main branch]
2024-05-28 15:06:16 -04:00
henrik karlsson
ae21bba2c7 [UBA]
* Fixed but where variable tracking if entries have been deleted in bucket was never reset

[CL 33924885 by henrik karlsson in ue5-main branch]
2024-05-27 11:42:45 -04:00
henrik karlsson
89fe909dcb [UBA]
* Added more times to steps to be able to track what is taking time

[CL 33919937 by henrik karlsson in ue5-main branch]
2024-05-26 23:28:21 -04:00
henrik karlsson
943b1d84d6 [Uba]
* WorkManager - Fixed bug in ParallelFor. deleted event could be set
* CacheService - More optimizations around maintenance

[CL 33918909 by henrik karlsson in ue5-main branch]
2024-05-26 18:07:50 -04:00
henrik karlsson
37fcd5cb20 [UBA]
* Change ranges array from array of structs to binary blob with 7bit encoded values
* Changed so temporary vector is reused over multiple container element iterations

[CL 33917075 by henrik karlsson in ue5-main branch]
2024-05-26 01:56:11 -04:00
henrik karlsson
43f4a75351 [UBA]
* Fixed linux compile error

[CL 33916910 by henrik karlsson in ue5-main branch]
2024-05-25 22:30:15 -04:00
henrik karlsson
ac8207c873 [Uba]
* Removed GetNowFileTime. GetSystemTimeAsFileTime should be used instead
* Fixed some minor bugs in uba cache server related to times
* Added obliterate command to cache server

[CL 33916906 by henrik karlsson in ue5-main branch]
2024-05-25 22:30:11 -04:00
henrik karlsson
2b6e993613 [UBA]
* Fixed macos compile error

[CL 33916360 by henrik karlsson in ue5-main branch]
2024-05-25 18:16:40 -04:00
henrik karlsson
5d8c42793d [UBA]
* Changed so UbaCacheServer stores ranges of input offsets for entries in the same key. It is likely we have many matching inputs between entries in the same key
* Added database creation time and store all times in relation to creation time
* Added lastUsedTime to entries to be able to add support for cleaning up entries that have not been used for x time (not implemented yet)

[CL 33916166 by henrik karlsson in ue5-main branch]
2024-05-25 16:58:10 -04:00