Commit Graph

459 Commits

Author SHA1 Message Date
henrik karlsson
955a26ecbf [UBA]
* Fixed so visualizer can visualize traces coming from UbaCli without needing restart
* Added some more logging to cache server maintenance
* Fixed scroll wheel zoom in visualizer
* Fixed so network server DisconnectClients does not put server in a bad state

[CL 34213980 by henrik karlsson in ue5-main branch]
2024-06-07 16:29:55 -04:00
henrik karlsson
acd0701e3d [UBA]
* Added timer scope around compressed obj files preload

[CL 34189252 by henrik karlsson in ue5-main branch]
2024-06-07 00:04:54 -04:00
henrik karlsson
87e57a366d [UBA]
* Removed lots of debug code now when bug has been found

[CL 34189212 by henrik karlsson in ue5-main branch]
2024-06-07 00:03:54 -04:00
henrik karlsson
c50a3b17e1 [UBA]
* Fixed bug where renamed file reported wrong stringkey for name to session from detoured process
* Fixed so compressed obj files wrote the right size on disk to file lookuptable

[CL 34184061 by henrik karlsson in ue5-main branch]
2024-06-06 20:30:32 -04:00
henrik karlsson
8c9338ae7d [UBA]
* Added crypto support on linux/macos

[CL 34178423 by henrik karlsson in ue5-main branch]
2024-06-06 18:18:18 -04:00
henrik karlsson
f235d46593 [UBA]
* Fixed so cacheclient useRoots set to true does not affect bucket id

[CL 34172207 by henrik karlsson in ue5-main branch]
2024-06-06 16:15:14 -04:00
henrik karlsson
cccb57fb9f [UBA]
* Changed so casdb entry is not invalidated when file is stored from helper since we already have caskey and everything ready
* Added options to disable usage of cache hits in cacheclient.. this is a debugging feature
* Added option to not use path roots in cache client
* Added more debug information to try to figure out bug where cache client sees wrong cas key of file

[CL 34170695 by henrik karlsson in ue5-main branch]
2024-06-06 15:45:03 -04:00
henrik karlsson
bde5eb22bb [UBA]
* Fixed macos compile errors

[CL 34169005 by henrik karlsson in ue5-main branch]
2024-06-06 15:08:21 -04:00
henrik karlsson
fcfd411a0d Fixed typo in ubaexports
[CL 34164056 by henrik karlsson in ue5-main branch]
2024-06-06 13:21:34 -04:00
henrik karlsson
ad3fbcb2e3 Fixed typo in ubaexports
[CL 34163989 by henrik karlsson in ue5-main branch]
2024-06-06 13:19:34 -04:00
henrik karlsson
000bde8513 [UBA]
* Added very basic solution for loading a config file. There are lots of internal things that we want to be able to config without having to release new binaries all the time
* Added CacheClientCreateInfo support for config file

[CL 34163080 by henrik karlsson in ue5-main branch]
2024-06-06 13:00:09 -04:00
henrik karlsson
bc5f780f83 [UBA]
* Reverted back to use OpenFile/GetFileInformation instead of GetFileAttributes because weirdly enough it seems to be much faster on cloud setups like AWS.. and I don't know why. You would think 1 syscall is faster than three (open,getinfo.close). GetFileInformation even contains more info than GetFileAttributes :-)

[CL 34144760 by henrik karlsson in ue5-main branch]
2024-06-05 19:57:55 -04:00
henrik karlsson
023755cc3c [UBA]
* Added more debug logging to writetocache mismatch
* Renamed all "entry" to either casEntry or fileEntry in order to be able to more easily do find-in-files
* Fixed so store entry done message is sent on fail as well (so server can clean up)

[CL 34142236 by henrik karlsson in ue5-main branch]
2024-06-05 17:57:46 -04:00
henrik karlsson
bbe78dfb31 [UBA]
* Added code to make cache server return result without waiting for unmapview of file being done

[CL 34132357 by henrik karlsson in ue5-main branch]
2024-06-05 14:00:34 -04:00
henrik karlsson
5c2d22ba69 [UBA]
* Reserve memory for elements that we know will be allocated in dir table and filemapping table

[CL 34132310 by henrik karlsson in ue5-main branch]
2024-06-05 13:58:58 -04:00
henrik karlsson
791502389d [UBA]
* Attempt at fixing problem with cache client seeing the wrong file when writing to cache. Problem is related to a race condition between directory crawler threads and writing files. We can end up in this scenario
1. Crawler query directory, file information gets stored in temporary state. and crawler starts traversing state
2. File is written and new date is set to file on disk, and file db entry is set to verified false.
3. Crawler hits the same file and now checks temporary state with file db entry and notice the lastwritten is the same, and set it back to verified. (but it is not the same)

[CL 34132081 by henrik karlsson in ue5-main branch]
2024-06-05 13:52:28 -04:00
henrik karlsson
5a263c548a [UBA]
* Added extra validation when writing cache entries
* Disabled directory preparsing when fetching cache entries for now

[CL 34100764 by henrik karlsson in ue5-main branch]
2024-06-04 14:07:46 -04:00
henrik karlsson
b787ab9d90 [UBA]
* Fixed bug in code that prefetches dir content

[CL 34084776 by henrik karlsson in ue5-main branch]
2024-06-03 23:14:56 -04:00
henrik karlsson
9775455aca [UBA]
* Fixed bug in Thread code where two concurrent waits could race and cause delete of functor at the same time

[CL 34081099 by henrik karlsson in ue5-main branch]
2024-06-03 19:23:20 -04:00
henrik karlsson
7900c5c3bc [UBA]
* Fixed so Cache server saves cas in parallel with buckets

[CL 34081088 by henrik karlsson in ue5-main branch]
2024-06-03 19:22:50 -04:00
henrik karlsson
b629a98f81 [UBA]
* Changed individual cancel message from Info to Detail

[CL 34080563 by henrik karlsson in ue5-main branch]
2024-06-03 18:52:18 -04:00
henrik karlsson
3b5d3ce44c [UBA]
* Fixed UbaCli linux compile error

[CL 34078781 by henrik karlsson in ue5-main branch]
2024-06-03 17:41:38 -04:00
henrik karlsson
367be10315 [UBA]
* Fixed annoying assert when pressing ctrl-c when running in debug
* Fixed so trace stream writes out processed stopped through cancel

[CL 34078000 by henrik karlsson in ue5-main branch]
2024-06-03 17:26:03 -04:00
henrik karlsson
152812809b [UBA]
* Removed duplicated code
* Added asserts to make sure no compressed obj files are used to calculate cas key
* Added missing locks around some code that should have locks

[CL 34072568 by henrik karlsson in ue5-main branch]
2024-06-03 14:37:42 -04:00
henrik karlsson
8135bb5221 [UBA]
* Added so cache server can handle StoreEntryDone messages with bool saying if it succeeded or not

[CL 34072414 by henrik karlsson in ue5-main branch]
2024-06-03 14:32:06 -04:00