Commit Graph

1303 Commits

Author SHA1 Message Date
Ben Marsh
2f710fb9c7 Horde: Remove legacy DirectoryNode update methods. DirectoryUpdate class now allows building a structured representation of an update to perform in batch.
[CL 25821952 by Ben Marsh in ue5-main branch]
2023-06-06 14:02:57 -04:00
Ben Marsh
db2a6176af Horde: Rework directory packing algorithm for better data locality.
* Leaf node data is always packed at the start of the output stream, followed by chunk interior nodes, followed by directory nodes.
* Interior nodes now use the IoHash of the last serialized child node to determine slicing points. Previous implementation used a BuzHash from the start of the node, which resulted in not using a sliding window.

[CL 25815424 by Ben Marsh in ue5-main branch]
2023-06-06 10:14:15 -04:00
Ben Marsh
3452cfd1aa EpicGames.Perforce: Speculatively add altsync and noaltsync values to client options enum.
[CL 25792307 by Ben Marsh in ue5-main branch]
2023-06-05 10:57:21 -04:00
Marc Audy
43986f732d Fix divergences from FNMain
#rnx
#preflight

[CL 25777212 by Marc Audy in ue5-main branch]
2023-06-02 19:33:12 -04:00
josh adams
f6381544e2 - Allow a project to override the Main SDK version for a platform (the platform's project Engine.ini would set
[OverrideSDK]
  SDKVersion=x.y.z
and AutoSDK, or anything using GetMainVersion(), would use that version string instead
- If multiple targets are built in one run of UBT/UAT, it will error out because there is no support to switch SDKs (and builds happen in parallel, etc)
- This is not a complete solution, because it can cause problems with shared tools like ShaderCompileWorker, when different projects are on different SDKs and they have one SCW to share
- Renamed GetMainVersion to GetMainVersionInternal(), and wrapped that in a new non-vitual GetMainVersion() that calls GetMainVersionInternal() (and handles the ini overrides)
#rb david.harvey,dave.barrett
#jira UE-185364
#preflight 647a12e7b0670733186c928e

[CL 25767233 by josh adams in ue5-main branch]
2023-06-02 13:42:59 -04:00
Ben Marsh
1314dbdf98 Horde: Refresh file metadata after moving from the cache and updating timestamps.
#preflight none

[CL 25764999 by Ben Marsh in ue5-main branch]
2023-06-02 12:33:28 -04:00
Ben Marsh
c6246d9472 Horde: Reverting CL 25709378; storing hashes with node locators/handles removes a lot of complexity, and makes it easier for clients to cache data.
#preflight 647a06955e71ee4db648158f

[CL 25762879 by Ben Marsh in ue5-main branch]
2023-06-02 11:35:51 -04:00
Ben Marsh
50b5a01b3e Horde: Build fix.
#preflight none

[CL 25737763 by Ben Marsh in ue5-main branch]
2023-06-01 15:47:38 -04:00
Ben Marsh
f77f72cd32 Horde: More refactoring of storage API to hide bundle implementation details.
- Rename StorageClientBase to BundleStorageClient. The current implementation assumes that bundles will be used for storage.
- Use ReadAsync() methods on NodeHandle to expand content, rather than requiring a TreeReader to be passed around.

#preflight none

[CL 25737520 by Ben Marsh in ue5-main branch]
2023-06-01 15:43:22 -04:00
carl bystrom
f17d4e0bc9 EpicGames.Perforce: Add cache tests for ManagedWorkspace
Also fix mismatched digests in the fixture.

#preflight none

[CL 25732665 by carl bystrom in ue5-main branch]
2023-06-01 13:46:11 -04:00
Ben Marsh
a4e2059326 Horde: Abstract out logic for building bundles into an interface, so implementations can choose not to use it if they desire.
#preflight 6477f5eb313d43282fcf9a9f

[CL 25724155 by Ben Marsh in ue5-main branch]
2023-06-01 08:39:27 -04:00
Ben Marsh
221ce42510 Horde: Remove hashes from node handles by default. A separate HashedNodeHandle type bundles the handle with a hash value for round-tripping data through NodeRef objects.
#preflight none

[CL 25709378 by Ben Marsh in ue5-main branch]
2023-05-31 14:41:23 -04:00
Ben Marsh
20355594a8 Horde: Remove methods which assume the hash is stored with a node handle.
#preflight none

[CL 25704985 by Ben Marsh in ue5-main branch]
2023-05-31 12:41:58 -04:00
Ben Marsh
e24c58010c Move BucketId implementation into UnrealCloudDDC. Not needed by the public API at the moment.
#preflight 647757500848b7126dc4d5bd

[CL 25701894 by Ben Marsh in ue5-main branch]
2023-05-31 10:37:30 -04:00
Ben Marsh
c80dcd77cb Fix UBT/UAT building on Windows ARM64.
#preflight 6477562f4b0d5a1eb1411fa1

[CL 25701794 by Ben Marsh in ue5-main branch]
2023-05-31 10:31:38 -04:00
Ben Marsh
aa7ef6a644 Horde: Remove unused small object store implementation.
#preflight none

[CL 25700970 by Ben Marsh in ue5-main branch]
2023-05-31 09:39:31 -04:00
Ben Marsh
7f7e2338bd Horde: Remove generic storage client interface. We don't currently use this.
#preflight none

[CL 25699315 by Ben Marsh in ue5-main branch]
2023-05-31 07:06:39 -04:00
henrik karlsson
91002a99c5 [Box]
* New binaries with bug fixes
* Removed BoxManaged code now when ubt is using pinvoke instead

#preflight 645c9d182965f6ea8e7627ee
#rb none

[CL 25697589 by henrik karlsson in ue5-main branch]
2023-05-31 01:53:35 -04:00
joe kirchoff
8d61991e8a Managed p/invoke libray for box rather than use a managed c++ library
#rnx
#rb Henrik.Karlsson
#preflight 64763f524b0d5a1eb1e81c38

[CL 25683741 by joe kirchoff in ue5-main branch]
2023-05-30 14:47:11 -04:00
Ben Marsh
97ab8e8e82 Horde: Separate C#-specific typed node serialization/deserialization from core bundle logic.
#preflight none

[CL 25661077 by Ben Marsh in ue5-main branch]
2023-05-28 14:02:50 -04:00
Ben Marsh
22294d0023 Horde: Missing files.
#preflight none

[CL 25659239 by Ben Marsh in ue5-main branch]
2023-05-27 10:45:29 -04:00
Ben Marsh
a728c807a8 Horde: Rename FileNode to ChunkedDataNode.
#preflight none

[CL 25659236 by Ben Marsh in ue5-main branch]
2023-05-27 10:44:11 -04:00
Ben Marsh
339f8934c3 Fix DeployTool task no longer accepting a zip file argument.
#preflight 6470b337624a2b767fe0d017

[CL 25643979 by Ben Marsh in ue5-main branch]
2023-05-26 11:55:13 -04:00
calvin zheng
d9d493619f Improved method of getting Xcode version
#jira UE-185817
#rb Josh.Adams
#preflight 646e55dc6c2a2532b1f164fd

[CL 25609928 by calvin zheng in ue5-main branch]
2023-05-24 15:01:27 -04:00
Ben Marsh
69e3180cc0 Horde: Add a custom error code for BuildGraph script compilation errors.
#preflight none

[CL 25606893 by Ben Marsh in ue5-main branch]
2023-05-24 13:06:11 -04:00