Joakim Lindqvist
8c1973150c
Horde Storage - Fixed incorrect claim mapping for legacy transaction log access, also made more of the claim verification case insensitive. Lastly I updated the scylla keyspace mapping to what its actually set to in the db (no functional difference)
...
#preflight none
[CL 20854466 by Joakim Lindqvist in ue5-main branch]
2022-06-28 08:06:41 -04:00
Joakim Lindqvist
d44a75400a
Horde Storage - Reverted enabling of PII everywhere, this should never be set in prod.
...
#preflight none
[CL 20854031 by Joakim Lindqvist in ue5-main branch]
2022-06-28 07:46:47 -04:00
Joakim Lindqvist
53711a3e64
Horde Storage - Ignore case when looking for claim values that do not contain a = (we already do for those containing = )
...
This resolves issues with the auth for legacy transaction log endpoints using legacy claims
#preflight none
[CL 20853766 by Joakim Lindqvist in ue5-main branch]
2022-06-28 07:26:15 -04:00
Jerome Delattre
3e9504ac79
Fix issue with missing test report in job details. Bump up the limit of test report loaded in jobdetails
...
[CL 20838703 by Jerome Delattre in ue5-main branch]
2022-06-27 16:20:43 -04:00
carl bystrom
440cf93cc0
Horde: Upgrade Datadog tracing library
...
#preflight 62b9bf2eba62f4498a32a316
[CL 20830643 by carl bystrom in ue5-main branch]
2022-06-27 10:37:15 -04:00
Joakim Lindqvist
97bc7a0128
Horde Storage - Disable forwarding of AWS SDK logs into serilog. The AWS log is quite useless producing multiple errors for operations that are not errors, and thus also spammy. It can still be useful to debug certain complicated AWS SDK issues so leaving the code in place should we need it.
...
#preflight none
[CL 20830015 by Joakim Lindqvist in ue5-main branch]
2022-06-27 09:35:52 -04:00
carl bystrom
41964467a5
Horde: Auto-join agent to pools requested in properties
...
#preflight 62b488141371af05d9f34cc0
[CL 20795938 by carl bystrom in ue5-main branch]
2022-06-23 11:41:29 -04:00
carl bystrom
13cb1ee505
Horde: Add more tracing scopes to popular streams endpoint
...
#preflight 62b45ee4c603be6148409bed
[CL 20793278 by carl bystrom in ue5-main branch]
2022-06-23 08:44:08 -04:00
carl bystrom
9ad8ce28ab
Horde: Fix missing remote IP log property
...
This somehow stopped working and I was unable to get it working with the inline Use(...).
#preflight 62b43efaae6850d11fb549fb
[CL 20792182 by carl bystrom in ue5-main branch]
2022-06-23 06:25:22 -04:00
carl bystrom
0e9aa887b9
Horde: Include any additional agent properties from settings
...
#preflight none
[CL 20773096 by carl bystrom in ue5-main branch]
2022-06-22 08:46:01 -04:00
carl bystrom
363bdb42ed
Horde: Terminate non-reusable EC2 instances on shutdown
...
#preflight none
[CL 20773050 by carl bystrom in ue5-main branch]
2022-06-22 08:41:21 -04:00
carl bystrom
ac5957805d
Horde: Add a fleet manager that can create/terminate instances from scratch on AWS EC2
...
The current AWS fleet manager was renamed to clarify it only can start existing and stopped instances.
#preflight 62b2dff7816e271be89b79dc
[CL 20771811 by carl bystrom in ue5-main branch]
2022-06-22 05:30:08 -04:00
carl bystrom
e152012ad4
Horde: Add AWS Lambda support for agent using the WorkerService
...
Adds a "one shot mode" to WorkerService that allows it to listen for exactly one lease from the server. This is a hybrid as opposed to sending the ComputeTaskMessage as part of the Lambda invocation request. Through this, the agent will listen for a lease and behave like a normal agent and share the same task queue. Functionality for starting these Lambda based agents is yet to be added.
A test task was added to aid testing in the fake HordeRpcServer.
#preflight 62b1940d0b1767c9a12480c9
[CL 20755174 by carl bystrom in ue5-main branch]
2022-06-21 05:53:25 -04:00
Joakim Lindqvist
6a1755d29f
Horde Storage - Updated documentation around auth setup
...
[CL 20736700 by Joakim Lindqvist in ue5-main branch]
2022-06-20 09:45:46 -04:00
Joakim Lindqvist
0fc3333ef6
Horde Storage - Removed support for the "AllNamespaces" special claim - this can be achived by using the acls in the auth setting instead
...
#preflight https://horde.devtools.epicgames.com/job/62b074b1ef1c98455449cd40
[CL 20736694 by Joakim Lindqvist in ue5-main branch]
2022-06-20 09:45:20 -04:00
Joakim Lindqvist
15e5cd0f3b
Horde Storage - Deleted raw ddc endpoints which are not in use anymore
...
#preflight none
[CL 20736591 by Joakim Lindqvist in ue5-main branch]
2022-06-20 09:38:04 -04:00
Joakim Lindqvist
861635bacc
Horde Storage - Fixed bug when requiring more then one claim in a ACL where only having one of the claims was suffiecent to get access to the ACL
...
#preflight none
[CL 20736097 by Joakim Lindqvist in ue5-main branch]
2022-06-20 08:53:11 -04:00
carl bystrom
990d90c28f
Horde: Make ComputeController instanceable again
...
Internal access modifier on constructor prevented class from getting instantiated by DI.
#preflight none
[CL 20735772 by carl bystrom in ue5-main branch]
2022-06-20 08:21:47 -04:00
Joakim Lindqvist
9fc33cbeb7
Horde Storage - Reworked how access control is managed within Horde Storage to align more with how Horde Build works. You now map ACLs to actions (from claims) which controls what you can do in each namespace. This allows us to grant read or write access to individual namespaces as well as moving more of the mapping from claims into configuration - thus supporting whatever claim setup licensees might have from their IdP
...
#preflight https://horde.devtools.epicgames.com/job/62b04081a0427d845626ace9
[CL 20735608 by Joakim Lindqvist in ue5-main branch]
2022-06-20 07:40:23 -04:00
carl bystrom
d59bbba9f7
Horde: Enable configuring of auto-scale strategy settings through REST API
...
Strategy specific settings were not hooked up before.
#fyi Bryan.Johnson
#preflight 62ac4bc2c6467711b6789ed7
[CL 20700580 by carl bystrom in ue5-main branch]
2022-06-17 05:43:09 -04:00
Joakim Lindqvist
89e02fbffd
Horde Storage - Removed usage of legacy ref store from BlobStoreConsistencyCheck, while correct to consider those namespaces as well practically it doesnt matter much and this causes issues when the legacy setup is not configured (which it shouldnt be for anyone as it is deprecated)
...
#preflight none
[CL 20684933 by Joakim Lindqvist in ue5-main branch]
2022-06-16 05:43:28 -04:00
Ben Marsh
d37e15ad7d
Horde: Minor formatting changes for Slack messages.
...
#preflight none
[CL 20669347 by Ben Marsh in ue5-main branch]
2022-06-15 10:05:00 -04:00
Ben Marsh
a3f9e91b05
Horde: Replace logic for ignoring systemic issues with code to ignore specific event ids in situations that warrant it. Systemic issues are now treated as real systemic isssues rather than false positives.
...
#preflight none
[CL 20662761 by Ben Marsh in ue5-main branch]
2022-06-14 20:59:16 -04:00
Ben Marsh
9ddd9b05a3
Horde: Remove matchers for generic "BUILD FAILED" messages in UAT. These do not contain any useful information.
...
#preflight none
[CL 20662461 by Ben Marsh in ue5-main branch]
2022-06-14 20:46:54 -04:00
Ben Marsh
9b8fa5c425
Fix tests.
...
#preflight none
[CL 20661949 by Ben Marsh in ue5-main branch]
2022-06-14 20:30:25 -04:00