Commit Graph

8 Commits

Author SHA1 Message Date
leon huang
08a10ebb73 Fixed issue with Smartling localization autehntication timeouts.
- Slack for authentication has been increased to 30s to account for heavy network traffic.
- Fixed logical error in determining authentication expiration time.
- Demoted Smartling Http errors from errors to warnings to prevent over-aggressive Horde notifications.
#rnx
#jira: UE-182142
#rb: trivial
#preflight: 642e1aa53670071d8324bbcb
#test: Ran a localization import job locally to verify that all authentication tokens are valid with a slack of 470s to simulate heavy network traffic. Ran a Horde job to ensure Setup Build ran successfully.

[CL 24951886 by leon huang in ue5-main branch]
2023-04-06 15:01:06 -04:00
leon huang
09eecdabde Localization: Introduced retry mechanism with exponential backoff for downloading files.
- The default timeout for HttpClient is 100s, this can result in certain files not being able to be downloaded in time. The httpResponse is never received. From experiments, it seems responses can take ~160s to respond during busier network traffic.
- Introduced retries up to 5 times with exponential backoff of multiples of 150s when requesteing the HttpResponse. First try is 150s, second is 300s etc
- Introduced authentication token refreshing. This cuts down the amount of time required to retrieve a new authentication token. Introduced to ensure that the token used after a retry will still be valid.
#jira: none
#rb: Jamie.Dale, Vincent.Gauthier
#preflight: 6425645f5e52099fe3c85006
#test: Ran UAT locally with teh Localize command. Timeouts of 150s seems to work within 2 tries of exponential backoff while downloading the files. No additional timeout exceptions have been encountered so far.

[CL 24868100 by leon huang in ue5-main branch]
2023-03-31 02:58:08 -04:00
leon huang
1778b31083 Localization: Updated Smartling to include some new directives.
- Updated downloads to only use published. The Smartling workflow will take care of publishing strings after each step. This is to emulate the "pending" behavior.
- Introduced the smartling.entity_escaping directive and set it to false for all files that are uploaded. This prevents  characters that resemble HTML tags from being escaped and garbling the translations.
#rnx
#rb: trivbial
#jira: none
#preflight: 64235f36b72410fc17f6533b

[CL 24831959 by leon huang in ue5-main branch]
2023-03-29 02:30:49 -04:00
leon huang
fe4f5afb3d Update Smartling integration to filter out UE FText placeholders.
The placeholders we use for FText are of the form {0} for positional argumens and {MyVariableName} as named arguments.
Smartling will flag those as warnings as potential placeholders and need to be manually reviewed. This feature will fix all the warnings and have all files to be uploaded have the directive applied to them.
#jira: FORT-541778
#rb: trivial
#preflight: 637e98b54364ef8d1493ce9b
#test Ran the BuildGraph command locally to make sure that UAt is able to compile properly

[CL 23258967 by leon huang in ue5-main branch]
2022-11-24 09:51:43 -05:00
leon huang
263ff88b8c Update Smartling localization to use Smartling namespaces to reduce duplicated strings and leverage the string sharing feature for Smartling.
#rb: trivial
#preflight: 637575d5ee4d25f90ac26a28
#jira: FORT-539764

[CL 23172512 by leon huang in ue5-main branch]
2022-11-17 00:29:21 -05:00
leon huang
ad320ef56b Update Smartling to download translations for files that are both in progress and published. This allows partial translations to still be used by the Engine.
#rb: trivial
#jira: FORT-528666
#preflight: none
#test: Ran BuildGraph locally for the "Localize UnrealEditor Release" target. Everything compiles fine but fix cannot be verified as localization data for 22.35 is not present yet.

[CL 22798379 by leon huang in ue5-main branch]
2022-10-26 19:08:08 -04:00
yiliang siew
9f9ccbedfc Comment out unused function for now since it is causing compilation errors/warnings.
#rb Leon.Huang
#preflight 63530bf23d41a4455ab24bde

[CL 22712186 by yiliang siew in ue5-main branch]
2022-10-22 15:35:54 -04:00
leon huang
5922fc3ee2 Smartling localization provider integration for Unreal Engine.
- Introduced the SmartlingLocalizationProvider abstract class to interface with Smartling backend for authentication, uploading and downloading of .po files.
- Subclasses of SmartlingLocalizationProvider can now be used as part of the Localize UAT command for automation.
#jira: none
#rb: Vincent.Gauthier, Jamie.Dale
#preflight: 632240dd506f1a33e0e3b52f

[CL 22030197 by leon huang in ue5-main branch]
2022-09-15 11:45:36 -04:00