* Another batch iwyu updates to reduce number of includes used in files
#preflight 63c58d742e714f64ade93797
#rb none
[CL 23732856 by henrik karlsson in ue5-main branch]
This represents UE4/Main @17774255, Release-5.0 @17791557 and Dev-PerfTest @17789485
[CL 17794212 by aurel cordonnier in ue5-release-engine-test branch]
#rb Justin.Marcus
#ROBOMERGE-SOURCE: CL 11064634 via CL 11064641 via CL 11064653
#ROBOMERGE-BOT: (v637-11041722)
[CL 11064661 by hongyi yu in Main branch]
tested by packaging for desktop and HTML5
#jira UEMOB-482 HTML5 as a platform extension
#rn
#rb none
#fyi josh.adams
[CL 9542570 by Nick Shin in Main branch]
Change 8553543 by Wes.Fudala
We now set a fixed value of 24 to CEF screenInfo colorDepth when off screen rendering is enabled.
Change 8235770 by Wes.Fudala
Fix for CEFJsScripting memory stomp and memory alignment errors called out by the stomp memory allocator when running with -stompmalloc on the commandline.
Change 8065597 by Leigh.Swift
BuildPatchServices: Improving ChunkBuildDirectory behaviour when dealing with empty build or builds only containing empty files.
This is now fully supported as part of the generation flow rather than an early detected edge case.
Change 7641628 by Leigh.Swift
BuildPatchServices: Tweaks to serialisation safety.
BuildPatchServices: DiskChunkStore fix for crash when chunkdump serialisation fails due to disk space.
Change 7436869 by Leigh.Swift
BuildPatchServices: Fix regression in BPT package chunks for cloud save improvements now require message pumping.
Change 7326553 by Wes.Fudala
BuildPatchServices: Attempt to restore functionality of the -SkipBuildPatchPrereq commandline. This stopped functioning in CL# 6655502 with the BPS DLC related refactors.
The issue was reported by a number of users that were relying on this commandline as a last resort workaround for prereq install issues.
Change 7323945 by Leigh.Swift
BuildPatchServices: BuildPatchTool: Install time coefficient values exposed by DiffManifests.
This gives an indicative install duration.
The time is not necessarily accurate, but the simulation is a constant and so the value is highly comparable between different builds.
Change 7310352 by Antony.Carter
BuildPatchServices: Adding support for overriding http path for chunk requests. This allows the ability to support signed urls when downloading patch data.
Change 7095282 by Leigh.Swift
BuildPatchServices: Fix regression with manifests that have no core files.
Change 7092198 by leigh.swift
BuildPatchServices: Reuse existing code from FBuildPatchAppManifest::GetChunkShaHash in FBuildPatchManifestSet::GetChunkShaHash.
This fixes an issue where older manifest files that did not ship with chunk sha values in them, can skip sha validation of chunks like pre-DLC launcher did.
Change 6959115 by Wes.Fudala
Added functionality that will optionally expose embedded browser console logs to the client.
Change 6835841 by Leigh.Swift
BuildPatchServices: Rearranging manifest save logic to avoid unnecessary seeking forwards, which avoids an assert when undetected write failures occur.
Change 6684994 by Leigh.Swift
BuildPatchServices: Don't clean empty directories if staging only.
Change 6655502 by Mike.Erickson, Leigh.Swift, Wes.Fudala
BuildPatchServices: Restructuring how installers are configured and make use of manifest files in order to combine multiple actions on an installation directory into one installer.
This resembles a feature set for a better DLC installation experience.
Change 6404031 by Richard.Fawcett
BuildPatchTool: Only append ".manifest" to output filename if output filename has been specified on the command line.
This was causing a manifest file called literally ".manifest" to be output to the clouddir if -OutputFilename was not specified.
Change 6077240 by Wes.Fudala
Execution of browser resource load complete delegate now happens on the main thread.
Change 6076171 by Leigh.Swift
BuildPatchTool: PatchGeneration: ChunkDeltaOptimise: PackageChunks: Improved corrupt output protection against ill timed taskkill, by serialising to temp filename, and then rename on success.
BuildPatchTool: PatchGeneration: Manifest file extension added if not provided, fixing an oversight and inconsistency with other mode behaviours.
BuildPatchTool: Compactify: Only warn when failing to get a file size, if the file still exists. Otherwise log instead.
Change 6049003 by Leigh.Swift
BuildPatchServices: Adding ProcessRequiredDiskSpace to Launcher.Install.Stats which represents how much disk space the install/update process needed to complete.
BuildPatchServices: Adding ProcessAvailableDiskSpace to Launcher.Install.Stats which represents how much disk space was available at the time of checking required disk space.
Change 5915157 by Leigh.Swift
BuildPatchTool: Adding a statistic to diffmanifests for temporary disk space requirement to apply the patch.
Change 5934838 by Leigh.Swift
BuildPatchTool: PackageChunks: Adding support to provide a tagset for the previous build manifest when producing chunkdbs. This allows expanding the chunks saved out to cover tagsets not installed in the previous build.
Change 5838666 by wes.fudala
Browser can now bubble up the state of completed web resource loads.
Change 5689493 by Leigh.Swift
Adding new x86 and x64 MS VC141 CRT redist, version 14.16.27012
Change 5689462 by Leigh.Swift
Fixing process handle leaks on windows.
Core was leaking for getting an application name.
Change 5500917 by Leigh.Swift
BuildPatchTool: Adding new arg DiffAbortThreshold to ChunkDeltaOptimise mode which allows skipping of the operation if the original delta is so large that it would take too long to process, and likely have little benefit.
BuildPatchTool: Switching some Log output to use Display so that it will appear in EC and CMD windows.
Change 5337482 by Leigh.Swift
BuildPatchTool: Fix for DiffManifests mode not accurately representing delta size for tagged install sets.
Change 5261246 by Leigh.Swift
BuildPatchServices: Fix for file download needing to mock response codes for higher layer statistics code which tracks data sizes and speeds.
This is a regression from previous change to correct download failure vs corruption statistics.
Change 5224725 by Leigh.Swift
BuildPatchServices: Fix for delta download of more than 0 bytes when no update is necessary.
BuildPatchServices: Skip requesting delta metafile if no file changes are actually required for a patch.
BuildPatchTool: Reduce unnecessary data produced by BPT ChunkDeltaOptimise mode.
Change 5010941 by Mike.Erickson
BuildPatchServices: Add download scaling based on average speed per request, maximum count, and download health.
Change 5010845 by Wes.Fudala
BuildPatchServices: IDownload refactored to have specific request and response success functions, to make it clearer that a successful request does not mean the response was also good.
BuildPatchServices: Fixed issues with download failures reporting as corruptions.
Change 5000643 by Wes.Hunt
Remove HttpServiceTracker from UE4.
Change 4884381 by Leigh.Swift
BuildPatchTool: Fix for Package Chunks mode hanging when no chunks were required.
Change 4848675 by Justin.Sargent, Leigh.Swift
Speculative fixes for graphics device lost related crash, by adding additional d3d api result checks.
Improved logging for graphics device lost handling.
Improved logging for tracking down common font loading failure resulting in an ensure.
Change 4831134 by Leigh.Swift
BuildPatchTool: Fix for crash in patchgeneration when fast-forward path replays no match.
Change 4801714 by Wes.Fudala
Fix for CEF issue encountered when building using Mac Mojave + XCode10.
Change 4719149 by Leigh.Swift
BuildPatchTool: PatchGeneration mode cyclic data optimisation, reduces SHA calculation requirement counts for cyclic data.
BuildPatchTool: PatchGeneration mode fix for a bug causing non-optimal match insertion idx searching when there are 10k+ matches per scanner.
Change 4680963 by Leigh.Swift
BuildPatchTool: ChunkDeltaOptimise mode is now FeatureLevel upgrade / downgrade aware.
Change 4680947 by Leigh.Swift
BuildPatchTool: Compactify speed improvements for massive network cloud directories.
Change 4656991 by Leigh.Swift
BuildPatchServices: Make sure chunk writer robustly discovers if a chunk fails to save out.
Change 4647815 by Leigh.Swift
Upping the minimum wait time for UdpMessageBeacon thread so that it will not always wait 0ms when network sends are failing, reducing disconnect CPU usage.
Adding configurable tick rate logic to XmppConnectionJingle thread. It will now default to 100Hz max.
Change 4627355 by Michael.Trepka
Fixed a problem with CEF being unable to find locale pak files on Mac for certain language/region combinations
Change 4620800 by Leigh.Swift
Fix for CEF crash when disabling a web window that has not yet got a parent window. There's no need to worry about focus in this case.
Change 4590207 by Leigh.Swift
BuildPatchTool: PackageChunks mode now supports FeatureLevel arg
Change 4590103 by leigh.swift
BuildPatchTool: Adding new mode ChunkDeltaOptimise which reducing the download size when patching between two specific builds in a specific direction.
BuildPatchTool: Updated Enumeration, DiffManifests, Compactify, PackageChunks, and VerifyChunks modes to take account of new delta data.
BuildPatchServices: Installers now have a single shared memory chunk store, which reduces the requirement for booting
Change 4590089 by Leigh.Swift
BuildPatchTool: Adding new mode ChunkDeltaOptimise which reducing the download size when patching between two specific builds in a specific direction.
BuildPatchTool: Updated Enumeration, DiffManifests, Compactify, PackageChunks, and VerifyChunks modes to take account of new delta data.
BuildPatchServices: Installers now have a single shared memory chunk store, which reduces the requirement for booting
Change 4341076 by Leigh.Swift
BuildPatchServices: Making FBuildPatchAppManifest::GetRemovableFiles more robust to handle directories with or without trailing slash.
Change 4331754 by Leigh.Swift
BuildPatchTool: Added support for selecting ChunkWindowSize when generating patches.
BuildPatchTool: Added support for providing the FeatureLevel command-line argument to indicate the data version that should be saved out by patch generation. This warns about defaulting to LatestJson if not provided.
BuildPatchTool: Added support for generating patches with recognition for any chunks with any ChunkWindowSize found in the provided CloudDir.
BuildPatchTool: Added command-line -IgnoreOtherWindowSizes param which if provided, the generation code will only accept chunk matches that are the same as ChunkWindowSize.
BuildPatchServices: Fixes for supporting installations that use any ChunkWindowSize.
BuildPatchServices: New manifest file format to reduce file size, this is now raw compressed binary data.
#lockdown Nick.Penwarden
#rb none
[CL 8675597 by Leigh Swift in Main branch]
#rb none
#lockdown Nick.Penwarden
============================
MAJOR FEATURES & CHANGES
============================
Change 4247640 by Daniel.Lamb
BuildPatchTool: PackageChunks: Fixed issue with filenames not being set for chunkdbs in particular cases where the chunkdbs were small.
Change 4247246 by Leigh.Swift
BuildPatchTool: Adding support to BPT PackageChunks to filter by tagsets, and also split chunkdb output by them too.
Change 4173518 by Wes.Fudala
WebBrowser: Adding support to enable allowing net security expirations.
Change 4102451 by Leigh.Swift
BuildPatchTool: PackageChunks: Adding tool mode JSON output for listing created chunkdb files.
Change 4099951 by Leigh.Swift
BuildPatchTool: PackageChunks: Adding PrevManifestFile commandline support to BPT PackageChunks mode, allowing us to generate chunkdbs that only cover data required to perform an update.
Change 4051406 by Leigh.Swift
BuildPatchServices: Update default number of simultaneous downloads for an installer to 16 which is now well proven in the wild.
Change 4036807 by Leigh.Swift
BuildPatchServices: Added new message type for receiving updates about which files have been touched by the installation.
BuildPatchServices: Cloud enumeration is now threaded to improve speed.
Change 4036477 by Richard.Fawcett
Thirdparty: AWSSDK: Update AWS SDK to version 3.3 as speculative fix for object is used after being disposed error.
Confirmed this exception is being raised from within the AWS SDK, and _not_ in Epic code.
Advice by Amazon on AWS forums for people experiencing this exception is always to update to the latest version of the SDK in the first instance.
Change 3922493 by Justin.Sargent
Runtime: Added shortcircuit support to the ExpressionParser. More documentation to come.
AgreementExpressionEvaluator has been updated to use the shortcircuit logic so it now processes expressions lef to right as expected in all cases.
AgreementExpressionEvaluator was also updated to perform evaluation as a two pass system. The tow pass solution prevents over prompting eulas in certain scenarios where the expression would ultimately resolve true without them.
Change 3983713 by Barnabas.McManners
BuildPatchServices: Fix for verification logging error counts for unique runs. Solved the issue by using an external cache of the errors encountered each run to deduct from the total. Reporting only the delta.
Change 3966915 by Wes.Fudala
WebBrowser: CEF: Potential fix for a rare issue encountered when we attempting to release resources outside of the game thread.
Change 3955168 by Justin.Sargent
BuildPatchServices: Updated primary messaging of overall install status to now display Updating when patching an existing installation rather than Installing.
Change 3954610 by Leigh.Swift
BuildPatchServices: Fixing issue with Cloud Chunk Source which would erroneously conclude that it needed to re-download a chunk due to external system failure.
There is now an explicit concept of 'lost chunk' which is tracked and bubbled up by the system errors that cause the loss in the first place, so that each source knows exactly when it should be required to retrieve a chunk that it had already retrieved previously. Being explicit, these lost chunks can also now contribute to the total download required stat.
Also fixing some tracking that was missing to update the total download required stat if a local Install Chunk Source failed to load data from the files on disk and so these chunks needed to be additionally downloaded.
Change 3947928 by Chad.Garyet
UAT: Changing commandutils to attempt to find the Win8.1sdk signtool before the win10 one. There's currently a bug related to vs2017/server2012r2/win10sdk signtool that causes it to exit with an undefined error when signing from a service account. Using the win8.1sdk circumvents this issue.
Change 3942776 by Rob.Cannaday
Http: Fix for Mac sending up duplicate header strings
Change 3940306 by Leigh.Swift
BuildPatchServices: Refactor to isolate CoreUObject dependency and be able to compile out usage.
Change 3936655 by Justin.Sargent
Slate: Changed the invalid fontcache ensure in ShapedTextCache from always to only once to reduce ensure spamChange 3917840 by Leigh.Swift
BuildPatchTool: DiffManifests mode now also saves info for New, Removed, Changed, and Unchanged file to the output json file.
Change 3911756 by Justin.Sargent
WebBrowser: SWebBrowserView now ensures that it has a valid pointer to it's parent window in it's onpaint to avoid issues with the first frame being scaled incorrectly due to not being able to access the parent windows dpi scaling.
Change 3906670 by Justin.Sargent
Slate: Change the ShapedTextCache to hold a weakptr to the Slate FontCache instead of a reference. This will allow it to detect if the FontCache has become invalid since it was linked with the ShapedTextCache, thus making it able to avoid crashing.
Change 3889008 by Justin.Sargent
StandaloneRenderer: Made the SlateD3DRenderingPolicy more resilient to graphics device errors.
Change 3886969 by Justin.Sargent
StandaloneRenderer:Changed SlateD3DConstantBuffer to no longer check on a D3DDevice failure and instead soft fail, so the application can go through the process of attempting to re-establish the D3DDevice.
Change 3886960 by Justin.Sargent
WebBrowser: Made CEFWebBrowserWindow more resilient to issues with creating textures.
Change 3855821 by Barnabas.McManners
BuildPatchServices: Added logging of the configuration to the start of all installs.
Change 3839245 by Wes.Fudala
WebBrowser: Adding support for web browser drag regions. These are areas of a page tagged with -webkit-app-region: drag or -webkit-app-region: no-drag. The application can now pass a handler function to the browser to handle window drag events. This handler will be called if the browser detects mouse drag events inside of a tagged drag region.
Change 3835225 by Jacob.Hedges
Slate: Fix for SScrollBarTrack size issue
Change 3824320 by Wes.Fudala
WebBrowser: Fix for reported deadlock in WebBrowserSingleton. Associated with github pull request #4303.
#jira UE-53420 GitHub 4330 : Fixed deadlock in FWebBrowserSingleton
#4303
Change 3811191 by Barnabas.McManners
BuildPatchServices: Expanded MF01-X into MF01-X-X and MF02-X where X is the os error codes
Change 3807662 by Barnabas.McManners
BuildPatchServices: Broke down build verification errors into 4 new cases.
Change 3805698 by Leigh.Swift
BuildPatchServices: Speculative fixes for Unit test crashes / failures.
Change 3804175 by Wes.Fudala
ThirdParty: CEF: Adding browser locale pak files for es-MX, and es-ES as the typical mapping/fallback does not seem functional on mac browser. They are copies of es_419 and es respectively.
Change 3786628 by Leigh.Swift
WebBrowser: Exposing ability to customise tool tip widgets produced from SWebBrowserView.
Change 3775678 by Richard.Fawcett
BuildPatchServices: Allow a Prerequisite install only mode.
Change 3774365 by Justin.Sargent
BuildPatchServices: Updated Build Stat report that is logged after every installation to use FText::AsMemory instead of the UnitConversion logic, and now it outputs multiple unit types for convenience.
Change 3774361 by Justin.Sargent
Http: Remove Pragma: no-cache header from libcurl requests
Change 3774258 by Leigh.Swift
BuildPatchServices: Fix for destructive patch destroy files that contain useful data.
Change 3766156 by Barnabas.McManners
Http: Various lower changes to enable Hardware testing and to enable proxy configuration.
Change 3756723 by Leigh.Swift
BuildPatchServices: Hooking up disk chunk store operation states to the installer statistics.
BuildPatchServices: Memory chunk store statistics fix for booted chunks that have been reloaded.
Change 3756320 by Rob.Cannaday
Http: Add default headers added to every HTTP request.
Change 3741274 by Wes.Fudala
WebBrowser: Release CEF related references prior to CEF shutdown.
Change 3738003 by Leigh.Swift
BuildPatchServices: Fix-ups for install stats when failures are occurring
NumFilesOutdated now only set on first run, so it is not set to the number of files that are retried.
Total downloaded data and total download requirement stats fixed up for runtime as well as final values.
Initial chunk counters now only set for first run.
Moving the GetBytesDownloaded api from cloud source to download service so that it correctly accumulates.
InstallSource was multiply attempting, and counting, recycle failures, throwing that stat out of proportion.
Change 3729851 by Barnabas.McManners
BuildPatchServices: Changed the installer's MoveFile method to default to not retry. We currently only have uses of move file which already handle retry.
Change 3725611 by Leigh.Swift
Core: FText::AsMemory - Fix for numerical edges.
Added unit tests to check all edges up to full uint64 range.
Change 3725127 by Leigh.Swift
BuildPatchServices: ManifestDiff: Correcting string format padding for new data size output uints.
Change 3725126 by Leigh.Swift
Core: FText::AsMemory fix. Shifting (equivalent of divide 2 per shift) does not work for calculating SI units which are base 10.
Change 3721926 by Justin.Sargent
ThirdParty: LibCurl update performed by Simon Tourangeau.
We now have 100MB/sec download speed with libcurl on Win64, compared to 3MB/sec originally
Change 3700670 by Michael.Trepka
SlateReflector: Fixed mouse click highlighting in Widget Reflector's Demo Mode in high DPI
Change 3697526 by Leigh.Swift
BuildPatchServices: Exposing a suite of runtime statistics for BuildPatchInstallers.
Change 3686439 by Leigh.Swift
BuildPatchServices: Stop installers from always logging a shutdown error on destruction. This should only occur if the installer is actually running.
Change 3684747 by Leigh.Swift
BuildPatchTool: Fix file ignore list to parse using platform agnostic method.
Change 3643038 by Michael.Trepka
Core: Don't defer Cocoa calls in FMacWindow Show and Hide to make sure both actions complete before we exit these functions. This solves the problem with the blocks being called after window was destroyed.
Change 3639692 by Michael.Trepka
Fixes for a couple of issues found by address sanitizer
Change 3625568 by Leigh.Swift
BuildPatchServices: Fixing numerical limits problem with double -> uint64 in FStatsCollector::SecondsToCycles().
Change 3617948 by Leigh.Swift
BuildPatchServices: Disk space requirement can now be lower when patching if destructive patch mode is enabled. This mode will delete existing old files once they are not needed.
BuildPatchServices: Adding new installation mode setting on installer config.
BuildPatchServices: If destructive installation mode is enabled, the file constructor will delete old existing files after completing the new one.
BuildPatchServices: Adding missing file path length check for install location to cover situation where staging directory is outside the install directory.
Change 3593632 by Leigh.Swift
BuildPatchServices: Adding additional installation tracking to BuildPatchServices. See Engine/Source/Runtime/Online/BuildPatchServices/Public/Interfaces/IBuildInstaller.h
[CL 4273704 by Leigh Swift in Main branch]
