Commit Graph

356 Commits

Author SHA1 Message Date
Josh Adams
1e6ed89565 - Frameworks working on Mac with Modern Xcode just like IOS frameworks
- Update frameworks with a Framework mode to differentiate between linking with it and copying to .app (in case of a static lib framework, or load-only dylib
- Updated CEF3 to work as a normal framework (if we have a universal framework binary, it would be simpler, because LoadInMain() would work without any paths)
#rb roman.dzieciol
#preflight 643484117536ac6b78ae7ce3

[CL 24985043 by Josh Adams in ue5-main branch]
2023-04-10 18:08:40 -04:00
Josh Adams
4c3471b8a7 - After staging, Modern xcode projects will build with stub xcode project to generate a complete .app in the root of the staging directory (tested Mac and IOS)
- Fixed up scripts for copying files into mac .app with modern xcode
- Changed bIncludeEngineSource being false to not remove game/samples/mods/etc from projects (only stub xcode projects set it to false, afaict)
#rb zack.neyland
#preflight 642cc4c21d19c0312af476c0

[CL 24922909 by Josh Adams in ue5-main branch]
2023-04-04 20:54:06 -04:00
danny couture
3782e2df04 Fix monolithic editor linux builds that are extremely large because debug symbols are not split properly
#rnx
#rb Brandon.Schaefer
#preflight 642abcf1da7f958370d8ad31

[CL 24891106 by danny couture in ue5-main branch]
2023-04-03 08:18:56 -04:00
Joe Kirchoff
79b7bd19d3 C++20 fixes
#rnx
#preflight 64276ce42a0b706ac6bc5400

[CL 24881643 by Joe Kirchoff in ue5-main branch]
2023-03-31 19:56:46 -04:00
robert millar
240c37b769 Link natvis files from module directories into binary debug info.
#rb joe.kirchoff

[CL 24824604 by robert millar in ue5-main branch]
2023-03-28 15:31:18 -04:00
brandon schaefer
547593db87 Move to adding a TargetRules bool for using AutoRTFM Compiler
#rb Neil.Henning
[FYI] Michael.Nicolella
#preflight 6421fdc6973e609670b97622

[CL 24824162 by brandon schaefer in ue5-main branch]
2023-03-28 15:14:44 -04:00
Josh Adams
e449e43c2a - Updating making Mac builds with modern xcode to stage files into the .app via xcode
- Mac and IOS both now run a script in Xcode to rsync from StagedBuilds into the .app
- Mac now generates and runs the xcode project after building (PostBuildSync like IOS) to codesign and pull in staged data, using a new ApplePostBuildSync class to share with IOS
- Added a SingleTarget mode to XcodeProjectGenerator to make a minimal project for PostBuildSync
#rb zack.neyland
#preflight 641a7276bb1320be4166c3fc

[CL 24745546 by Josh Adams in ue5-main branch]
2023-03-22 07:24:29 -04:00
joe kirchoff
88c89989cd UnrealBuildTool: Update -Deterministic to not have a per module setting as this doesn't work due to PCH requirements and instead add a setting to control warning level
#rb Henrik.Karlsson

[CL 24647188 by joe kirchoff in ue5-main branch]
2023-03-14 19:43:44 -04:00
mic rooney
8d82fa54b6 Allowing UBT to build individual plugins as though they were local.
* Also reverting a previous change that was building the whole project when adding new plugins.

#jira UE-171182
[REVIEW] [at]Josh.Adams, [at]Joe.Kirchoff
#preflight 640f5e7380540a5a36edb89d

[CL 24641918 by mic rooney in ue5-main branch]
2023-03-14 15:24:13 -04:00
james singer
38043bb2a0 Provide option to disable dump_syms where iteration speed is desirable. (-NoDumpSyms or set bDisableDumpSyms)
#jira UE-177205
#preflight 640a062228026468d9d37cf8
#review-24547341 @Brandon.Schaefer
#rb Brandon.Schaefer

[CL 24576891 by james singer in ue5-main branch]
2023-03-09 11:27:20 -05:00
bryan sefcik
1ad98523c4 Added support to give actions in UBT "weight". "Weight" is an average measurement of how many cores and memory an action uses. Using one core with a normal amount of memory for an action would be a value of 1.
Why do this:
Currently when compiling a cpp file with MSVC, it compiles across multiple cores while clang does not. This means that while we support limiting the number of cores(using ProcessorCountMultiplier), MSVC will use more cores than we specify. It also means that MSVC will always be faster when compiling because clang does not support compiling a cpp over multiple cores. To get similiar results when compiling with clang, we set the weight of MSVC to 1.5 and the weight of clang to 1.0. We then set the ProcessorCountMultiplier to 1.5. This results in MSVC and clang taking roughly the same amount of CPU utilization and clang compiles to be much faster.

	                     Old Timing(secs)	Old CPU Utilization	New Timing	New CPU Utilization(secs)
PlatformA AncientGame	590.94	51	                               431.47	73
MSVC AncientGameEditor	1016.96	94	                             1026.08	95
Clang AncientGameEditor	1543.72	63	                               1270.4	84
PlatformB AncientGame	494	52	                               396.95	74

Old = without weight path
New = with weight path

#jira
#rb christopher.waters, joe.kirchoff
#preflight 6409026c8832f48a4dc72025

[CL 24567859 by bryan sefcik in ue5-main branch]
2023-03-08 17:08:22 -05:00
Andrew Scheidecker
02f9686b0f Fix ClangToolchain omitting global compiler options from the command line on platforms that don't use a shared response file.
#jira none
#rb Joe.Kirchoff
#preflight 6408d6096c1b9295b9bddca7

[CL 24564056 by Andrew Scheidecker in ue5-main branch]
2023-03-08 13:59:38 -05:00
Joe Kirchoff
04b2b155bc UnrealBuildTool: Make CStandard enum consistent with CppStandard
#rnx
#preflight 6407c690c13b7130d276f1b8

[CL 24551440 by Joe Kirchoff in ue5-main branch]
2023-03-07 18:41:02 -05:00
joe kirchoff
1ad009dd27 UnrealBuildTool: Stash shared paths in the CppCompileEnvironment after creating a shared response file so those paths can still be used for validation
#rnx
[FYI] Henrik.Karlsson

[CL 24493752 by joe kirchoff in ue5-main branch]
2023-03-02 20:29:33 -05:00
bryan sefcik
b0205aeefa Added another possible fix for SNDBS when using PCH chains.
#preflight 63fe91bb30633435f8cbf742

[CL 24455007 by bryan sefcik in ue5-main branch]
2023-02-28 19:02:35 -05:00
swarm
b61361facf Secondary remote Mac
#jira UE-120589
# rb josh.adams
#preflight 63f2da7d90198dffbaaee3ff

[CL 24309059 by swarm in ue5-main branch]
2023-02-19 21:45:46 -05:00
bryan sefcik
1cc61ecdd1 Possible fix for android having issues with PCHs
[CL 24253388 by bryan sefcik in ue5-main branch]
2023-02-16 04:16:25 -05:00
bryan sefcik
0ef675123b Possible fix for SNDBS when compiling with PCH chains.
#jira
#rb joe.kirchoff
#preflight 63ed1d817d2ec3d2fd4c3452

[CL 24251837 by bryan sefcik in ue5-main branch]
2023-02-16 02:02:35 -05:00
henrik karlsson
dceb9f0713 [UnrealBuildTool]
* Fixed so -SingleFile includes running prereq actions if they are not up to date.

#preflight skipped
#rb joe.kirchoff
#jira none

[CL 24239919 by henrik karlsson in ue5-main branch]
2023-02-15 15:31:40 -05:00
joe kirchoff
3c3baf04d1 UnrealBuildTool: Return target file from GetCompileArguments_FileType rather then getting it from the ProducedItem list
#rnx
#rb trivial
#preflight 63e6875a211c20974fefc76f

[CL 24136563 by joe kirchoff in ue5-main branch]
2023-02-11 12:26:49 -05:00
henrik karlsson
0573c9a222 [UBT]
* Changed so clang single file placeholder action is not having any produced items.. this means that ubt modes that looks for produced items won't find anything on the placeholder actions

#preflight skipped
#rb joe.kirchoff

[CL 24136526 by henrik karlsson in ue5-main branch]
2023-02-11 12:26:10 -05:00
henrik karlsson
8035d32fe0 [UBT]
* Disabled -SingleFile option when building for multiple architectures at once... this can be implemented if someone needs it but require a bit of work
* Enabled -SingleFile option for apple platforms

#preflight skipped
#rb zach.neyland
#jira none

[CL 24129855 by henrik karlsson in ue5-main branch]
2023-02-10 18:36:33 -05:00
zack neyland
b1ecff88d2 UBT: AppleToolChain temporary workaround for failing builds.
-SingleFile=... will not work for the time being, but this at least resolves horde build failures.

#jira UE-176814
#preflight na

[CL 24128134 by zack neyland in ue5-main branch]
2023-02-10 17:06:40 -05:00
bryan sefcik
592942fad7 Added support for Clang PCH chaining
https://clang.llvm.org/docs/PCHInternals.html#chained-precompiled-headers

Linux - EngineTestEditor -allmodules
Before:
Total PCH Size: 3.41 GB

After:
Total PCH Size: 2.65 GB

#jira
#rb joe.kirchoff
#preflight 63e57da9636f66aac7dc1818

[CL 24114121 by bryan sefcik in ue5-main branch]
2023-02-09 22:37:30 -05:00
henrik karlsson
5f74d114d5 [UBT]
Changed how single files are built. We don't want to invalidate makefile everytime we build single files since it destroys turnaround times. With this change a single file compile can take 2s (+ the actual compile time).

The new behavior injects a special action per module when creating the makefile. These actions can be used to on-the-fly create a proper compile action that follows the rules of the module that the specific file belongs to.. In a normal build these actions are ignored since the logic deciding which actions to build is backtraced from which binaries we want to create.

When a specific file compile is triggered, the logic deciding which files to build search up all these special actions and create a lookup based on which folders the special actions handle. It then try to find the special action that handles the specific file. The matching special action then creates a compile action that can handle that specific file and then queue up the action for execution. If no special action is found it falls back to try to use actions that have this specific file as input (ispc files for example)

Details:
* Removed lots of custom code for "specific files" handling
* Changed so pch (both private and shared) always use definition file. Added #pragma once and change so pch wrapper file include definition file. This made the adaptive path and specific file easy to implement (just disable pch in compile environment and it will just work)
* Added SingleFileAction for both VCToolChain and ClangToolChain. It now works to compile specific headers and cpp files. (It creates wrapper files on the fly to be able to compile all header files (compiling headers directly blow up if there are circular includes)
* Fixed so GenerateClangDatabase mode works with new changes
* Moved the logic that makes sure all (directly) depending cpp files are recompiled when .h are included in the singlefile option

#preflight 63dcc46f78716a01e8069649
#rb joe.kirchoff

[CL 24094027 by henrik karlsson in ue5-main branch]
2023-02-09 04:20:43 -05:00