Files
UnrealEngineUWP/Engine/Build/BatchFiles/Linux
Josh Adams 3f3c6fd578 Copying //UE4/Dev-Platform to //UE4/Dev-Main (Source: //UE4/Dev-Platform @ 3233741)
#lockdown Nick.Penwarden
#rb none

==========================
MAJOR FEATURES + CHANGES
==========================

[NOTE: Switch changes have been removed from this list, and will be in a comment in //UE4/Main/Engine/Build/Switch/SwitchChanges.txt]

Change 3207431 on 2016/11/22 by Keith.Judge

	Make VectorSign on XB1 match (incorrect) SSE implementation rather than the reference FPU implementation. Too many things seem to rely on this to change the default behaviour now.

	#jira UE-36921
	#jira UE-38560

Change 3208206 on 2016/11/22 by Josh.Adams

	- Changed plugins upgrading a content-only project to code-based, even if the modules inside aren't compiled for the current platform. There are issues with runtime not knowing the plugin isn't needed. The proper way is to non-whitelist the platform in the project, not in the modules, if you don't want it to upgrade the project. See the comments in this change for more info.
	#jira UE-38929

Change 3209137 on 2016/11/23 by Alicia.Cano

	Add a check to iOS tool chain for exception flag
	#jira UE-36528
	#ios

Change 3209296 on 2016/11/23 by Ben.Marsh

	Always send build failure notifications in Dev-Platform to Will.Fissler@epicgames.com and Owen.Stupka@epicgames.com

Change 3211316 on 2016/11/28 by Joe.Barnes

	Fix some typos

Change 3211318 on 2016/11/28 by Joe.Barnes

	Fix wrong function name in header file. Didn't match actual function name in RenderingThread.cpp

Change 3213227 on 2016/11/29 by Dmitry.Rekman

	Add -fPIC to libwebsockets on Linux.

Change 3213463 on 2016/11/29 by Nick.Shin

	helper build scripts for CentOS 7 Linux (via Docker)

	LINUX: pull source and compile: zlib openssl libcurl & libwebsockets

	using [ glibc 2.17 ]  & [ gcc 4.8.5 ]

	Docker creates an image (that is essentially a CentOS box) and runs the build script within that environment (called a container).  think of this as a VM -- but waaaaaaay better -- nothing is virtualized -- it's all on the metal.

	#jira UEPLAT-1246  -  Update libWebsockets
	#jira UEPLAT-1221  -  update websocket library
	#jira UEPLAT-1203  -  Add Linux library for libwebsockets
	#jira UEPLAT-1204  -  Rebuild libwebsockets with SSL

Change 3213939 on 2016/11/29 by Michael.Trepka

	Ignore parent widget's geometry scale when showing a popup menu in a separate window

	#jira UE-38706

Change 3215583 on 2016/11/30 by Josh.Adams

	Merging //UE4/Dev-Main to Dev-Platform (//UE4/Dev-Platform)

Change 3216345 on 2016/11/30 by Josh.Adams

	Better fix for poison proxy fix

Change 3217106 on 2016/12/01 by Michael.Trepka

	Fixed a crash caused by an attempt to use FPlayWorldCommands::GlobalPlayWorldActions before it's initialized when showing suppressable warning dialogs in UEditorEngine::UpdateAutoLoadProject()

	#jira UE-38816

Change 3217223 on 2016/12/01 by Josh.Adams

	- Fixed some TEXT macro warnings that crept in from IWYU changes

Change 3217253 on 2016/12/01 by Dmitry.Rekman

	Linux: fix GL crash (UE-17649).

	- Making sure all streams are set up. Fix by Cengiz.

Change 3217473 on 2016/12/01 by Daniel.Lamb

	Fixed a case when we load a map it might not have it's sublevels loaded because it's not treated like a map.
	#test cook run QAGame

Change 3217588 on 2016/12/01 by Peter.Sauerbrei

	Pull in IPv6 fix

Change 3217654 on 2016/12/01 by Michael.Trepka

	Changed the Mac-specific high DPI code to use system backingScaleFactor only if NSHighResolutionCapable in Info.plist is set to true. This solves the problem with macOS Sierra giving us actual backingScaleFactor values even in low DPI modes.

Change 3217873 on 2016/12/01 by Josh.Adams

	- Added some logging to a tvOS assert, since debugging it right away is tricky

Change 3218097 on 2016/12/01 by Josh.Adams

	- Fixed up the Switch MediaFramework, making editor better, etc
	- ALso changed PS4 and Xbox plugins to be enabled by default by having two entries in the plugin module for the Factory modules (an editor only entry, and a platform specific runtime entry... this will make it so that UE4Game.exe won't ahve it compiled in, even with it enabled by default)

Change 3218133 on 2016/12/01 by Dmitry.Rekman

	Linux: report server hangs by crashing the hung thread (UE-39164).

Change 3218512 on 2016/12/01 by Josh.Adams

	- Made the MfMedia plugin to be distributable in public builds, since it's for Windows and Xbox

Change 3219804 on 2016/12/02 by Dmitry.Rekman

	Linux: fix project settings crash (UE-38800).

	- Also submitted as a pull request #2945.

Change 3220027 on 2016/12/02 by Nick.Shin

	plow all physx libs into build

	NOTE: most browsers will not function
	- chrome and firefox nightly only works

	checking this in as per email

	#jira UE-38323 VehicleTemplate Vehicle does not move in HTML5

Change 3221620 on 2016/12/05 by Joe.Barnes

	UE-37275 - Temporary workaround for log lines losing carriage returns. Add's a \n when outputting lines if there isn't one at the end.

Change 3221689 on 2016/12/05 by Dmitry.Rekman

	Attempt to change/rename.

Change 3221700 on 2016/12/05 by Dmitry.Rekman

	Another attempt to change renamed file (from Linux).

Change 3221731 on 2016/12/05 by Michael.Trepka

	Added missing initialization for FAvfVideoSampler::MetalTextureCache

	#jira UE-38689

Change 3221792 on 2016/12/05 by Michael.Trepka

	Fixed a crash in FMetalDynamicRHI::RHIAsyncReallocateTexture2D for PVRTC2 textures

Change 3222675 on 2016/12/05 by Josh.Adams

	- Removed some resolution setting junk that was recently added to PlatformerGame - settings resolution on AppleTV is bad, it doesn't need to change resolution on non-desktop platforms
	#jira UE-39188

Change 3223546 on 2016/12/06 by Brent.Pease

	 + Properly set and use the realtime compression for ios.
	 + Reduce unused memory on ios from the precached first buffer
	 + Fix a resource tracking issue that was causing a double free on the sound buffer

Change 3223785 on 2016/12/06 by Brent.Pease

	 + Add support for iPhone7 (implemented by peter.sauerbrei, merged in from WEX)

	#jira ue-38701

Change 3224314 on 2016/12/06 by Chris.Babcock

	Send OnTargetPlatformChangedSupportedFormats when format changed in Android project settings in editor
	#jira UE-38361
	#ue4
	#android

Change 3225367 on 2016/12/07 by Josh.Adams

	- Added FKey::Virtual_Accept and Virtual_Back, which will map to FaceButton Right/Down appropriately based on platform (Switch swaps them)
	- Made changes to ShooterGame and VehicleGame for Virtual_Accept and Back
	- Added some icons for ShooterGame, and changed some text blocks to SRichTextBlock to insert the icons

Change 3225426 on 2016/12/07 by Chris.Babcock

	Add missing Android UPL file for binary builds
	#jira UE-39420
	#ue4
	#android

Change 3225471 on 2016/12/07 by Dmitry.Rekman

	Update all platforms to C++14.

Change 3225525 on 2016/12/07 by Nick.Shin

	Cook-On-The-Fly for HTML5

	- re-enabled: ENetworkFileServerProtocol::NFSP_Http

	- cleaned up port numbers used with cook-on-the-fly situations

	- fixed null_ptr in NetworkFileServerHttp.cpp

	- fix CORS issue with HTML5LaunchHelper (not really needed -- but doesn't hurt to have it in the test server)

	- finally, the core of the jira issue:
	  o fix serialization bug: do not append zero sized data
	  o fix de-serialization bug: removed double insertion of packet "Marker and Size" header

	#jira UE-38281 Quicklaunch UFE HTML5 fails to get COTF Header Size

Change 3225690 on 2016/12/07 by Dmitry.Rekman

	Linux: improvements in touch support.

	- Multiple fingers.
	- Filtering out "moved" events from the same location.
	- Consistent logging.

	(Edigrating 3225194 from Wombat to Dev-Platform)

Change 3225868 on 2016/12/07 by Josh.Stoddard

	Gracefully handle delete without matching new on iOS & Mac

	#jira UE-39395

Change 3226159 on 2016/12/07 by Omar.Rodriguez

	UEPLAT-1423 WEX: Improved virtual keyboard for Android

	* Renamed old virtual keyboard functions by adding "Dialog" suffix to the name
	* Added new virtual keyboard functions that use InputMethodManager to show/hide keyboard
	* Hide the virtual keyboard, if shown, onPause
	* Slate edit box decides which functions to call for showing/hiding keyboard
	  - eventually will be based on command line parameter like in IOS

	#jira UEPLAT-1423

Change 3226167 on 2016/12/07 by Dmitry.Rekman

	Allow running as root on ARM.

	(Edigrating 3204974 to Dev-Platform)

Change 3226168 on 2016/12/07 by Dmitry.Rekman

	Print current CVar value when denying an override.

	(Based on CL 3205476).

Change 3226169 on 2016/12/07 by Dmitry.Rekman

	Allow enabling sound (if disabled by default).

	(Based on CL 3205505)

Change 3226171 on 2016/12/07 by Dmitry.Rekman

	Allow running from symlinks.

	(Edigrating 3205518 to Dev-Platform).

Change 3226174 on 2016/12/07 by Dmitry.Rekman

	Linux: do not init SDL audio (we do not use it anyway).

	(Based on CL 3205505).

Change 3226327 on 2016/12/07 by Nick.Shin

	fix CIS warning

	#jira UE-38281 Quicklaunch UFE HTML5 fails to get COTF Header Size

Change 3226506 on 2016/12/08 by Dmitry.Rekman

	Fix one more case-sensitive misspelling (UE-39030).

	- Submitted as part of PR #2976.

Change 3226542 on 2016/12/08 by Dmitry.Rekman

	Linux: fix weirdness with tesselation in GL4 (UE-32865).

	- Workaround by CengizT. Proper fix tracked as UE-39489.

Change 3226570 on 2016/12/08 by Dmitry.Rekman

	Fix for ar failing due to too long command line (UE-39009).

	- Based on PR #2973.

Change 3226575 on 2016/12/08 by Dmitry.Rekman

	Add build-essential to dependencies (UE-39053).

	- PR #2981 contributed by cpyarger.

Change 3227129 on 2016/12/08 by Josh.Adams

	Merging //UE4/Dev-Main to Dev-Platform (//UE4/Dev-Platform)
	Fixed up a deferred GL error as well
	Fixed some copyrights of files not in main

Change 3227260 on 2016/12/08 by Omar.Rodriguez

	UE-39140 Projects with iCloud are failing provisioning check when code signing.

	* Set default value of bEnableCloudKitSupport to False
	* Set value of get-task-allow to true only on non-distribution builds
	* Only write out the entitlements file if changes have been made

	#jira UE-39140

Change 3229312 on 2016/12/09 by Dmitry.Rekman

	Fix missing responses (UE-39572).

	- Proper implementation of UE-39009.

Change 3230849 on 2016/12/12 by Dmitry.Rekman

	Linux: fixed Android packaging (UE-39635).

	- Misspelled case; fixed by JohnHenry Carawon.

	#jira UE-39635

Change 3231591 on 2016/12/12 by Peter.Sauerbrei

	fix for splash screen not being turned off by default
	#jira UE-39591

Change 3231880 on 2016/12/12 by Josh.Adams

	- Fixing StaticAnalysis warnings, but -enablecodeanalysis stopped working for some reason, and the /Zm thing has hit me really hard, so this is a hopeful checkin for static analysis issues
	#jira UE-39680

Change 3232816 on 2016/12/13 by Dmitry.Rekman

	Linux: fix for CEF (UE-39682)

	- Fix by Cengiz.Terzibas.

Change 3232873 on 2016/12/13 by Josh.Adams

	Merging //UE4/Dev-Main to Dev-Platform (//UE4/Dev-Platform)

Change 3232933 on 2016/12/13 by Josh.Adams

	- Missed the files that were needed to fix up after merge from main, but didn';t come from main

Change 3233066 on 2016/12/13 by Ben.Marsh

	UBT: Ignore exception if PATH variable contains invalid characters when looking for XGE.

Change 3233512 on 2016/12/13 by Ben.Marsh

	Fix static analysis warnings.

[CL 3233813 by Josh Adams in Main branch]
2016-12-13 19:47:16 -05:00
..

Build scripts for native Linux build

This document describes how to build Unreal Engine natively on a Linux host. The steps are described here are applicable to the current build, but you may want to visit https://wiki.unrealengine.com/Building_On_Linux for the latest updates on the process.

If you are stuck at some point, we suggest searching AnswerHub (https://answers.unrealengine.com/questions/topics/linux.html) for possible answers or asking a new question on there if you can not find what you are looking for. You may also receive help on #UE4Linux IRC channel on FreeNode, however it is not an official support outlet.

Prerequisites

The packages that are required to build the engine vary from distribution to distribution, and an up-to-date list should be maintained (and installed) by Setup.sh - feel free to suggest modifications. Automated install generally works for Ubuntu only.

Most important dependencies:

  • mono 3.x (2.x may work, but is not recommended), including xbuild and C# compiler (*mcs), and libraries for NET 4.0 framework.
  • clang 3.9.0 (clang 3.5 through 3.8 should also be able to compile the engine).

You will also need at least 20 GB of free disk space and a relatively powerful machine.

If you want to rebuild third-party dependencies (we don't recommend doing that any more), you will need many more development packages installed. Refer to BuildThirdParty.sh script and specific automake/CMake scripts for each dependency. You don't have to do that though as we supply prebuilt libraries.

Setting up/updating the sources

Setup has been simplified since the previous releases, and the additional binary files which are too large to be included into github repository are now being downloaded by GitDependencies tool with minimal hassle. After cloning the repository, you will need to run Setup.sh script which will invoke the said tool to download them. The tool will be registered as a post-merge hook, so later updates to binary files will be downloaded after each git pull.

How to set up the sources for building, step by step:

  1. Clone EpicGames/UnrealEngine repository

    git clone https://github.com/EpicGames/UnrealEngine -b release

  2. Run Setup.sh once.

    cd UnrealEngine

    ./Setup.sh

    The script will try to install additional packages (for certain distributions) and download precompiled binaries of third party libraries. It will also build one of the libraries on your system (LinuxNativeDialogs or LND for short).

    You should see ** SUCCESS ** message after running this step. If you don't, take a look into BuildThirdParty.log located in Engine/Build/BatchFiles/Linux directory.

  3. After the successful setup, you can generate makefiles (and CMakelists.txt).

    ./GenerateProjectFiles.sh

Updating the sources later can be done with git pull. The tool to download binary files will be registered as a post-merge hook by Setup.sh, so third party libraries will be updated automatically (if needed). If you ever need to run it directly, it can be found in Engine/Binaries/DotNET/ directory (GitDependencies.exe, which needs to be invoked through mono).

Building and running

GenerateProjectFiles.sh produces a number of "project" files, including Makefile, CMakeLists.txt which you can use to import the project in your favorite IDE and qmake project file. Both QtCreator and KDevelop 4.6+ are known to handle the project well (although the latter takes about 3-4 GB of resident RAM to load the project).

The targets match the name of the resulting binary, e.g. UE4Editor-Linux-Debug or UE4Game. You can build them by just typing make in the engine's root folder.

4.8 and later versions have simplified building the editor by providing makefile targets "StandardSet" and "DebugSet", the former being the default. You can now just type

make

to build the editor. Alternatively, build the following targets:

make CrashReportClient ShaderCompileWorker UnrealLightmass UnrealPak UE4Editor

If you intend to develop the editor, you can build a debug configuration of it:

make UE4Editor-Linux-Debug

(note that it will still use development ShaderCompileWorker / UnrealLightmass). This configuration runs much slower.

If you want to rebuild the editor from scatch, you can use

make UE4Editor ARGS="-clean" && make UE4Editor

In order to run it:

cd Engine/Binaries/Linux/
./UE4Editor

Or, if you want to start it with a specific project:

cd Engine/Binaries/Linux/
./UE4Editor "~/Documents/Unreal Projects/MyProject/MyProject.uproject"

You can also append -game if you want to run the project as a game (you can also do that from the running editor).

Notes

Depending on mono version and some other not yet clarified circumstances (this may be relevant: http://stackoverflow.com/questions/13859467/ravendb-client-onlinux-connecting-to-windows-server-using-mono-http), binary downloader tool invoked by Setup.sh may fail. In that case, Setup.sh will keep re-running it until it succeeds (or at least stops crashing). You may want to keep an eye on this as there is a slight possibility of the script getting stuck in an infinite loop if the tool keeps crashing.

On the first start, the editor will be "compiling shaders" (a bit misleading terminology, it will be converting them to GLSL). The result will be stored in Engine/DerivedDataCache folder and used for subsequent runs.

Depending on the project, the editor may need rather large number of file handles (e.g. 16000+). If you start seeing errors about not being able to open files, you may need to adjust your limits.

It is advised that you install the editor on a case insensitive filesystem if you intend to open projects from other systems (OS X and Windows), or Marketplace. JFS formatted with -O option seems to be the best solution.

The time it takes to build the editor in development configuration can be large, debug configuration takes about 2/3 of this time. The build process can also take significant amount of RAM (roughly 1GB per core).

It is also possible to cross-compile the editor (currently from Windows only). You may use this route if your Windows machine happens to be more powerful, but explanation of it is beyond the scope of this document.