Files
UnrealEngineUWP/Engine/Source/Runtime/StreamingFile/Public/StreamingNetworkPlatformFile.h
Robert Manuszewski 301e5763c2 Copying //UE4/Dev-Core to //UE4/Dev-Main (Source: //UE4/Dev-Core @ 3228803)
#lockdown Nick.Penwarden
#rb none

==========================
MAJOR FEATURES + CHANGES
==========================

Change 3209807 on 2016/11/24 by Chris.Wood

	CRP now has improved handling of lost comms with website/DB (CRP v.1.2.9)
	[UE-38397] - CrashReportProcess should not lose crashes when the website goes down.

Change 3209936 on 2016/11/24 by Steven.Hutton

	Reconciled offline work. Fixed a number of display bugs with the reports page.

Change 3209938 on 2016/11/24 by Steven.Hutton

	Reconciled offline work

	Adding JQuery UI packages

Change 3210736 on 2016/11/28 by Steve.Robb

	Unset() made protected, which is an implementation details of TFunction and not the way to unbind one (may leak memory).
	Fixes to existing calls.

	https://answers.unrealengine.com/questions/494947/proper-way-to-deal-with-destroying-a-tfunction.html

Change 3211181 on 2016/11/28 by Steve.Robb

	Improved error message when binding a delegate to a pending kill object.

	#jira UE-5232

Change 3211214 on 2016/11/28 by Steve.Robb

	PR #2978: fixed typo in FMallocLeakDetection (Contributed by finap)

	#jira UE-39049

Change 3211301 on 2016/11/28 by Steve.Robb

	PR #2892: Copy bCustomVersionsAreReset when creating an Archive from another Ar. (Contributed by surakin)

	#jira UE-37941

Change 3213387 on 2016/11/29 by Steven.Hutton

	Test of a release note parsed from the changelist

Change 3213553 on 2016/11/29 by Gil.Gribb

	UE4 - Rework dependencies and UStruct creation so that we can create UBlueprintGeneratedClass's without needing the parent class serialized.

Change 3214800 on 2016/11/30 by Robert.Manuszewski

	ModuleManager will now use a critical section instead of FMultiReaderSingleWriterGT to make it really thread safe.

	- removed FMultiReaderSingleWriterGT because it was not fully thread safe

Change 3214926 on 2016/11/30 by Robert.Manuszewski

	Merging using Dev-Core_To_Dev-LoadTimes (reversed)

Change 3214981 on 2016/11/30 by Gil.Gribb

	UE4 - Make sure that subobjects of CDOs are exported even if they don't have any direct references; they might be archetypes.

Change 3215392 on 2016/11/30 by Steve.Robb

	Error out on editor builds when reading a non-boolean value in an archive.

Change 3215674 on 2016/11/30 by Steve.Robb

	Replacement of a custom scope-exit setup with our standard macro.

Change 3215720 on 2016/11/30 by Steve.Robb

	Default constructor for TTuple which value-initializes the elements.

Change 3216777 on 2016/12/01 by Graeme.Thornton

	Add NoRedist and NotForLicensees folders in the game folder to the C# version of config file hierarchy.

Change 3216858 on 2016/12/01 by Graeme.Thornton

	Improvements to pak signing and encryption
	 - Remove compile time defines for encryption key and signing keys
	 - Embed keys in executable by including in the UBT generated UELinkerFixups.cpp file
	 - Add key access core delegate for passing these keys through to pak platform file

Change 3216860 on 2016/12/01 by Graeme.Thornton

	Re-enable pak signing and encryption in ShooterGame

Change 3216861 on 2016/12/01 by Graeme.Thornton

	Re-enable pak signing and encryption in Paragon

Change 3217076 on 2016/12/01 by Gil.Gribb

	UE4 - replaced !GIsIntialLoad with EVENT_DRIVEN_ASYNC_LOAD_ACTIVE_AT_RUNTIME as a first step toward boot time EDL

Change 3221139 on 2016/12/05 by Ben.Woodhouse

	Dummy integrate of CL 3221131 (versioning workarounds) from Dev-LoadTimes4.14 with accept target to prevent those workarounds being merged out of dev-loadtimes4.14.

	Command:
	p4 integrate //UE4/Dev-LoadTimes4.14/...@3221131,3221131

	w/ resolve/accept-target

Change 3221410 on 2016/12/05 by Steve.Robb

	Allow Algo::IsSorted to work on C arrays and initializer_lists.

Change 3221673 on 2016/12/05 by Gil.Gribb

	set up an intentional merge conflict so we can do the right thing when dev-BP and dev-core come together

Change 3223182 on 2016/12/06 by Chris.Wood

	Add EngineModeEx to CrashReportCommon
	[UE-39258] - Update CrashReporter to include whether Engine crashes are from vanilla build or not

Change 3224646 on 2016/12/07 by Robert.Manuszewski

	It's no longer necessary to rebuild the cooked exe to enable the event driven loader. EDL and the new async IO are now controlled with ini settings only.

Change 3224647 on 2016/12/07 by Robert.Manuszewski

	Event Driven Loader is now enabled by default.

Change 3224669 on 2016/12/07 by Chris.Wood

	Compressing some crash files output from CRP to S3 (CRP v1.2.11)
	[UE-37564] - Add compression support for CRP crash files in S3

	Add EngineModeEx to support to CRP (CRP v1.2.10)
	[UE-39258] - Update CrashReporter to include whether Engine crashes are from vanilla build or not

Change 3224873 on 2016/12/07 by Robert.Manuszewski

	A few fixes to the EDL macro refactor.

Change 3224933 on 2016/12/07 by Robert.Manuszewski

	Async Loading settings will now be logged on startup in cooked games

Change 3224984 on 2016/12/07 by Robert.Manuszewski

	Small fix to EDL and new async IO global var init.

Change 3225027 on 2016/12/07 by Robert.Manuszewski

	Re-enabling EDL in ShooterGame since it no longer requires the cooked exe to be re-compiled (and EDL is on by default anyway).

Change 3226702 on 2016/12/08 by Steve.Robb

	UHT can now skip over macro-like identifiers while parsing.
	Correctly handles FTypefaceEntry::Name parsing, which was broken by the workaround in CL# 3219332.
	Syntax workaround reverted in FTypefaceEntry.

	#jira UE-38231

Change 3226756 on 2016/12/08 by Steve.Robb

	LexicalConversion renamed to Lex after #core discussion.
	Lex::ToString overloads added for FString itself.

Change 3226766 on 2016/12/08 by Steve.Robb

	FCookStatsManager::ToString replaced with Lex::ToString, as it now supports the required functionality.

Change 3226949 on 2016/12/08 by Robert.Manuszewski

	Fixing static analysis warnings

Change 3228566 on 2016/12/09 by Robert.Manuszewski

	Making UBT not think it needs to use separate temporary target for non source code projects when EDL settings don't match default.

Change 3228601 on 2016/12/09 by Steve.Robb

	Fix for TSparseArray visualization of types smaller than 8 bytes.

Change 3228654 on 2016/12/09 by Gil.Gribb

	UE4 - Fix very old bug with lock free lists, probably not relevant to anything we currently use.

Change 3228697 on 2016/12/09 by Graeme.Thornton

	Rebuilt UnrealPak

[CL 3228932 by Robert Manuszewski in Main branch]
2016-12-09 11:36:14 -05:00

219 lines
7.1 KiB
C++

// Copyright 1998-2017 Epic Games, Inc. All Rights Reserved.
#pragma once
#include "CoreMinimal.h"
#include "GenericPlatform/GenericPlatformFile.h"
#include "Misc/Paths.h"
#include "NetworkMessage.h"
#include "NetworkPlatformFile.h"
DECLARE_LOG_CATEGORY_EXTERN(LogStreamingPlatformFile, Log, All);
#if 0
/**
* Visitor to gather local files with their timestamps
*/
class STREAMINGFILE_API FStreamingLocalTimestampVisitor : public IPlatformFile::FDirectoryVisitor
{
private:
/** The file interface to use for any file operations */
IPlatformFile& FileInterface;
/** true if we want directories in this list */
bool bCacheDirectories;
/** A list of directories that we should not traverse into */
TArray<FString> DirectoriesToIgnore;
/** A list of directories that we should only go one level into */
TArray<FString> DirectoriesToNotRecurse;
public:
/** Relative paths to local files and their timestamps */
TMap<FString, FDateTime> FileTimes;
FStreamingLocalTimestampVisitor(IPlatformFile& InFileInterface, const TArray<FString>& InDirectoriesToIgnore, const TArray<FString>& InDirectoriesToNotRecurse, bool bInCacheDirectories=false)
: FileInterface(InFileInterface)
, bCacheDirectories(bInCacheDirectories)
{
// make sure the paths are standardized, since the Visitor will assume they are standard
for (int32 DirIndex = 0; DirIndex < InDirectoriesToIgnore.Num(); DirIndex++)
{
FString DirToIgnore = InDirectoriesToIgnore[DirIndex];
FPaths::MakeStandardFilename(DirToIgnore);
DirectoriesToIgnore.Add(DirToIgnore);
}
for (int32 DirIndex = 0; DirIndex < InDirectoriesToNotRecurse.Num(); DirIndex++)
{
FString DirToNotRecurse = InDirectoriesToNotRecurse[DirIndex];
FPaths::MakeStandardFilename(DirToNotRecurse);
DirectoriesToNotRecurse.Add(DirToNotRecurse);
}
}
virtual bool Visit(const TCHAR* FilenameOrDirectory, bool bIsDirectory)
{
// make sure all paths are "standardized" so the other end can match up with it's own standardized paths
FString RelativeFilename = FilenameOrDirectory;
FPaths::MakeStandardFilename(RelativeFilename);
// cache files and optionally directories
if (!bIsDirectory)
{
FileTimes.Add(RelativeFilename, FileInterface.GetTimeStamp(FilenameOrDirectory));
}
else if (bCacheDirectories)
{
// we use a timestamp of 0 to indicate a directory
FileTimes.Add(RelativeFilename, 0);
}
// iterate over directories we care about
if (bIsDirectory)
{
bool bShouldRecurse = true;
// look in all the ignore directories looking for a match
for (int32 DirIndex = 0; DirIndex < DirectoriesToIgnore.Num() && bShouldRecurse; DirIndex++)
{
if (RelativeFilename.StartsWith(DirectoriesToIgnore[DirIndex]))
{
bShouldRecurse = false;
}
}
if (bShouldRecurse == true)
{
// If it is a directory that we should not recurse (ie we don't want to process subdirectories of it)
// handle that case as well...
for (int32 DirIndex = 0; DirIndex < DirectoriesToNotRecurse.Num() && bShouldRecurse; DirIndex++)
{
if (RelativeFilename.StartsWith(DirectoriesToNotRecurse[DirIndex]))
{
// Are we more than level deep in that directory?
FString CheckFilename = RelativeFilename.Right(RelativeFilename.Len() - DirectoriesToNotRecurse[DirIndex].Len());
if (CheckFilename.Len() > 1)
{
bShouldRecurse = false;
}
}
}
}
// recurse if we should
if (bShouldRecurse)
{
FileInterface.IterateDirectory(FilenameOrDirectory, *this);
}
}
return true;
}
};
#endif
/**
* Wrapper to redirect the low level file system to a server
*/
class STREAMINGFILE_API FStreamingNetworkPlatformFile
: public FNetworkPlatformFile
{
friend class FAsyncFileSync;
// FNetworkPlatformFile interface
virtual bool InitializeInternal(IPlatformFile* Inner, const TCHAR* HostIP) override;
public:
/** Default Constructor */
FStreamingNetworkPlatformFile() { };
/** Virtual destructor */
virtual ~FStreamingNetworkPlatformFile();
public:
static const TCHAR* GetTypeName()
{
return TEXT("StreamingFile");
}
/** Sends Open message to the server and creates a new file handle if successful. */
class FStreamingNetworkFileHandle* SendOpenMessage(const FString& Filename, bool bIsWriting, bool bAppend, bool bAllowRead);
/** Sends Read message to the server. */
bool SendReadMessage(uint64 HandleId, uint8* Destination, int64 BytesToRead);
/** Sends Write message to the server. */
bool SendWriteMessage(uint64 HandleId, const uint8* Source, int64 BytesToWrite);
/** Sends Seek message to the server. */
bool SendSeekMessage(uint64 HandleId, int64 NewPosition);
/** Sends Close message to the server. */
bool SendCloseMessage(uint64 HandleId);
public:
// need to override what FNetworkPlatformFile does here
void InitializeAfterSetActive() override { }
// IPlatformFile interface
virtual bool ShouldBeUsed(IPlatformFile* Inner, const TCHAR* CmdLine) const override;
virtual IPlatformFile* GetLowerLevel() override
{
return nullptr;
}
virtual void SetLowerLevel(IPlatformFile* NewLowerLevel) override
{
check(false);
}
virtual const TCHAR* GetName() const override
{
return FStreamingNetworkPlatformFile::GetTypeName();
}
virtual bool DeleteFile(const TCHAR* Filename) override;
virtual bool IsReadOnly(const TCHAR* Filename) override;
virtual bool MoveFile(const TCHAR* To, const TCHAR* From) override;
virtual bool SetReadOnly(const TCHAR* Filename, bool bNewReadOnlyValue) override;
virtual FDateTime GetTimeStamp(const TCHAR* Filename) override;
virtual void SetTimeStamp(const TCHAR* Filename, FDateTime DateTime) override;
virtual FDateTime GetAccessTimeStamp(const TCHAR* Filename) override;
virtual IFileHandle* OpenRead(const TCHAR* Filename, bool bAllowWrite = false) override;
virtual IFileHandle* OpenWrite(const TCHAR* Filename, bool bAppend, bool bAllowRead) override;
virtual bool DirectoryExists(const TCHAR* Directory) override;
virtual bool CreateDirectoryTree(const TCHAR* Directory) override;
virtual bool CreateDirectory(const TCHAR* Directory) override;
virtual bool DeleteDirectory(const TCHAR* Directory) override;
virtual bool IterateDirectory(const TCHAR* Directory, IPlatformFile::FDirectoryVisitor& Visitor) override;
virtual bool IterateDirectoryRecursively(const TCHAR* Directory, IPlatformFile::FDirectoryVisitor& Visitor) override;
virtual bool DeleteDirectoryRecursively(const TCHAR* Directory) override;
virtual bool CopyFile(const TCHAR* To, const TCHAR* From, EPlatformFileRead ReadFlags = EPlatformFileRead::None, EPlatformFileWrite WriteFlags = EPlatformFileWrite::None) override;
virtual FString ConvertToAbsolutePathForExternalAppForRead( const TCHAR* Filename ) override;
virtual FString ConvertToAbsolutePathForExternalAppForWrite( const TCHAR* Filename ) override;
private:
// FNetworkPlatformFile interface
virtual void PerformHeartbeat() override;
virtual void GetFileInfo(const TCHAR* Filename, FFileInfo& Info) override;
private:
/** Set files that the server said we should sync asynchronously */
TArray<FString> FilesToSyncAsync;
/** Stored information about the files we have already cached */
TMap<FString, FFileInfo> CachedFileInfo;
};