izzy/UnrealEngineUWP
0
0
Fork 0
mirror of https://github.com/izzy2lost/UnrealEngineUWP.git synced 2026-03-26 18:15:20 -07:00
Code Issues Packages Projects Releases Wiki Activity
Files
ec625768bfbd65f169c18ab15833a00a8a8d8e64
UnrealEngineUWP/Engine/Source/Developer/TextureBuild/Private/TextureBuildFunction.cpp

777 lines
35 KiB
C++
Raw Normal View History

Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
// Copyright Epic Games, Inc. All Rights Reserved.
#include "TextureBuildFunction.h"
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
#include "ChildTextureFormat.h"
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
#include "DerivedDataCache.h"
#include "DerivedDataValueId.h"
#include "Engine/TextureDefines.h"
#include "IImageWrapper.h"
#include "IImageWrapperModule.h"
#include "ImageCore.h"
#include "ImageCoreUtils.h"
#include "Interfaces/ITextureFormat.h"
#include "Interfaces/ITextureFormatModule.h"
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
#include "IO/IoHash.h"
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
#include "Memory/CompositeBuffer.h"
#include "Memory/SharedBuffer.h"
#include "Modules/ModuleManager.h"
#include "PixelFormat.h"
#include "Serialization/CompactBinary.h"
#include "Serialization/CompactBinaryWriter.h"
#include "Serialization/FileRegions.h"
#include "Serialization/MemoryWriter.h"
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
#include "TextureBuildUtilities.h"
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
#include "TextureCompressorModule.h"
#include "TextureFormatManager.h"
DEFINE_LOG_CATEGORY_STATIC(LogTextureBuildFunction, Log, All);
// Any edits to the texture compressor or this file that will change the output of texture builds
// MUST have a corresponding change to this version. Individual texture formats have a version to
// change that is specific to the format. A merge conflict affecting the version MUST be resolved
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
// by generating a new version. This also includes the addition of new outputs to the build, as
// this will cause a DDC verification failure unless a new version is created.
// A reminder that for DDC invalidation, running a ddc fill job or the ddc commandlet is a friendly
// thing to do! -run=DerivedDataCache -Fill -TargetPlatform=Platform1,Platform...N
//
static const FGuid TextureBuildFunctionVersion(TEXT("B20676CE-A786-43EE-96F0-2620A4C38ACA"));
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
static void ReadCbField(FCbFieldView Field, bool& OutValue) { OutValue = Field.AsBool(OutValue); }
static void ReadCbField(FCbFieldView Field, int32& OutValue) { OutValue = Field.AsInt32(OutValue); }
static void ReadCbField(FCbFieldView Field, uint8& OutValue) { OutValue = Field.AsUInt8(OutValue); }
static void ReadCbField(FCbFieldView Field, uint32& OutValue) { OutValue = Field.AsUInt32(OutValue); }
static void ReadCbField(FCbFieldView Field, float& OutValue) { OutValue = Field.AsFloat(OutValue); }
static void ReadCbField(FCbFieldView Field, FGuid& OutValue) { OutValue = Field.AsUuid(); }
static void ReadCbField(FCbFieldView Field, FName& OutValue)
{
if (Field.IsString())
{
OutValue = FName(FUTF8ToTCHAR(Field.AsString()));
}
}
static void ReadCbField(FCbFieldView Field, FColor& OutValue)
{
FCbFieldViewIterator It = Field.AsArrayView().CreateViewIterator();
OutValue.A = It++->AsUInt8(OutValue.A);
OutValue.R = It++->AsUInt8(OutValue.R);
OutValue.G = It++->AsUInt8(OutValue.G);
OutValue.B = It++->AsUInt8(OutValue.B);
}
static void ReadCbField(FCbFieldView Field, FVector2f& OutValue)
{
FCbFieldViewIterator It = Field.AsArrayView().CreateViewIterator();
OutValue.X = It++->AsFloat(OutValue.X);
OutValue.Y = It++->AsFloat(OutValue.Y);
}
static void ReadCbField(FCbFieldView Field, FVector4f& OutValue)
{
FCbFieldViewIterator It = Field.AsArrayView().CreateViewIterator();
OutValue.X = It++->AsFloat(OutValue.X);
OutValue.Y = It++->AsFloat(OutValue.Y);
OutValue.Z = It++->AsFloat(OutValue.Z);
OutValue.W = It++->AsFloat(OutValue.W);
}
static void ReadCbField(FCbFieldView Field, FIntPoint& OutValue)
{
FCbFieldViewIterator It = Field.AsArrayView().CreateViewIterator();
OutValue.X = It++->AsInt32(OutValue.X);
OutValue.Y = It++->AsInt32(OutValue.Y);
}
static FTextureBuildSettings ReadBuildSettingsFromCompactBinary(const FCbObjectView& Object)
{
FTextureBuildSettings BuildSettings;
BuildSettings.FormatConfigOverride = Object["FormatConfigOverride"].AsObjectView();
FCbObjectView ColorAdjustmentCbObj = Object["ColorAdjustment"].AsObjectView();
FColorAdjustmentParameters& ColorAdjustment = BuildSettings.ColorAdjustment;
ReadCbField(ColorAdjustmentCbObj["AdjustBrightness"], ColorAdjustment.AdjustBrightness);
ReadCbField(ColorAdjustmentCbObj["AdjustBrightnessCurve"], ColorAdjustment.AdjustBrightnessCurve);
ReadCbField(ColorAdjustmentCbObj["AdjustSaturation"], ColorAdjustment.AdjustSaturation);
ReadCbField(ColorAdjustmentCbObj["AdjustVibrance"], ColorAdjustment.AdjustVibrance);
ReadCbField(ColorAdjustmentCbObj["AdjustRGBCurve"], ColorAdjustment.AdjustRGBCurve);
ReadCbField(ColorAdjustmentCbObj["AdjustHue"], ColorAdjustment.AdjustHue);
ReadCbField(ColorAdjustmentCbObj["AdjustMinAlpha"], ColorAdjustment.AdjustMinAlpha);
ReadCbField(ColorAdjustmentCbObj["AdjustMaxAlpha"], ColorAdjustment.AdjustMaxAlpha);
BuildSettings.bUseNewMipFilter = Object["bUseNewMipFilter"].AsBool(BuildSettings.bUseNewMipFilter);
Normal Maps were not renormalizing normal vectors after generating mips caused reduced length normals, which then bends them when we drop components for compression in BC5 or ASTC don't change existing content, only normalize when new option bNormalizeNormals is enabled note that ISPCTexComp is inconsistently doing normalization, no other tex formats do #preflight 632270e0a514fd1e3751a141 #rb fabian.giesen [CL 22028968 by charles bloom in ue5-main branch]
2022-09-15 10:49:25 -04:00
BuildSettings.bNormalizeNormals = Object["bNormalizeNormals"].AsBool(BuildSettings.bNormalizeNormals);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
BuildSettings.bDoScaleMipsForAlphaCoverage = Object["bDoScaleMipsForAlphaCoverage"].AsBool(BuildSettings.bDoScaleMipsForAlphaCoverage);
ReadCbField(Object["AlphaCoverageThresholds"], BuildSettings.AlphaCoverageThresholds);
ReadCbField(Object["MipSharpening"], BuildSettings.MipSharpening);
ReadCbField(Object["DiffuseConvolveMipLevel"], BuildSettings.DiffuseConvolveMipLevel);
ReadCbField(Object["SharpenMipKernelSize"], BuildSettings.SharpenMipKernelSize);
ReadCbField(Object["MaxTextureResolution"], BuildSettings.MaxTextureResolution);
check( BuildSettings.MaxTextureResolution != 0 );
ReadCbField(Object["TextureFormatName"], BuildSettings.TextureFormatName);
ReadCbField(Object["bHDRSource"], BuildSettings.bHDRSource);
ReadCbField(Object["MipGenSettings"], BuildSettings.MipGenSettings);
BuildSettings.bCubemap = Object["bCubemap"].AsBool(BuildSettings.bCubemap);
BuildSettings.bTextureArray = Object["bTextureArray"].AsBool(BuildSettings.bTextureArray);
BuildSettings.bVolume = Object["bVolume"].AsBool(BuildSettings.bVolume);
BuildSettings.bLongLatSource = Object["bLongLatSource"].AsBool(BuildSettings.bLongLatSource);
BuildSettings.bSRGB = Object["bSRGB"].AsBool(BuildSettings.bSRGB);
ReadCbField(Object["SourceEncodingOverride"], BuildSettings.SourceEncodingOverride);
BuildSettings.bHasColorSpaceDefinition = Object["bHasColorSpaceDefinition"].AsBool(BuildSettings.bHasColorSpaceDefinition);
ReadCbField(Object["RedChromaticityCoordinate"], BuildSettings.RedChromaticityCoordinate);
ReadCbField(Object["GreenChromaticityCoordinate"], BuildSettings.GreenChromaticityCoordinate);
ReadCbField(Object["BlueChromaticityCoordinate"], BuildSettings.BlueChromaticityCoordinate);
ReadCbField(Object["WhiteChromaticityCoordinate"], BuildSettings.WhiteChromaticityCoordinate);
ReadCbField(Object["ChromaticAdaptationMethod"], BuildSettings.ChromaticAdaptationMethod);
BuildSettings.bUseLegacyGamma = Object["bUseLegacyGamma"].AsBool(BuildSettings.bUseLegacyGamma);
BuildSettings.bPreserveBorder = Object["bPreserveBorder"].AsBool(BuildSettings.bPreserveBorder);
BuildSettings.bForceNoAlphaChannel = Object["bForceNoAlphaChannel"].AsBool(BuildSettings.bForceNoAlphaChannel);
BuildSettings.bForceAlphaChannel = Object["bForceAlphaChannel"].AsBool(BuildSettings.bForceAlphaChannel);
BuildSettings.bComputeBokehAlpha = Object["bComputeBokehAlpha"].AsBool(BuildSettings.bComputeBokehAlpha);
BuildSettings.bReplicateRed = Object["bReplicateRed"].AsBool(BuildSettings.bReplicateRed);
BuildSettings.bReplicateAlpha = Object["bReplicateAlpha"].AsBool(BuildSettings.bReplicateAlpha);
BuildSettings.bDownsampleWithAverage = Object["bDownsampleWithAverage"].AsBool(BuildSettings.bDownsampleWithAverage);
BuildSettings.bSharpenWithoutColorShift = Object["bSharpenWithoutColorShift"].AsBool(BuildSettings.bSharpenWithoutColorShift);
BuildSettings.bBorderColorBlack = Object["bBorderColorBlack"].AsBool(BuildSettings.bBorderColorBlack);
BuildSettings.bFlipGreenChannel = Object["bFlipGreenChannel"].AsBool(BuildSettings.bFlipGreenChannel);
BuildSettings.bApplyYCoCgBlockScale = Object["bApplyYCoCgBlockScale"].AsBool(BuildSettings.bApplyYCoCgBlockScale);
BuildSettings.bApplyKernelToTopMip = Object["bApplyKernelToTopMip"].AsBool(BuildSettings.bApplyKernelToTopMip);
BuildSettings.bRenormalizeTopMip = Object["bRenormalizeTopMip"].AsBool(BuildSettings.bRenormalizeTopMip);
CPU accessible textures #rb fabian.giesen #rb charles.bloom [CL 26655002 by dan thompson in ue5-main branch]
2023-07-27 16:46:23 -04:00
BuildSettings.bCPUAccessible = Object["bCPUAccessible"].AsBool(BuildSettings.bCPUAccessible);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
ReadCbField(Object["CompositeTextureMode"], BuildSettings.CompositeTextureMode);
ReadCbField(Object["CompositePower"], BuildSettings.CompositePower);
ReadCbField(Object["LODBias"], BuildSettings.LODBias);
ReadCbField(Object["LODBiasWithCinematicMips"], BuildSettings.LODBiasWithCinematicMips);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
BuildSettings.bStreamable_Unused = Object["bStreamable"].AsBool(BuildSettings.bStreamable_Unused);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
BuildSettings.bVirtualStreamable = Object["bVirtualStreamable"].AsBool(BuildSettings.bVirtualStreamable);
BuildSettings.bChromaKeyTexture = Object["bChromaKeyTexture"].AsBool(BuildSettings.bChromaKeyTexture);
ReadCbField(Object["PowerOfTwoMode"], BuildSettings.PowerOfTwoMode);
ReadCbField(Object["PaddingColor"], BuildSettings.PaddingColor);
Implement PadWithBorderColor texture setting. #jira UE-158070 #rb Dan.Thompson [CL 28253332 by alexander suvorov in ue5-main branch]
2023-09-26 18:49:57 -04:00
BuildSettings.bPadWithBorderColor = Object["bPadWithBorderColor"].AsBool(BuildSettings.bPadWithBorderColor);
Implement Resize to Specific Resolution texture padding and resizing option. #jira UE-158070 #rb Dan.Thompson [CL 28425273 by alexander suvorov in ue5-main branch]
2023-10-03 14:56:03 -04:00
ReadCbField(Object["ResizeDuringBuildX"], BuildSettings.ResizeDuringBuildX);
ReadCbField(Object["ResizeDuringBuildY"], BuildSettings.ResizeDuringBuildY);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
ReadCbField(Object["ChromaKeyColor"], BuildSettings.ChromaKeyColor);
ReadCbField(Object["ChromaKeyThreshold"], BuildSettings.ChromaKeyThreshold);
ReadCbField(Object["CompressionQuality"], BuildSettings.CompressionQuality);
ReadCbField(Object["LossyCompressionAmount"], BuildSettings.LossyCompressionAmount);
ReadCbField(Object["Downscale"], BuildSettings.Downscale);
ReadCbField(Object["DownscaleOptions"], BuildSettings.DownscaleOptions);
ReadCbField(Object["VirtualAddressingModeX"], BuildSettings.VirtualAddressingModeX);
ReadCbField(Object["VirtualAddressingModeY"], BuildSettings.VirtualAddressingModeY);
ReadCbField(Object["VirtualTextureTileSize"], BuildSettings.VirtualTextureTileSize);
ReadCbField(Object["VirtualTextureBorderSize"], BuildSettings.VirtualTextureBorderSize);
BuildSettings.OodleEncodeEffort = Object["OodleEncodeEffort"].AsUInt8(BuildSettings.OodleEncodeEffort);
BuildSettings.OodleUniversalTiling = Object["OodleUniversalTiling"].AsUInt8(BuildSettings.OodleUniversalTiling);
BuildSettings.bOodleUsesRDO = Object["bOodleUsesRDO"].AsBool(BuildSettings.bOodleUsesRDO);
BuildSettings.OodleRDO = Object["OodleRDO"].AsUInt8(BuildSettings.OodleRDO);
Expose Preserve Extremes Oodle encoding option in Texture Editor UI. #jira UE-161928 #rb Dan.Thompson [CL 27571641 by alexander suvorov in ue5-main branch]
2023-09-01 19:25:25 -04:00
BuildSettings.bOodlePreserveExtremes = Object["bOodlePreserveExtremes"].AsBool(BuildSettings.bOodlePreserveExtremes);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
ReadCbField(Object["OodleTextureSdkVersion"], BuildSettings.OodleTextureSdkVersion);
Texture MipGen clamp mip filter if texture address mode is not wrap in both x&y todo for the future to separate x/y mip gen clamp/wrap #jira UE-162283 #preflight 63612d38ef6d25c67459c5ed #rb alexander.suvorov [CL 22921412 by charles bloom in ue5-main branch]
2022-11-02 13:53:39 -04:00
ReadCbField(Object["TextureAddressModeX"], BuildSettings.TextureAddressModeX);
ReadCbField(Object["TextureAddressModeY"], BuildSettings.TextureAddressModeY);
ReadCbField(Object["TextureAddressModeZ"], BuildSettings.TextureAddressModeZ);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
return BuildSettings;
}
static ERawImageFormat::Type ComputeRawImageFormat(ETextureSourceFormat SourceFormat)
{
return FImageCoreUtils::ConvertToRawImageFormat(SourceFormat);
}
static bool TryReadTextureSourceFromCompactBinary(FCbFieldView Source, UE::DerivedData::FBuildContext& Context,
const FTextureBuildSettings & BuildSettings, TArray<FImage>& OutMips)
{
FSharedBuffer InputBuffer = Context.FindInput(Source.GetName());
if (!InputBuffer)
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("Missing input '%s'."), *WriteToString<64>(Source.GetName()));
return false;
}
if ( InputBuffer.GetSize() == 0 )
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("Input size zero '%s'."), *WriteToString<64>(Source.GetName()));
return false;
}
Texture UEDelta filter to replace PNG filter Simple North/Up pixel filter parallel, simd removes slow call into ImageWrapper just to run the PNGz0 filter UEDelta works for udim, cubes, all pixel formats, there are no limitations or corner cases #jira UE-181911 #rb fabian.giesen [CL 32654283 by charles bloom in ue5-main branch]
2024-04-01 18:31:48 -04:00
// Source data has no CompressionFormat
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
ETextureSourceFormat SourceFormat = (ETextureSourceFormat)Source["SourceFormat"].AsUInt8();
ERawImageFormat::Type RawImageFormat = ComputeRawImageFormat(SourceFormat);
EGammaSpace GammaSpace = (EGammaSpace)Source["GammaSpace"].AsUInt8();
int32 NumSlices = Source["NumSlices"].AsInt32();
int32 SizeX = Source["SizeX"].AsInt32();
int32 SizeY = Source["SizeY"].AsInt32();
int32 MipSizeX = SizeX;
int32 MipSizeY = SizeY;
const uint8* DecompressedSourceData = (const uint8*)InputBuffer.GetData();
int64 DecompressedSourceDataSize = InputBuffer.GetSize();
FCbArrayView MipsCbArrayView = Source["Mips"].AsArrayView();
Typecast warning fixups #jira UE-166462 #rb fabian.giesen #preflight 6463ec86d62884a78fd92874 [CL 25514891 by dan thompson in ue5-main branch]
2023-05-17 15:57:20 -04:00
OutMips.Reserve(IntCastChecked<int32>(MipsCbArrayView.Num()));
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
for (FCbFieldView MipsCbArrayIt : MipsCbArrayView)
{
FCbObjectView MipCbObjectView = MipsCbArrayIt.AsObjectView();
int64 MipOffset = MipCbObjectView["Offset"].AsInt64();
int64 MipSize = MipCbObjectView["Size"].AsInt64();
Replaced some container operator new usage. #rb james.hopkin #jira none #preflight 6459670f28155a0f41565a34 [CL 25384456 by Steve Robb in ue5-main branch]
2023-05-09 05:17:49 -04:00
FImage& SourceMip = OutMips.Emplace_GetRef(
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
MipSizeX, MipSizeY,
NumSlices,
RawImageFormat,
GammaSpace
);
check( MipOffset + MipSize <= DecompressedSourceDataSize );
Replaced some container operator new usage. #rb james.hopkin #jira none #preflight 6459670f28155a0f41565a34 [CL 25384456 by Steve Robb in ue5-main branch]
2023-05-09 05:17:49 -04:00
check( SourceMip.GetImageSizeBytes() == MipSize );
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Texture UEDelta filter to replace PNG filter Simple North/Up pixel filter parallel, simd removes slow call into ImageWrapper just to run the PNGz0 filter UEDelta works for udim, cubes, all pixel formats, there are no limitations or corner cases #jira UE-181911 #rb fabian.giesen [CL 32654283 by charles bloom in ue5-main branch]
2024-04-01 18:31:48 -04:00
SourceMip.RawData.Reset(MipSize);
SourceMip.RawData.AddUninitialized(MipSize);
FMemory::Memcpy(
SourceMip.RawData.GetData(),
DecompressedSourceData + MipOffset,
MipSize
);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
MipSizeX = FMath::Max(MipSizeX / 2, 1);
MipSizeY = FMath::Max(MipSizeY / 2, 1);
if ( BuildSettings.bVolume )
{
NumSlices = FMath::Max(NumSlices / 2, 1);
}
}
return true;
}
FGuid FTextureBuildFunction::GetVersion() const
{
UE::DerivedData::FBuildVersionBuilder Builder;
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
Builder << TextureBuildFunctionVersion;
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
ITextureFormat* TextureFormat = nullptr;
GetVersion(Builder, TextureFormat);
if (TextureFormat)
{
TArray<FName> SupportedFormats;
TextureFormat->GetSupportedFormats(SupportedFormats);
TArray<uint16> SupportedFormatVersions;
for (const FName& SupportedFormat : SupportedFormats)
{
SupportedFormatVersions.AddUnique(TextureFormat->GetVersion(SupportedFormat));
}
SupportedFormatVersions.Sort();
Builder << SupportedFormatVersions;
}
return Builder.Build();
}
void FTextureBuildFunction::Configure(UE::DerivedData::FBuildConfigContext& Context) const
{
Texture: Integrated the texture compiling manager with the derived data build scheduler This allows for pausing of async texture compilation and limiting concurrent texture builds based on the same memory limits that the asset compiling manager uses. #jira UE-141137 #jira UE-141139 #preflight 636a78af4d3c1d9d92d2ce5a #rb Zousar.Shaker [CL 23033009 by Devin Doucette in ue5-main branch]
2022-11-08 13:26:12 -05:00
Context.SetTypeName(UTF8TEXTVIEW("Texture"));
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Context.SetCacheBucket(UE::DerivedData::FCacheBucket(ANSITEXTVIEW("Texture")));
const FCbObject Settings = Context.FindConstant(UTF8TEXTVIEW("Settings"));
const int64 RequiredMemoryEstimate = Settings["RequiredMemoryEstimate"].AsInt64();
Context.SetRequiredMemory(RequiredMemoryEstimate);
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
// All texture builds output (at least) these values.
struct FChildBuildData
{
FEncodedTextureDescription TextureDescription;
FEncodedTextureExtendedData TextureExtendedData;
FTextureEngineParameters EngineParameters;
FEncodedTextureDescription::FSharedBufferMipChain MipBuffers;
// Cache these values since we always need them
int32 NumStreamingMips, NumEncodedMips;
// Pass-thru values.
FCompositeBuffer CPUCopyImageInfo;
FSharedBuffer CPUCopyRawData;
};
static bool ReadChildBuildInputs(FChildBuildData& OutChildBuildInputs, UE::DerivedData::FBuildContext& Context)
{
{
FSharedBuffer RawTextureDescription = Context.FindInput(UTF8TEXTVIEW("EncodedTextureDescription"));
if (!RawTextureDescription)
{
Context.AddError(TEXTVIEW("Missing EncodedTextureDescription"));
return false;
}
UE::TextureBuildUtilities::EncodedTextureDescription::FromCompactBinary(OutChildBuildInputs.TextureDescription, FCbObject(RawTextureDescription));
}
{
FSharedBuffer RawTextureExtendedData = Context.FindInput(UTF8TEXTVIEW("EncodedTextureExtendedData"));
if (!RawTextureExtendedData)
{
Context.AddError(TEXTVIEW("Missing EncodedTextureExtendedData"));
return false;
}
UE::TextureBuildUtilities::EncodedTextureExtendedData::FromCompactBinary(OutChildBuildInputs.TextureExtendedData, FCbObject(RawTextureExtendedData));
}
{
FCbObject EngineParametersCb = Context.FindConstant(UTF8TEXTVIEW("EngineParameters"));
UE::TextureBuildUtilities::TextureEngineParameters::FromCompactBinary(OutChildBuildInputs.EngineParameters, EngineParametersCb);
}
OutChildBuildInputs.NumStreamingMips = OutChildBuildInputs.TextureDescription.GetNumStreamingMips(&OutChildBuildInputs.TextureExtendedData, OutChildBuildInputs.EngineParameters);
OutChildBuildInputs.NumEncodedMips = OutChildBuildInputs.TextureDescription.GetNumEncodedMips(&OutChildBuildInputs.TextureExtendedData);
if (OutChildBuildInputs.TextureExtendedData.MipSizesInBytes.Num() == 0)
{
// Init with linear sizes.
OutChildBuildInputs.TextureExtendedData.MipSizesInBytes.SetNumUninitialized(OutChildBuildInputs.NumEncodedMips);
for (int32 MipIndex = 0; MipIndex < OutChildBuildInputs.NumEncodedMips; MipIndex++)
{
OutChildBuildInputs.TextureExtendedData.MipSizesInBytes[MipIndex] = OutChildBuildInputs.TextureDescription.GetMipSizeInBytes(MipIndex);
}
}
{
FSharedBuffer InputTextureMipTailData;
if (OutChildBuildInputs.TextureDescription.NumMips > OutChildBuildInputs.NumStreamingMips)
{
InputTextureMipTailData = Context.FindInput(UTF8TEXTVIEW("MipTail"));
if (!InputTextureMipTailData)
{
Context.AddError(TEXTVIEW("Couldn't find expected packed non-streaming mips in build"));
return false;
}
}
uint64 CurrentMipTailOffset = 0;
for (int32 MipIndex = 0; MipIndex < OutChildBuildInputs.NumEncodedMips; MipIndex++)
{
FSharedBuffer MipData;
if (MipIndex >= OutChildBuildInputs.NumStreamingMips)
{
// Mip tail.
uint64 SourceMipSize = OutChildBuildInputs.TextureExtendedData.MipSizesInBytes[MipIndex];
MipData = FSharedBuffer::MakeView(InputTextureMipTailData.GetView().Mid(CurrentMipTailOffset, SourceMipSize), InputTextureMipTailData);
CurrentMipTailOffset += SourceMipSize;
}
else
{
TUtf8StringBuilder<10> StreamingMipName;
StreamingMipName << "Mip" << MipIndex;
MipData = Context.FindInput(StreamingMipName);
}
if (MipData.GetSize() != OutChildBuildInputs.TextureExtendedData.MipSizesInBytes[MipIndex])
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("Unexpected mip size when unpacking parent build: got %d, expected %d"), MipData.GetSize(), OutChildBuildInputs.TextureExtendedData.MipSizesInBytes[MipIndex]);
Context.AddError(Error);
return false;
}
OutChildBuildInputs.MipBuffers.Add(MipData);
}
}
OutChildBuildInputs.CPUCopyImageInfo = FCompositeBuffer(Context.FindInput(UTF8TEXTVIEW("CPUCopyImageInfo")));
OutChildBuildInputs.CPUCopyRawData = Context.FindInput(UTF8TEXTVIEW("CPUCopyRawData"));
return true;
}
static void WriteChildBuildOutputs(UE::DerivedData::FBuildContext& Context, FChildBuildData&& BuildOutputs)
{
for (int32 MipIndex = 0; MipIndex < BuildOutputs.NumStreamingMips; MipIndex++)
{
TUtf8StringBuilder<10> StreamingMipName;
StreamingMipName << "Mip" << MipIndex;
Context.AddValue(UE::DerivedData::FValueId::FromName(StreamingMipName), MoveTemp(BuildOutputs.MipBuffers[MipIndex]));
}
//
// The actual streaming mips for the build might be different based on packed mip tails... however in order
// to facilitate input/output connection between build jobs we want to always emit the full set of streaming mips
// as outputs even if they are empty.
//
if (BuildOutputs.TextureExtendedData.NumMipsInTail)
{
int32 UnadjustedNumStreamingMips = BuildOutputs.TextureDescription.GetNumStreamingMips(nullptr, BuildOutputs.EngineParameters);
if (UnadjustedNumStreamingMips != BuildOutputs.NumStreamingMips)
{
FSharedBuffer EmptyBuffer = FUniqueBuffer::Alloc(0).MoveToShared();
for (int32 EmptyStreamingMipIndex = BuildOutputs.NumStreamingMips; EmptyStreamingMipIndex < UnadjustedNumStreamingMips; EmptyStreamingMipIndex++)
{
TUtf8StringBuilder<10> StreamingMipName;
StreamingMipName << "Mip" << EmptyStreamingMipIndex;
Context.AddValue(UE::DerivedData::FValueId::FromName(StreamingMipName), EmptyBuffer);
}
}
}
if (BuildOutputs.NumStreamingMips != BuildOutputs.NumEncodedMips)
{
// we need to pass the non streaming mips all packed together, and we can't append composite buffers (?)
TArray<FSharedBuffer> NonStreamingMips;
NonStreamingMips.Reserve(BuildOutputs.NumEncodedMips - BuildOutputs.NumStreamingMips);
for (int32 MipIndex = BuildOutputs.NumStreamingMips; MipIndex < BuildOutputs.NumEncodedMips; MipIndex++)
{
NonStreamingMips.Add(BuildOutputs.MipBuffers[MipIndex]);
}
Context.AddValue(UE::DerivedData::FValueId::FromName(UTF8TEXTVIEW("MipTail")), FCompositeBuffer(MoveTemp(NonStreamingMips)));
}
Context.AddValue(UE::DerivedData::FValueId::FromName(UTF8TEXTVIEW("EncodedTextureDescription")), UE::TextureBuildUtilities::EncodedTextureDescription::ToCompactBinary(BuildOutputs.TextureDescription));
Context.AddValue(UE::DerivedData::FValueId::FromName(UTF8TEXTVIEW("EncodedTextureExtendedData")), UE::TextureBuildUtilities::EncodedTextureExtendedData::ToCompactBinary(BuildOutputs.TextureExtendedData));
Context.AddValue(UE::DerivedData::FValueId::FromName(UTF8TEXTVIEW("CPUCopyImageInfo")), BuildOutputs.CPUCopyImageInfo);
Context.AddValue(UE::DerivedData::FValueId::FromName(UTF8TEXTVIEW("CPUCopyRawData")), BuildOutputs.CPUCopyRawData);
}
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
void FTextureBuildFunction::Build(UE::DerivedData::FBuildContext& Context) const
{
const FCbObject Settings = Context.FindConstant(UTF8TEXTVIEW("Settings"));
if (!Settings)
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("Settings are not available."));
return;
}
const FTextureBuildSettings BuildSettings = ReadBuildSettingsFromCompactBinary(Settings["Build"].AsObjectView());
const uint16 RequiredTextureFormatVersion = Settings["FormatVersion"].AsUInt16();
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
const ITextureFormat* TextureFormat = nullptr;
[Backout] - CL23414304 #fyi Dan.Thompson Original CL Desc ----------------------------------------------------------------- Cache TextureFormat on the BuildSettings so we don't have to look through the TPM whenever we want it. #rb charles.bloom #preflight 638f926c5624e6da5e0afa93 #preflight 638fa3c05624e6da5e12c8b9 [CL 23415924 by Dan Thompson in ue5-main branch]
2022-12-06 15:36:46 -05:00
if (ITextureFormatManagerModule* TFM = GetTextureFormatManager())
{
TextureFormat = TFM->FindTextureFormat(BuildSettings.TextureFormatName);
}
else
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("TextureFormatManager not found!"));
return;
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
if (!TextureFormat)
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("Texture format %s not found"), *WriteToString<128>(BuildSettings.TextureFormatName));
return;
}
const uint16 CurrentTextureFormatVersion = TextureFormat->GetVersion(BuildSettings.TextureFormatName, &BuildSettings);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
if (CurrentTextureFormatVersion != RequiredTextureFormatVersion)
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("%s has version %hu when version %hu is required."),
*BuildSettings.TextureFormatName.ToString(), CurrentTextureFormatVersion, RequiredTextureFormatVersion);;
return;
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
const FChildTextureFormat* ChildTextureFormat = TextureFormat->GetChildFormat();
if (ChildTextureFormat)
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
const_cast<FTextureBuildSettings&>(BuildSettings).BaseTextureFormatName = ChildTextureFormat->GetBaseFormatName(BuildSettings.TextureFormatName);
}
else
{
const_cast<FTextureBuildSettings&>(BuildSettings).BaseTextureFormatName = BuildSettings.TextureFormatName;
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
const_cast<FTextureBuildSettings&>(BuildSettings).BaseTextureFormat = GetTextureFormatManager()->FindTextureFormat(BuildSettings.BaseTextureFormatName);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
TArray<FImage> SourceMips;
if (!TryReadTextureSourceFromCompactBinary(Settings["Source"], Context,BuildSettings, SourceMips))
{
return;
}
CPU accessible textures #rb fabian.giesen #rb charles.bloom [CL 26655002 by dan thompson in ue5-main branch]
2023-07-27 16:46:23 -04:00
FSharedImageRef CPUCopy;
if (BuildSettings.bCPUAccessible)
{
CPUCopy = new FSharedImage();
SourceMips[0].CopyTo(*CPUCopy);
// We just use a placeholder texture rather than the source.
SourceMips.Empty();
FImage& Placeholder = SourceMips.AddDefaulted_GetRef();
UE::TextureBuildUtilities::GetPlaceholderTextureImage(&Placeholder);
}
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
TArray<FImage> AssociatedNormalSourceMips;
if (FCbFieldView CompositeSource = Settings["CompositeSource"];
CompositeSource && !TryReadTextureSourceFromCompactBinary(CompositeSource, Context,BuildSettings, AssociatedNormalSourceMips))
{
return;
}
Fix bug in DDC2 texture build path caused by using SourceMips after it had been cleared by BuildTexture. #rb devin.doucette [CL 32278799 by zousar shaker in ue5-main branch]
2024-03-15 13:43:13 -04:00
// SourceMips will be cleared by BuildTexture. Store info from it for use later.
const int32 SourceMipsNum = SourceMips.Num();
const int32 SourceMipsNumSlices = SourceMips[0].NumSlices;
const int32 SourceMip0SizeX = SourceMips[0].SizeX;
const int32 SourceMip0SizeY = SourceMips[0].SizeY;
UE_LOG(LogTextureBuildFunction, Display, TEXT("Compressing %s -> %d source mip(s) (%dx%d) to %s..."), *Context.GetName(), SourceMipsNum, SourceMip0SizeX, SourceMip0SizeY, *BuildSettings.TextureFormatName.ToString());
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
ITextureCompressorModule& TextureCompressorModule = FModuleManager::GetModuleChecked<ITextureCompressorModule>(TEXTURE_COMPRESSOR_MODULENAME);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
TArray<FCompressedImage2D> CompressedMips;
uint32 NumMipsInTail;
uint32 ExtData;
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
UE::TextureBuildUtilities::FTextureBuildMetadata BuildMetadata;
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
bool bBuildSucceeded = TextureCompressorModule.BuildTexture(
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
SourceMips,
AssociatedNormalSourceMips,
BuildSettings,
Context.GetName(),
CompressedMips,
NumMipsInTail,
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
ExtData,
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
&BuildMetadata
);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
if (!bBuildSucceeded)
{
return;
}
check(CompressedMips.Num() > 0);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
FChildBuildData OutputData;
{
FTextureEngineParameters EngineParameters;
if (UE::TextureBuildUtilities::TextureEngineParameters::FromCompactBinary(EngineParameters, Context.FindConstant(UTF8TEXTVIEW("EngineParameters"))) == false)
{
UE_LOG(LogTextureBuildFunction, Error, TEXT("Engine parameters are not available."));
return;
}
OutputData.EngineParameters = EngineParameters;
}
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
FEncodedTextureDescription TextureDescription;
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
int32 CalculatedMip0SizeX = 0, CalculatedMip0SizeY = 0, CalculatedMip0NumSlices = 0;
Fix bug in DDC2 texture build path caused by using SourceMips after it had been cleared by BuildTexture. #rb devin.doucette [CL 32278799 by zousar shaker in ue5-main branch]
2024-03-15 13:43:13 -04:00
int32 CalculatedMipCount = TextureCompressorModule.GetMipCountForBuildSettings(SourceMip0SizeX, SourceMip0SizeY, SourceMipsNumSlices, SourceMipsNum, BuildSettings, CalculatedMip0SizeX, CalculatedMip0SizeY, CalculatedMip0NumSlices);
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
BuildSettings.GetEncodedTextureDescriptionWithPixelFormat(&TextureDescription, (EPixelFormat)CompressedMips[0].PixelFormat, CalculatedMip0SizeX, CalculatedMip0SizeY, CalculatedMip0NumSlices, CalculatedMipCount);
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.TextureDescription = MoveTemp(TextureDescription);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
// ExtendedData is only really useful for textures that have a post build step for tiling,
// however it's possible that we ran the old build process where the tiling occurs as part
// of the BuildTexture->CompressImage step via child texture formats. In that case, we've already
// tiled and we need to pass the data back out. Otherwise, this gets ignored and the tiling step
// regenerates it.
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
FEncodedTextureExtendedData ExtendedData;
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
ExtendedData.NumMipsInTail = NumMipsInTail;
ExtendedData.ExtData = ExtData;
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.NumEncodedMips = OutputData.TextureDescription.GetNumEncodedMips(&ExtendedData);
ExtendedData.MipSizesInBytes.AddUninitialized(OutputData.NumEncodedMips);
for (int32 MipIndex = 0; MipIndex < OutputData.NumEncodedMips; MipIndex++)
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
{
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
ExtendedData.MipSizesInBytes[MipIndex] = CompressedMips[MipIndex].RawData.Num();
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.MipBuffers.Add(MakeSharedBufferFromArray(MoveTemp(CompressedMips[MipIndex].RawData)));
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.TextureExtendedData = MoveTemp(ExtendedData);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
}
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.NumStreamingMips = OutputData.TextureDescription.GetNumStreamingMips(&OutputData.TextureExtendedData, OutputData.EngineParameters);
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
{
CPU accessible textures #rb fabian.giesen #rb charles.bloom [CL 26655002 by dan thompson in ue5-main branch]
2023-07-27 16:46:23 -04:00
if (CPUCopy.IsValid())
{
FCbObject ImageInfoMetadata;
CPUCopy->ImageInfoToCompactBinary(ImageInfoMetadata);
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.CPUCopyImageInfo = ImageInfoMetadata.GetBuffer();
CPU accessible textures #rb fabian.giesen #rb charles.bloom [CL 26655002 by dan thompson in ue5-main branch]
2023-07-27 16:46:23 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
OutputData.CPUCopyRawData = MakeSharedBufferFromArray(MoveTemp(CPUCopy->RawData));
CPU accessible textures #rb fabian.giesen #rb charles.bloom [CL 26655002 by dan thompson in ue5-main branch]
2023-07-27 16:46:23 -04:00
}
Undoing backout - this was depending on the original issue, not an issue in and of itself. This does also correct a separate issue with the texture editor using the removed metadata information. Removing texture build metadata due to ddc complexities. It will be added to the metadata system in the new build flow SoonTM. Additionally, the alpha information for the source mips is no longer necessary as that is computed elsewhere now. #rb fabian.giesen #jira UE-183750 [CL 30894760 by dan thompson in ue5-main branch]
2024-01-25 14:17:55 -05:00
// This will get added to the build metadata in a later cl.
// Context.AddValue(UE::DerivedData::FValueId::FromName(ANSITEXTVIEW("TextureBuildMetadata")), BuildMetadata.ToCompactBinaryWithDefaults());
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
WriteChildBuildOutputs(Context, MoveTemp(OutputData));
Texture GetBuildRequiredEstimate better estimate of texture build memory needed create new TextureBuildUtilities module that can be used from Engine or TextureBuildWorker new cvar memory.WindowsPlatformMemoryGetStatsLimitTotalVirtualGB simulates a lower memory system #rb fabian.giesen #preflight 62b34bf8650c9d5857a38514 [CL 20786800 by charles bloom in ue5-main branch]
2022-06-22 20:21:16 -04:00
}
}
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Fix for shared linear texture encoding and DDC2/IBuild interface. #rb fabian.giesen #fyi devin.doucette #preflight 640a29b5c41a0a2a772b8deb [CL 24579796 by Dan Thompson in ue5-main branch]
2023-03-09 14:03:35 -05:00
void GenericTextureTilingBuildFunction(UE::DerivedData::FBuildContext& Context, const ITextureTiler* Tiler, const UE::DerivedData::FUtf8SharedString& BuildFunctionName)
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
FChildBuildData ChildBuildData;
if (!ReadChildBuildInputs(ChildBuildData, Context))
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
TStringBuilder<256> Error;
Error.Appendf(TEXT("Failed to read child build inputs for tiling texture %s, build function %s."), *Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get());
Context.AddError(Error.ToView());
return;
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
// The linear build wrote out an extended data but it must be a linear extended data - convert to what we need.
FCbObject LODBiasCb = Context.FindConstant(UTF8TEXTVIEW("LODBias"));
ChildBuildData.TextureExtendedData = Tiler->GetExtendedDataForTexture(ChildBuildData.TextureDescription, LODBiasCb["LODBias"].AsInt8());
ChildBuildData.NumEncodedMips = ChildBuildData.TextureDescription.GetNumEncodedMips(&ChildBuildData.TextureExtendedData);
ChildBuildData.NumStreamingMips = ChildBuildData.TextureDescription.GetNumStreamingMips(&ChildBuildData.TextureExtendedData, ChildBuildData.EngineParameters);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
UE_LOG(LogTextureBuildFunction, Display, TEXT("Tiling %s with %s -> %d source mip(s) with a tail of %d..."),
*Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get(), ChildBuildData.TextureDescription.NumMips, ChildBuildData.TextureExtendedData.NumMipsInTail);
Update the texture build to route new information out: 1. Whether the source mips detects alpha 2. Several hashes to track the state of data at various stages of the build process. Move the r.SharedLinearTextureEncoding out of the ConsoleManager as that's The Old Way. Rename TextureDerivedDataVersion for uniqueness. #rb devin.doucette #rb charles.bloom #preflight 6377fca7815e4b9b75681765 [CL 23206768 by Dan Thompson in ue5-main branch]
2022-11-18 17:09:58 -05:00
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
//
// Careful - the linear build might have a different streaming mip count than we output due to mip tail
// packing.
//
// If the platform packs mip tails, we need to pass all the relevant mip buffers at once.
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
int32 FirstMipTailIndex;
int32 MipTailCount;
ChildBuildData.TextureDescription.GetEncodedMipIterators(&ChildBuildData.TextureExtendedData, FirstMipTailIndex, MipTailCount);
// We pass views to the tiler, maybe should change,
TArray<FMemoryView, TInlineAllocator<FEncodedTextureExtendedData::MAX_TEXTURE_MIP_COUNT>> MipViews;
for (FSharedBuffer& MipBuffer : ChildBuildData.MipBuffers)
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
MipViews.Add(MipBuffer.GetView());
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
// Process the mips
for (int32 MipIndex = 0; MipIndex < FirstMipTailIndex + 1; MipIndex++)
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
int32 MipsRepresentedThisIndex = MipIndex == FirstMipTailIndex ? MipTailCount : 1;
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
TArrayView<FMemoryView> MipsThisIndex = MakeArrayView(MipViews.GetData() + MipIndex, MipsRepresentedThisIndex);
FSharedBuffer MipData = Tiler->ProcessMipLevel(ChildBuildData.TextureDescription, ChildBuildData.TextureExtendedData, MipsThisIndex, MipIndex);
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
// Make sure we got the size we advertised prior to the build. If this ever fires then we
// have a critical mismatch!
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
check(ChildBuildData.TextureExtendedData.MipSizesInBytes[MipIndex] == MipData.GetSize());
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
ChildBuildData.MipBuffers[MipIndex] = MoveTemp(MipData);
} // end for each mip
WriteChildBuildOutputs(Context, MoveTemp(ChildBuildData));
}
void GenericTextureDecodeBuildFunction(UE::DerivedData::FBuildContext& Context, const UE::DerivedData::FUtf8SharedString& BuildFunctionName)
{
FChildBuildData ChildBuildInputs;
if (!ReadChildBuildInputs(ChildBuildInputs, Context))
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("Failed to read child build inputs for decoding texture %s, build function %s."), *Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get());
Context.AddError(Error.ToView());
return;
}
// Read inputs unique to us.
FName BaseTextureFormatName = NAME_None;
bool bSRGB = false;
const ITextureFormat* BaseTextureFormat = nullptr;
{
FCbObject TextureInfoCb = Context.FindConstant(UTF8TEXTVIEW("TextureInfo"));
ReadCbField(TextureInfoCb["BaseFormatName"], BaseTextureFormatName);
uint16 RequiredVersion = TextureInfoCb["BaseFormatVersion"].AsUInt16();
bSRGB = TextureInfoCb["bSRGB"].AsBool();
if (ITextureFormatManagerModule* TFM = GetTextureFormatManager())
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
BaseTextureFormat = TFM->FindTextureFormat(BaseTextureFormatName);
}
if (!BaseTextureFormat)
{
TStringBuilder<256> Error;
Error << TEXT("Missing texture format: ") << BaseTextureFormatName;
Context.AddError(Error.ToView());
return;
}
uint16 OurVersion = BaseTextureFormat->GetVersion(BaseTextureFormatName);
if (OurVersion != RequiredVersion)
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("%s has version %hu when version %hu is required."), *BaseTextureFormatName.ToString(), OurVersion, RequiredVersion);
Context.AddError(Error.ToView());
return;
}
}
UE_LOG(LogTextureBuildFunction, Display, TEXT("Decoding %s with %s..."), *Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get());
if (!BaseTextureFormat->CanDecodeFormat(ChildBuildInputs.TextureDescription.PixelFormat))
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("Texture format %s can't decode image format %s"), *BaseTextureFormatName.ToString(), GetPixelFormatString(ChildBuildInputs.TextureDescription.PixelFormat));
Context.AddError(Error);
return;
}
EPixelFormat DecodedPixelFormat = PF_Unknown;
for (int32 MipIndex = 0; MipIndex < ChildBuildInputs.NumEncodedMips; MipIndex++)
{
int32 NumSlicesWithDepth = ChildBuildInputs.TextureDescription.GetNumSlices_WithDepth(MipIndex);
int32 SizeX = ChildBuildInputs.TextureDescription.GetMipWidth(MipIndex);
int32 SizeY = ChildBuildInputs.TextureDescription.GetMipHeight(MipIndex);
FImage DecodedImage;
if (!BaseTextureFormat->DecodeImage(SizeX, SizeY, NumSlicesWithDepth, ChildBuildInputs.TextureDescription.PixelFormat,
bSRGB, BaseTextureFormatName, ChildBuildInputs.MipBuffers[MipIndex], DecodedImage, Context.GetName()))
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("Texture format %s failed to decode image format %s, mip %d"), *BaseTextureFormatName.ToString(), GetPixelFormatString(ChildBuildInputs.TextureDescription.PixelFormat), MipIndex);
Context.AddError(Error);
return;
}
ERawImageFormat::Type NeededConversion;
DecodedPixelFormat = FImageCoreUtils::GetPixelFormatForRawImageFormat(DecodedImage.Format, &NeededConversion);
if (NeededConversion != DecodedImage.Format)
{
FImage ConvertedImage;
DecodedImage.CopyTo(ConvertedImage, NeededConversion, DecodedImage.GammaSpace);
ChildBuildInputs.MipBuffers[MipIndex] = MakeSharedBufferFromArray(MoveTemp(ConvertedImage.RawData));
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
else
{
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
ChildBuildInputs.MipBuffers[MipIndex] = MakeSharedBufferFromArray(MoveTemp(DecodedImage.RawData));
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
ChildBuildInputs.TextureExtendedData.MipSizesInBytes[MipIndex] = ChildBuildInputs.MipBuffers[MipIndex].GetSize();
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
Preview Platform Textures -- Added Decode interface to texture formats to return to PC viewable formats. -- Added Detile interface to return textures to linear layout for relevant platforms. -- Reworked the IBuild "DDC2" texture build usage to be more straightforward for chaining multiple build steps (i.e. Encode -> Tile -> Detile -> Decode). -- Added UI to the texture editor to select a target platform to view. -- Fixed a bug with DDC2 and CPU Copy textures (they didn't work at all) #rb Devin.Doucette, fabian.giesen, charles.bloom #jira UE-149124 [CL 33116818 by dan thompson in ue5-main branch]
2024-04-19 16:57:52 -04:00
ChildBuildInputs.TextureDescription.PixelFormat = DecodedPixelFormat;
WriteChildBuildOutputs(Context, MoveTemp(ChildBuildInputs));
}
void GenericTextureDetileBuildFunction(UE::DerivedData::FBuildContext& Context, const ITextureTiler* Tiler, const UE::DerivedData::FUtf8SharedString& BuildFunctionName)
{
FChildBuildData ChildBuildInputs;
if (!ReadChildBuildInputs(ChildBuildInputs, Context))
{
TStringBuilder<256> Error;
Error.Appendf(TEXT("Failed to read child build inputs for detiling texture %s, build function %s."), *Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get());
Context.AddError(Error.ToView());
return;
}
UE_LOG(LogTextureBuildFunction, Display, TEXT("De-Tiling %s with %s -> %d source mip(s) with a tail of %d..."),
*Context.GetName(), StringCast<TCHAR>(*BuildFunctionName).Get(), ChildBuildInputs.TextureDescription.NumMips, ChildBuildInputs.TextureExtendedData.NumMipsInTail);
FEncodedTextureDescription::FUniqueBufferMipChain LinearMips;
Tiler->DetileMipChain(LinearMips, ChildBuildInputs.MipBuffers, ChildBuildInputs.TextureDescription, ChildBuildInputs.TextureExtendedData, *Context.GetName());
ChildBuildInputs.MipBuffers.Reset(LinearMips.Num());
for (FUniqueBuffer& Buffer : LinearMips)
{
ChildBuildInputs.MipBuffers.Add(Buffer.MoveToShared());
}
// After we detile, we are a linear texture:
ChildBuildInputs.TextureExtendedData = FEncodedTextureExtendedData();
ChildBuildInputs.NumEncodedMips = ChildBuildInputs.TextureDescription.GetNumEncodedMips(nullptr);
ChildBuildInputs.NumStreamingMips = ChildBuildInputs.TextureDescription.GetNumStreamingMips(nullptr, ChildBuildInputs.EngineParameters);
WriteChildBuildOutputs(Context, MoveTemp(ChildBuildInputs));
Shared Linear Texture Encoding [DDC2] -- Separates out the platform tiling code to allow for texture builds to reuse the linear texture that gets encodes with windows. Primary Components: DDC2 texture build input/output revamped to support future FDerivedData references where the bulk data remains in the Zen server during cooks. Tiling code is separated out in to ITextureTiler interface so that tiling can be done without calling FChildTextureFormat::CompressImage[Ex] Adding mip dimensions to GetMipCountForBuildSettings #rb fabian.giesen, zousar.shaker #preflight 6304f87f516bef57ffada18d [CL 21511157 by Dan Thompson in ue5-main branch]
2022-08-23 12:41:58 -04:00
}
Reference in New Issue Copy Permalink