Commit Graph

346 Commits

Author SHA1 Message Date
johan berg
0d74ea37ae [Insights] Memory units IEC compatible, use ToString to log stringbuilder.
#rb ionut.matasaru

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18430091 in //UE5/Release-5.0/... via CL 18435285
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18435510 by johan berg in ue5-release-engine-test branch]
2021-12-10 17:45:22 -05:00
johan berg
a0801850e1 [Insights] Added Trace.status console command
Added console command to print status of trace to in game console. In order to list the available channels a enumeration method was added.

#rb martin.ridgers
#jira UE-136018
#preflight 61b32d0dc01c89f906dc3dbd

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18429738 in //UE5/Release-5.0/... via CL 18429749
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18429751 by johan berg in ue5-release-engine-test branch]
2021-12-10 05:52:36 -05:00
johan berg
745283887e Fix unity issue.
#rb none

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18429680 in //UE5/Release-5.0/... via CL 18429694
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18429696 by johan berg in ue5-release-engine-test branch]
2021-12-10 05:31:26 -05:00
johan berg
504310ad02 [Insights] TraceMalloc should not use it's own root heap
* TraceMalloc should not use it's own root heap. Instead it will use a regular heap in system memory and make fake heaps (since we can't track virtual allocations for trace's own allocations).
 * The first named was miscategorized as a root heap.

#rb ionut.matasaru

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18417001 in //UE5/Release-5.0/... via CL 18417015
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v897-18405271)

[CL 18417028 by johan berg in ue5-release-engine-test branch]
2021-12-09 04:07:17 -05:00
johan berg
f0f428cd8f [Insights] Add special tag for Trace.
* Adds special value reserved to Trace allocations
 * Adds checks to avoid collisions between FName indices and ELLMTags.
#preflight 61af41ca353890ce23edcf36

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18393722 in //UE5/Release-5.0/... via CL 18393732
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v896-18170469)

[CL 18393738 by johan berg in ue5-release-engine-test branch]
2021-12-07 06:54:54 -05:00
andrew firth
cf447a1923 [CsvProfiler] - enable continuous writes
#rb Ben.Woodhouse
#preflight 6155e22d9ed4ad000136d556

#ROBOMERGE-AUTHOR: andrew.firth
#ROBOMERGE-SOURCE: CL 17680019 via CL 17966846 via CL 18365976 via CL 18366088
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18366185 by andrew firth in ue5-release-engine-test branch]
2021-12-03 01:32:26 -05:00
andrew firth
98a85f7fdd [CSV] - adding SystemMaxMB to CSV reports to represent console retail memory limit on the produced graphs.
[at]Brandon.Dawson
#preflight 613a73890c19af0001d3358e

#ROBOMERGE-AUTHOR: andrew.firth
#ROBOMERGE-SOURCE: CL 17477492 via CL 17926806 via CL 18361979 via CL 18362053
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18362119 by andrew firth in ue5-release-engine-test branch]
2021-12-02 18:58:00 -05:00
jon nabozny
4b2669cd2b [CSVProfiler] - move initialization of ExtraDevMemory to an explicit call POST initialization of platform memory subsystems to avoid initialization order problems with the first call to the CSVProfiler singleton.
[at]Ben.Woodhouse
#rb Ben.Woodhouse
#preflight 6138c4f99c40ec0001271e5d

#ROBOMERGE-OWNER: jon.nabozny
#ROBOMERGE-AUTHOR: andrew.firth
#ROBOMERGE-SOURCE: CL 17458711 via CL 17911290 via CL 18360722 via CL 18361121
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18361361 by jon nabozny in ue5-release-engine-test branch]
2021-12-02 18:21:43 -05:00
johan berg
6664e6cbee [Insights] TraceLog stat group to visualize memory usage.
#rb martin.ridgers

#ROBOMERGE-AUTHOR: johan.berg
#ROBOMERGE-SOURCE: CL 18299416 in //UE5/Release-5.0/... via CL 18299428
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18299432 by johan berg in ue5-release-engine-test branch]
2021-11-26 07:45:51 -05:00
ilya loshchinin
0b8d203984 NonUnity buildfix
#ROBOMERGE-AUTHOR: ilya.loshchinin
#ROBOMERGE-SOURCE: CL 18288411 via CL 18288896 via CL 18288944 via CL 18290354 via CL 18290400
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18290426 by ilya loshchinin in ue5-release-engine-test branch]
2021-11-24 18:30:02 -05:00
ilya loshchinin
0e3e31ab74 CsvProfiler: allow disabling categories through configuration by using [CsvProfiler]/DisabledCategories array.
#rb ben.woodhouse
#preflight 619e5fe6ee100b68fa301e2c

#ROBOMERGE-AUTHOR: ilya.loshchinin
#ROBOMERGE-SOURCE: CL 18286466 via CL 18286469 via CL 18286473 via CL 18287851 via CL 18287893
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18287945 by ilya loshchinin in ue5-release-engine-test branch]
2021-11-24 15:42:26 -05:00
jason nadro
3f6970e4fc Remove compiler message that was used to debug a potential build issue.
#rb trivial
#jira none

#ROBOMERGE-AUTHOR: jason.nadro
#ROBOMERGE-SOURCE: CL 18273198 in //UE5/Release-5.0/... via CL 18273210
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18273215 by jason nadro in ue5-release-engine-test branch]
2021-11-23 14:10:42 -05:00
jason nadro
b1f38b302c Moving implementations of FResourceSize into the cpp.
#rb trivial
#jira none
#preflight 619d0a2b88439fccfe83ed5b

#ROBOMERGE-AUTHOR: jason.nadro
#ROBOMERGE-SOURCE: CL 18272635 in //UE5/Release-5.0/... via CL 18272657
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18272683 by jason nadro in ue5-release-engine-test branch]
2021-11-23 13:20:25 -05:00
jason nadro
b006d328f3 Testing adding a new file with a pragma message to ensure horde jobs have synced and built the file.
#rb trivial
#jira none

#ROBOMERGE-AUTHOR: jason.nadro
#ROBOMERGE-SOURCE: CL 18271453 in //UE5/Release-5.0/... via CL 18271461
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18271471 by jason nadro in ue5-release-engine-test branch]
2021-11-23 12:02:46 -05:00
jason nadro
40819376d6 [BuildFix] - Partially reverting my previous change (CL# 18259478) by putting the implementations back into the header.
#rb trivial
#jira none
#preflight 619bde671806a2425923ec2a

#ROBOMERGE-AUTHOR: jason.nadro
#ROBOMERGE-SOURCE: CL 18261575 in //UE5/Release-5.0/... via CL 18261586
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18261600 by jason nadro in ue5-release-engine-test branch]
2021-11-22 14:28:19 -05:00
jason nadro
21eb49709d Extend FResourceSizeEx to keep track of name for each memory size added. This allows for verbose reporting of resource sizes.
This results in output like the following:

                                                                                                                            Object      NumKB      MaxKB   ResExcKB  ResExcDedSysKB  ResExcDedVidKB  ResExcUnkKB
StaticMesh /Game/AncientContent/Megascans/Surfaces/Rock/SM_RockRough1.SM_RockRough1       1.31          1.33     395.50           12.75                  0.00                 382.75
						                               None                                                 12.75
							               None                                                  0.79
							               TexcoordBuffer and TangentBuffer       66.35
							               PositionVertexBuffer                            5.53
							               ColorVertexBuffer                              22.12
							               IndexBuffer                                       95.99
							               ReversedDepthOnlyIndexBuffer           95.99
							               ReversedIndexBuffer                          95.99
							               WireframeIndexBuffer                          0.00

- Adding a `-verbose` flag to `obj list` which will dump each tracked named size.
- Adding additional `AddSharedSystemMemoryBytes(const FName& Tag, const SIZE_T InMemoryBytes)` function which accepts a named tag.
- Modify FStaticMeshLODResources::GetResourceSizeEx() to use the new interface.
- Modify FSkeletalMeshLODRenderData::GetResourceSizeEx() to use the new interface.
- Remove the "Shared" version of the memory tracking functions.  These are not used at all across the engine.  This simplifies the code and makes the output of obj list more readable.
- Move FResourceSizeEx into its own cpp file so modifying the header isn't a painful full recompile.

#rb dave.jones2
#jira none
#preflight 619bb03f88439fccfe625cba

#ROBOMERGE-AUTHOR: jason.nadro
#ROBOMERGE-SOURCE: CL 18259478 in //UE5/Release-5.0/... via CL 18259492
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18259504 by jason nadro in ue5-release-engine-test branch]
2021-11-22 11:54:59 -05:00
ben woodhouse
42c2be7740 Csv profiler named event support
Add support for emitting named events from timing stats without compiling them in. This is controlled via new commandline options, which can be used in combination:
 -csvNamedEvents emits named events for exclusive stats
 -csvNamedEventsTiming emits named events for standard timing stats

Instrumentation overhead reduction
-Make it possible to disable CSVPROFILERTRACE_ENABLED, since this increases CSV profiler instrumentation overhead by about 15%
- Remove LLM scopes from stat functions and move into stat block allocation function. Reduces overhead slightly

#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 18253615 via CL 18253616 via CL 18253618 via CL 18253622 via CL 18253625 via CL 18254405 via CL 18254407
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v895-18170469)

[CL 18254408 by ben woodhouse in ue5-release-engine-test branch]
2021-11-21 07:17:10 -05:00
Marc Audy
0c3be2b6ad Merge Release-Engine-Staging to Test @ CL# 18240298
[CL 18241953 by Marc Audy in ue5-release-engine-test branch]
2021-11-18 14:37:34 -05:00
martin ridgers
9e22ed453e Don't spawn the trace server if -buildmachine is present on the command line.
#rb cdp
#rnx
#ushell-cherrypick of 18032861 by Catalin.Dragoiu
#preflight 618cd047026d8c8fe93d14ee

#ROBOMERGE-AUTHOR: martin.ridgers
#ROBOMERGE-SOURCE: CL 18147522 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v889-18060218)

[CL 18147535 by martin ridgers in ue5-release-engine-test branch]
2021-11-11 03:44:15 -05:00
aurel cordonnier
fc542f6cfd Merge from Release-Engine-Staging @ 18081189 to Release-Engine-Test
This represents UE4/Main @18073326, Release-5.0 @18081140 and Dev-PerfTest @18045971

[CL 18081471 by aurel cordonnier in ue5-release-engine-test branch]
2021-11-07 23:43:01 -05:00
martin ridgers
7f6469353a Wrong CreateProcess() flag to pop out a debug console window.
#rnx

#ROBOMERGE-AUTHOR: martin.ridgers
#ROBOMERGE-SOURCE: CL 18048657 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v885-17909292)

[CL 18048709 by martin ridgers in ue5-release-engine-test branch]
2021-11-04 03:50:01 -04:00
aurel cordonnier
a6e741e007 Merge from Release-Engine-Staging @ 17915896 to Release-Engine-Test
This represents UE4/Main @17911760, Release-5.0 @17915875 and Dev-PerfTest @17914035

[CL 17918595 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-25 20:05:28 -04:00
martin ridgers
718662ba87 -tracenocache command line option allowing users to optionall disable the caching of important trace events if they so wish.
#rb jb
#rnx

#ROBOMERGE-AUTHOR: martin.ridgers
#ROBOMERGE-SOURCE: CL 17857945 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v883-17842818)

[CL 17857961 by martin ridgers in ue5-release-engine-test branch]
2021-10-19 04:09:47 -04:00
aurel cordonnier
a12d56ff31 Merge from Release-Engine-Staging @ 17791557 to Release-Engine-Test
This represents UE4/Main @17774255, Release-5.0 @17791557 and Dev-PerfTest @17789485

[CL 17794212 by aurel cordonnier in ue5-release-engine-test branch]
2021-10-12 21:21:22 -04:00
aurel cordonnier
69fe095547 Merge from Release-Engine-Staging @ 17636544 to Release-Engine-Test
This represents UE4/Main @17638339 and Dev-PerfTest @17636504

[CL 17638842 by aurel cordonnier in ue5-release-engine-test branch]
2021-09-27 19:54:25 -04:00