Commit Graph

72 Commits

Author SHA1 Message Date
aurel cordonnier
7f517562d5 Merge from Release-Engine-Staging @ 17438845 to Release-Engine-Test
This represents UE4/Main @17430120 and Dev-PerfTest @17437669

[CL 17439044 by aurel cordonnier in ue5-release-engine-test branch]
2021-09-06 12:23:53 -04:00
aurel cordonnier
dc4bf61540 Merge from Release-Engine-Staging @ 17030559 to Release-Engine-Test
This represents UE4/Main @ 17030256 and Dev-PerfTest @ 17030553

[CL 17031509 by aurel cordonnier in ue5-release-engine-test branch]
2021-08-03 11:56:47 -04:00
per larsson
e8e3d67ddb Fix crash when running CsvPerfReport tool with non US culture
- convert floats,doubles with invariant number format
- catch format exception and return default value

#rb Paul.Chipchase, Ben Woodhouse
#rnx
#jira none

#ROBOMERGE-SOURCE: CL 16922317 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v836-16769935)

[CL 16922383 by per larsson in ue5-release-engine-test branch]
2021-07-22 08:07:48 -04:00
ben woodhouse
6a9e5a715a PerfReportTool 4.62 - Make scrollableFormatting and reverseSortRows properties of the table, settable in XML. Commandline overrides still work
- Modify defined tables to use the new attributes

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16797223 via CL 16797225 via CL 16797229 via CL 16797233
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v836-16769935)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16804512 by ben woodhouse in ue5-release-engine-test branch]
2021-07-01 13:12:17 -04:00
ben woodhouse
a718b6aaf5 PerfReportTool 4.61 - Reset attributes on map summary files after copying. This ensures the file is not readonly, even if the source file is
#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16797090 via CL 16797093 via CL 16797098 via CL 16797099
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v836-16769935)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16804505 by ben woodhouse in ue5-release-engine-test branch]
2021-07-01 13:11:29 -04:00
ben woodhouse
3bce99225b Move SummaryTableElement and SummaryTableRowData into separate SummaryTableData.cs file.
This moves core data and summary table cache serialization away from the higher level summary table logic

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16796939 via CL 16796941 via CL 16796946 via CL 16796948
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v836-16769935)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16804501 by ben woodhouse in ue5-release-engine-test branch]
2021-07-01 13:10:41 -04:00
ben woodhouse
49e3a1af3f PerfReportTool 3.60. Refactoring:
- Split classes into separate files
- Make Summary types self-register so they're self-contained and more easily extendable
- Remove redundant XmlHelper class, convert existing usage of this to use the GetSafeAttribute method
- Output is unchanged (verified with unit tests)
#jira

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16796904 via CL 16796908 via CL 16796909 via CL 16796910
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v836-16769935)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16804496 by ben woodhouse in ue5-release-engine-test branch]
2021-07-01 13:09:53 -04:00
ben woodhouse
f081dc6e12 PerfReportFort 4.52
- Add support for 3 levels of section barrier. Replace the bool "minor" attribute with int "level" attribute which can be 0,1 or 2 (0 is thickest)
- Fix bug where filter order is ignored for columns in the rowSort list in collated summary tables. Columns we're collating by will still appear first, but their relative order is preserved
- Adjust automated test summary table ordering to sort first by release version

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16770651 via CL 16770653 via CL 16770656 via CL 16770657
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v836-16769935)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16770688 by ben woodhouse in ue5-release-engine-test branch]
2021-06-24 07:42:49 -04:00
ben woodhouse
decfed0925 PerfReportTool 4.51 - scrollable summary table improvements
- Add support for more than two sticky columns in collated summary tables
- Add format info for columns, replaces "lowIsBad" list. Allows specifying auto colorization rules and also numerical formatting
- Add support for multiple section boundaries, and minor (dashed line) section boundaries
- Section boundaries no longer require startToken or endToken (both are now optional)
- Section boundaries now can be specific to collated or full tables

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 16740162 via CL 16740164 via CL 16740166 via CL 16740221
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v835-16672529)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16742906 by ben woodhouse in ue5-release-engine-test branch]
2021-06-22 10:36:56 -04:00
aurel cordonnier
25a11deeac Merge from Release-Engine-Staging @ 16579919
This represents UE4/Main @ 16579691 and Dev-PerfTest @ 16579576

[CL 16581170 by aurel cordonnier in ue5-release-engine-test branch]
2021-06-07 20:09:45 -04:00
ben woodhouse
1277942245 PerfReportTool 4.49.2 - Fix non-rounded numbers in the FPSChart summary
Update test data
[FYI] robert.millar

#ROBOMERGE-SOURCE: CL 16479765 via CL 16479776 via CL 16479781 via CL 16479784
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v823-16466674)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16479786 by ben woodhouse in ue5-release-engine-test branch]
2021-05-26 21:38:09 -04:00
ben woodhouse
0119a32ea4 PerfReportTool 4.49.1: Fix access none with single CSV mode peak summary
#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16479526 via CL 16479531 via CL 16479538 via CL 16479542
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v823-16466674)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16479692 by ben woodhouse in ue5-release-engine-test branch]
2021-05-26 21:22:37 -04:00
ben woodhouse
dcca425837 PerfReportTool 4.49: Fix latent bug with PRC color serialization (ToString() not implemented).
- Don't specify colours for PeakSummary report type. Pass null instead and have it set them automatically (this also avoids the need to serialize)

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16459036 via CL 16459039 via CL 16459051 via CL 16459069
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v818-16446889)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16459138 by ben woodhouse in ue5-release-engine-test branch]
2021-05-25 20:22:42 -04:00
ben woodhouse
fdd36c7fdb PerfReportTool 4.48
- Refactor Peaks Summary to remove a lot of legacy code
  - Sections can now be specified via summarySection elements in the XML
  - Remove inMainSummary from graph elements
- Fix precision issue with SummaryTable data. Always store as doubles - never go via strings for numeric data
   - NOTE: we are intentionally not bumping the SummaryTableCache version to avoid unnecessary churn here. Users can force an invalidate if necessary
- Pre-sort summary table to ensure deterministic output
- Update test results

#ROBOMERGE-OWNER: Ben.Woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16451878 via CL 16452760 via CL 16452854 via CL 16452934
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v818-16446889)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16459127 by ben woodhouse in ue5-release-engine-test branch]
2021-05-25 20:21:55 -04:00
Marc Audy
e80ea6b959 Merge from Release-Engine-Staging @ 16444985
This represents UE4/Main @ 16445039 and Dev-PerfTest @ 16444526

[CL 16445122 by Marc Audy in ue5-release-engine-test branch]
2021-05-25 02:43:26 -04:00
ben woodhouse
15e6f5a2d2 Integrate CL 16308862 from Dev-EngineMerge: PerfReportTool 4.47 - ExtraLinks summary
Change 16308862 by ben.woodhouse[at]ROBOMERGE_FORTNITE_Dev_EngineMerge on 2021/05/12 22:00:30

PerfReportTool 4.47 - ExtraLinks summary
Adds a new ExtraLinks summary type, which reads a <csvfilename>.links file. The file contains lines with additional links in the format:
LongName,ShortName,URL

These links are added to a new Links section of the report. They are also added to summary table row, with the LongName as the key.

The section can be added to all reports by adding with -extraLinksSummary, or add the summary type "ExtraLinks" to the Report type XML.

#ROBOMERGE-SOURCE: CL 16308651 via CL 16309102 via CL 16315492
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Release-Engine-Test) (v804-16311228)
#ROBOMERGE[STARSHIP]: UE5-Main

[CL 16315504 by ben woodhouse in ue5-release-engine-test branch]
2021-05-13 13:54:13 -04:00
Marc Audy
f02d489290 Update Release-Engine-Test from Release-Engine-Staging @ 16264272
[CL 16264458 by Marc Audy in ue5-release-engine-test branch]
2021-05-11 01:10:20 -04:00
ben woodhouse
cdeb752863 PerfReportTool 4.45
- make -csvLinkRootPath work any type of path. Links are made relative to the passed-in csv directory and then the new root is added

#ROBOMERGE-SOURCE: CL 16178660 via CL 16178671 via CL 16178673 via CL 16208175
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v796-16191650)

[CL 16208185 by ben woodhouse in ue5-main branch]
2021-05-05 11:51:38 -04:00
ben woodhouse
ea37cceb85 PerfReportTool 4.44
-add -reportLinkRootPath arg to make report links relative to a particular location
-add -csvLinkRootPath arg to make CSV links relative to a particular location
-add -listFiles arg to just list files that pass the filter instead of processing them

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 16177813 via CL 16177817 via CL 16177818 via CL 16178057
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v792-16166999)

[CL 16178065 by ben woodhouse in ue5-main branch]
2021-05-01 15:23:22 -04:00
aurel cordonnier
50944fd712 Merge UE5/RES @ 16162155 to UE5/Main
This represents UE4/Main @ 16130047 and Dev-PerfTest @ 16126156

[CL 16163576 by aurel cordonnier in ue5-main branch]
2021-04-29 19:32:06 -04:00
ben woodhouse
e3ad811d6b Add missing file from CL 16110876
#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16110880 via CL 16110883 via CL 16110885 via CL 16110886
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16117146 by ben woodhouse in ue5-main branch]
2021-04-26 14:45:34 -04:00
ben woodhouse
d36b7af983 PerfReportTool 4.43
- Add support for >,<,>=,<= operators for metadata queries (for numerical fields)
- Use doubles for SummaryTable/SummaryTableColumn values, so we can accurately show display values (does not affect summary cache - this was already at double precision)

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16110876 via CL 16110877 via CL 16110881 via CL 16110882
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16117137 by ben woodhouse in ue5-main branch]
2021-04-26 14:44:53 -04:00
ben woodhouse
867df3f118 PerfReportTool 4.42
- Add -requireMetadata option to ignore CSVs without metadata
- Clean up help text so the lines arent too long for standard console output

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16105233 via CL 16105248 via CL 16105254 via CL 16105255
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116861 by ben woodhouse in ue5-main branch]
2021-04-26 14:28:01 -04:00
ben woodhouse
41de178a81 PerfReportTool 4.41
- add -summaryTableCacheUseOnlyCsvID param to ignore the ReportType hash and just use the CSV ID for summaryTableCache ID entries. This is a good idea if you want these files to persist and you don't want them to be regenerated when report types change
- Add ReportType and ReportTypeID to the summaryTable ToolMetaData entries
- Use the reportType name as part of the report hash (this will invalidate existing cache files!)

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16024419 via CL 16024452 via CL 16024531 via CL 16045954
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116846 by ben woodhouse in ue5-main branch]
2021-04-26 14:27:22 -04:00
ben woodhouse
14fb564e7e PerfReportTool 4.40
- Refactor code to avoid use of the term Metadata to refer to summary table row data. The term metadata was easily confused with CSV metadata, and in most cases, it wasn't actually metadata.
- This refactor resulted in some minor breaking changes in XML format and command line params. The affected reports and scripts have been fixed up accordingly

The following were renamed:
SummaryMetadata -> SummaryTableRowData
SummaryMetadataValue->SummaryTableElement
SummaryMetadataTable->SummaryTable
metadataKey -> summaryStatName (also affects XML)
metadataPrefix -> summaryStatNamePrefix (also affects XML)
metadataCache -> summaryTableCache
Commandline params, e.g: -metadataCache -> -summaryMetadataCache


#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16023141 via CL 16023153 via CL 16023173 via CL 16045518
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116817 by ben woodhouse in ue5-main branch]
2021-04-26 14:25:00 -04:00