Commit Graph

152 Commits

Author SHA1 Message Date
tyler staples
7ab16f4e82 PerfReportTool - Fix divide by 0 issue in MVP calculation.
[FYI] andrew.ladenberger

[CL 25035524 by tyler staples in ue5-main branch]
2023-04-13 20:28:01 -04:00
tyler staples
d2ddfa358a PerfReportTool - Add support for date formats and disabling column word wrap.
#rb ben.woodhouse

[CL 24905945 by tyler staples in ue5-main branch]
2023-04-03 22:30:12 -04:00
andrew ladenberger
b74738167a [PerfReportTool] Removed gamethread histogram from the summary table. This works better as part of the report (see HistogramSummary.cs)
#rb tyler.staples, ben.woodhouse

[CL 24343562 by andrew ladenberger in ue5-main branch]
2023-02-21 13:09:49 -05:00
ben woodhouse
0e7d1d7ea0 PerfReportTool - Add -summaryTableXmlRowSortAppend arg to allow appending values to a summary table's row sort list via the commandline
[CL 24136498 by ben woodhouse in ue5-main branch]
2023-02-11 12:25:29 -05:00
ben woodhouse
f7cd8f51d5 PerfReportTool: add -summaryTableXmlAppend arg for appending stats/metrics to the end of a summary table's filter list via the commandline. This allows us to append multiple stats (-summaryTableXmlSubst only supports one stat per substitution)
[CL 24092968 by ben woodhouse in ue5-main branch]
2023-02-09 00:36:36 -05:00
ben woodhouse
3785b38b51 PerfReportTool - support writing PRC json to separate files, via -summaryTableToJsonSeparateFiles. Also add -summaryTableToJsonNoIndent option
[CL 23462559 by ben woodhouse in ue5-main branch]
2022-12-09 08:21:02 -05:00
ben woodhouse
f02d3c3cc7 PerfReportTool - fix help formatting so it fits in a standard 120-character wide command prompt and make some descriptions more concise.
[FYI] tyler.staples

[CL 23462265 by ben woodhouse in ue5-main branch]
2022-12-09 07:21:26 -05:00
ben woodhouse
a7c96a8ca4 PerfReportTool 4.99.0
- Add support for a default report type. This will be considered if autodetection otherwise fails
- Add a requiredForDefaultFallback param to make specific metadata matches optional if we're falling back. This defaults to 1 (true)
- Add allowAutoDetect flag to reports so they can opt out of autodetection (these need to be specified explicitly)

[CL 23263072 by ben woodhouse in ue5-main branch]
2022-11-24 19:13:30 -05:00
jordan cristiano
4e35c288f8 Added output of per-event mvp, hitches data so we can reference it in summary tables.
#rb tyler.staples
[FYI] andrew.ladenberger, ben.woodhouse

[CL 22999920 by jordan cristiano in ue5-main branch]
2022-11-04 22:29:17 -04:00
tyler staples
c4009bdc7b PerfReportTool - Fix off by one error in regression filter when counting rows in first row group.
+ Also added handling for if all data is part of the same row group or if there are no rows (avoid divide by 0).

#rb ben.woodhouse

[CL 22961417 by tyler staples in ue5-main branch]
2022-11-03 15:02:31 -04:00
tyler staples
3b43312f37 PerfReportTool - Add support for regression and other column filters.
+ Additional column filters can now be created by implementing ISummaryTableColumnFilter and adding it to the list in Program.MakeAdditionalColumnFilters.
+ Moved stat threshold checks into an additional filter.
+ Added a column filter to hide metadata columns.
+ Added a column filter to only show columns where the most recent build has regressed by more than a given threshold.
+ You can now use 'debugShowFilteredColumns' to have columns be grayed out instead of removed. Hovering over them will show the reason they were filtered out (which filter and the reason). This is for debugging purposes and sanity checks to make sure you're not missing important information, especially when iterating on new filters. Some additional settings were added to SummaryTableColumn to support this.
+ Filters can also mark individual cells as 'invalid' to indicate they are not taken into consideration for that filter. These are grayed out with a tooltip when debugShowFilteredColumns is enabled. Currently this does not work in collated views.
+ Added the ability to set tooltips for column headers.
+ Added the ability to add a color modifier for the entire column or individual cells.

#rb ben.woodhouse

[CL 22890943 by tyler staples in ue5-main branch]
2022-11-01 16:30:42 -04:00
tyler staples
b02c452ae8 PerfReportTool - Update budget colour scheme to match auto as it's much easier on the eyes.
#rb ben.woodhouse

[CL 22798511 by tyler staples in ue5-main branch]
2022-10-26 19:10:45 -04:00
tyler staples
c94b11439d PerfReportTool - Add support for colourThreshold overrides in summaryTableColumnFormatInfo.
This allows setting colourThresholds globally for an entire column, overriding other settings.

Also added support for specifiying the actual colours and if they should be lerped between or not.
Note: lerpColours isn't currently serialized to prc files.

#rb ben.woodhouse

[CL 22712141 by tyler staples in ue5-main branch]
2022-10-22 15:34:08 -04:00
tyler staples
d49dd7aded PerfReportTool - Add support for showing value buckets in columns.
This allows you to define a list of value thresholds for a column and the bucket names that correspond with each threshold. When present the corresponding bucket name will be displayed in the column instead of/with the value.

#rb ben.woodhouse

[CL 22670762 by tyler staples in ue5-main branch]
2022-10-20 16:47:38 -04:00
tyler staples
ed4771efaa Fixed inconsistencies with -colorizeTable and it not correctly overriding the colorMode set in the summary table xml.
+ 'default' now only exists as an argument and not an actual state as default means use what is defined in the summary table xml file.
+ Removed the 'Default' TableColorizeMode value and added a 'Budget' value which represents budget coloring.

#rb ben.woodhouse

[CL 22662548 by tyler staples in ue5-main branch]
2022-10-20 13:44:01 -04:00
andrew ladenberger
190bdcd52c PerfReportTool : Minor QoL updates for histograms
- Show decimals on histogram thresholds
- Shift the gamethread summary table histogram down (75%-150%)
- Renamed the gamethread summary table histogram

#rb brant.french
[FYI] tyler.staples, ben.woodhouse

[CL 22217649 by andrew ladenberger in ue5-main branch]
2022-09-27 23:53:18 -04:00
ben woodhouse
fe8e2509aa PerfReportTool 4.94.2 - Fix diff row bug which caused an extra all-zero row to be created for every diff row added. This was breakng automatic colorization, causing all previous rows to be red
[CL 21500256 by ben woodhouse in ue5-main branch]
2022-08-22 21:35:10 -04:00
ben woodhouse
9bcde0bc1e Make "BoundedStatValuesSummary: end event appeared before the start event" non-fatal.
[CL 21500252 by ben woodhouse in ue5-main branch]
2022-08-22 21:35:02 -04:00
ben woodhouse
39009136b1 PerfReportTool 4.94 - Fix exception in HistogramSummary when SelectedStat doesn't exist. This was breaking perf reporting for devices without a GPUTime stat
[CL 21499928 by ben woodhouse in ue5-main branch]
2022-08-22 21:21:55 -04:00
andrew ladenberger
49ad5a8fc1 [PerfReportTool] Added gamethread summary stat for percent of frames over fps target at {1.25x, 1.5x, 1.75x, 2x}. This can be used in summary tables to show a histogram distrubition.
#rb ben.woodhouse
[FYI] tyler.staples, jordan.cristiano

#ROBOMERGE-AUTHOR: andrew.ladenberger
#ROBOMERGE-SOURCE: CL 21386718 via CL 21389178 via CL 21389672
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v975-21357124)

[CL 21391174 by andrew ladenberger in ue5-main branch]
2022-08-15 14:54:21 -04:00
andrew ladenberger
679b0004c6 PerfReportTool - Updated the Histogram summary table
- New option to suppress the averages table
- Reversed from under to over budget
- Removed the hitch table since the tool already has a seperate hitch summary

#rb Ben.Woodhouse
[FYI] Tyler.Staples

#ROBOMERGE-AUTHOR: andrew.ladenberger
#ROBOMERGE-SOURCE: CL 21358870 via CL 21358876 via CL 21358887
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21360773 by andrew ladenberger in ue5-main branch]
2022-08-12 15:06:33 -04:00
ben woodhouse
a3c3ea66e9 PerfReportTool 4.91 - replace autoColorize bool xml param with colorizeMode, which can be default, auto or off (new option). Add equivalent commandline param (-colorizeTable)
- Adding a diff row no longer disables colorization (unless colorizeMode is explicitly set to off)
- More formatting improvements for transposed tables

#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 21238557 via CL 21238558 via CL 21239577
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21239660 by ben woodhouse in ue5-main branch]
2022-07-26 17:00:58 -04:00
ben woodhouse
458e3e3917 PerfReportTool - more formatting improvements
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 21237283 via CL 21237284 via CL 21237285
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21237312 by ben woodhouse in ue5-main branch]
2022-07-25 20:11:06 -04:00
ben woodhouse
c3331cec01 PerfReportTool 4.90 - Improve column formatting. Remove hacky min-width calculation and just rely on CSS no-wrap.
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 21236844 via CL 21236845 via CL 21236850
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21236864 by ben woodhouse in ue5-main branch]
2022-07-25 15:56:41 -04:00
ben woodhouse
4a7608d6cb Reduce thresholds for diff column colourization
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 21236790 via CL 21236792 via CL 21236794
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v972-20964824)

[CL 21236805 by ben woodhouse in ue5-main branch]
2022-07-25 15:40:56 -04:00