Commit Graph

198 Commits

Author SHA1 Message Date
ben woodhouse
cb37d31a43 PerfReportTool 4.235.0. Add hideInDetailedReports attribute to summaries allowing them to be suppressed. This is useful if you only want to emit summary table row data for a given summary
[CL 32185090 by ben woodhouse in ue5-main branch]
2024-03-12 13:33:03 -04:00
ben woodhouse
f27a3c8875 PerfReportTool 4.234.0
- Add support for startEvent and stopEvent in graphs
- Add requiredEvents field for graphs so we can suppress graphs based on whether particular events are present

[CL 32016929 by ben woodhouse in ue5-main branch]
2024-03-05 08:03:21 -05:00
ben woodhouse
3c075bb5c1 CSVToSVG 3.61
- Add -startEvent and -endEvent params to start and stop graphing at a particular event
- The params -startEventOffset and -endEventOffset allow you to offset the start/end by a particular number of frames
- If multiple CSVs are being processed, the data is cropped so frame counts start from zero
- The existing -maxx and -maxy parameters are relative to the adjusted CSV (e.g so -maxx=200 with -startEvent gc will capture 200 frames from the first gc)
- Fix bug with legend sorting. Frame is now always top
- Fix bug with auto Y axis scaling when a range is specified. Use the range instead of the whole CSV

Common
- Fix commandline parsing for negative numbers. Negative numbers are always recognized as values rather than param names

[FYI] tyler.staples

[CL 32016893 by ben woodhouse in ue5-main branch]
2024-03-05 08:00:20 -05:00
ben woodhouse
d4d2df2b83 PerfReportTool 4.233.0 : Unify wildcard handling for summary tables so it correctly matches mid-string wildcards. Also optimize using a binary search
[CL 31979848 by ben woodhouse in ue5-main branch]
2024-03-03 10:27:37 -05:00
ben woodhouse
1f59f63a96 PerfReportTool 4.232.0: Add support for stat type qualifiers in summary tables so we can identify stats by their type to avoid ambiguity, e.g [meta]deviceprofile. Prefixes are :
[metric] SummaryTableMetric
[csv] CsvStatAverage
[meta] CsvMetadata
[toolmeta] ToolMetadata

[CL 31978791 by ben woodhouse in ue5-main branch]
2024-03-02 20:24:47 -05:00
ben woodhouse
90a828c869 PerfReportTool: Also output the elementType in the header tooltip (E.g CsvMetadata, SummaryTableMetric etc)
[CL 31599556 by ben woodhouse in ue5-main branch]
2024-02-17 07:08:25 -05:00
ben woodhouse
b8f8c1b7b2 PerfReportTool: When stat names are remapped, display the original name as a tooltip
[CL 31578316 by ben woodhouse in ue5-main branch]
2024-02-16 15:42:57 -05:00
ben woodhouse
6b06bd7eaa PerfReportTool 4.230.0 - Add support for variables which can be used outside of individual CSV reporting. Any variable declared in a variableSet without a metadata query can be used in this way. This is useful if we want to access variables in SummaryTable definitions for example. Also strip whitespace in summary table row sort and filter lists
[CL 30955693 by ben woodhouse in ue5-main branch]
2024-01-27 11:28:43 -05:00
bruno ferreira1
963571427f Adding -showmin and -showmax to csvinfo
[REVIEW] [at]tyler.staples
#rnx

[CL 30930359 by bruno ferreira1 in ue5-main branch]
2024-01-26 12:56:37 -05:00
tyler staples
ed483b845c PRT - Update help text to include new dynamic graph args.
Also removed deprecated externalGraphs arg

#rnx

#rb ben.woodhouse

[CL 30719102 by tyler staples in ue5-main branch]
2024-01-19 12:23:26 -05:00
ben woodhouse
a941e9c6bf PerfReportTool: Minor tweaks to heading formatting for better use of vertical space. Graphs now use h3 instead of h2
[CL 30718644 by ben woodhouse in ue5-main branch]
2024-01-19 12:12:16 -05:00
ben woodhouse
30d7164b7e PerfReportTool 4.29.0 - Detailed report improvements: Add a top level nav bar with buttons to expand and collapse all sections and jump to the graphs. Clicking on a graph in the list now expands it
[CL 30715173 by ben woodhouse in ue5-main branch]
2024-01-19 09:51:48 -05:00
tyler staples
a718fe697a PRS - Dynamically load graphs in generated reports
Updates the full report generation to optionally embed a url to the csvtosvg end point to create and display graphs on demand rather than generating them offline. This reduces the size of the reports by about 250x.

+ Updated GetCsvToSvgArgs to have different output formats (command line, url).
+ Added -useEmbeddedGraphUrl arg to specify inserting the url instead of fully inlining the graph. This is accompanied by -embeddedGraphUrlRoot to specify the base url to target.
+ Removed the concept and handling of external graphs as the code path wasn't used and didn't work.
+ Refactored GenerateReport to create a list of CsvSvgInfo objects to better handle the different formats (url, inline).
+ Updated command line handling to decoded − into '-' to fix an issue where negative numbers were treated as arguments.
+ Remove giant graphs from ReportTypes.xml as they're unused.

#rnx

#rb ben.woodhouse
#tests prt compare tests, manual testing

[CL 30677752 by tyler staples in ue5-main branch]
2024-01-17 22:10:33 -05:00
ben woodhouse
b21a22c2b5 PerfreportTool 4.227.1 : Fix extraLinks summary null dereference. Add utf-8 charset to meta
[CL 30664963 by ben woodhouse in ue5-main branch]
2024-01-17 14:32:03 -05:00
ben woodhouse
3ab21db8c2 PerfReportTool 4.227.0
Make summaries and graphs collapsible. Summaries can start collapsed if specified in xml via the "collapsed" attribute.
Add a new HtmlSection helper class to assist with this.
We may later want to extend this functionality to add a top level hierarchy to the report, allowing us to have high level sections with multiple summaries in them.

[FYI] tyler.staples

[CL 30660748 by ben woodhouse in ue5-main branch]
2024-01-17 11:57:59 -05:00
ben woodhouse
130703b8a1 PerfReportTool: Optimize commandline parsing. Some args can be very long when response files are passed so use a stringbuilder for concatenation. Commandline parsing could take 40s for a summarytable with 3000 PRC entries before.
#rb tyler.staples

[CL 30624170 by ben woodhouse in ue5-main branch]
2024-01-15 16:21:32 -05:00
evgenii babinets
3e36e29ef0 Changing CSV library to emit a more useful error when encountering an empty file.
#rb ben.woodhouse

[CL 30620106 by evgenii babinets in ue5-main branch]
2024-01-15 11:27:34 -05:00
ben woodhouse
477d1387ed PerfReportTool 4.226.0: Add a stat budgets summary type
This summary type sums up multiple CsvStat averages and emits the total as a SummaryTableMetric named metricName (if specified).
- Budget colors can optionally be applied to individual stats and/or the total via colourThresholds and colourThresholdsTotal nodes
- If emitStatMetrics is enabled, each stat will emit a SummaryTableMetric, named metricName/strippedStatName (with the same value as the existing CsvStatAverage element if it exists)
- Budget coloring is applied to existing CsvStatAverage elements.
- The budget for a given stat is assumed to be the first element of its colourThresholds. This value is displayed in the report
- A totalStatName attribute can be specified if a total stat already exists. If so, an "other" value will be output to the detailed summary table with the unaccounted value
- If the showTotal attribute is set to false (default: true), the total won't be shown in the detailed report

Other changes:
 - Always read all CSV stat averages, regardless of whether -readAllStats is specified. -readAllStats is only now used to determine whether to show CSV stat averages in a summary table

Example:
	<summary type="statBudgets" metricName="GTGameplay" title="Gamethread - Gameplay Budgets" hideStatPrefix="Exclusive/GameThread/" emitStatMetrics="1">
		<colourThresholdsTotal>3,4,5,6</colourThresholdsTotal>
		<colourThresholds stat="Exclusive/GameThread/Buildings">1,2,3,4</colourThresholds>
		<stats>Exclusive/GameThread/Buildings,Exclusive/GameThread/Camera,Exclusive/GameThread/Curie,Exclusive/GameThread/Network*,Exclusive/GameThread/PlayerController*,Exclusive/GameThread/WorldTickMisc,Exclusive/GameThread/FlushLatentActions,Exclusive/GameThread/Tickables,Exclusive/GameThread/SyncBodies,Exclusive/GameThread/CharPhys*,Exclusive/GameThread/Character*,Exclusive/GameThread/FortPawnTickSubsystem,Exclusive/GameThread/SignificanceManager,exclusive/gamethread/vehicle*,Exclusive/GameThread/AbilityTasks,Exclusive/GameThread/Actor*,Exclusive/GameThread/HandleRPC,Exclusive/GameThread/RepNotifies,Exclusive/GameThread/TickActors,Exclusive/GameThread/Pickups,Exclusive/GameThread/ProjectileMovement,Exclusive/GameThread/TimelineComponent,Exclusive/GameThread/TimerManager,Exclusive/GameThread/FortTrainManager</stats>
	</summary>
[FYI] andrew.ladenberger, michael.short

[CL 30329557 by ben woodhouse in ue5-main branch]
2023-12-14 15:20:48 -05:00
ben woodhouse
f860dd925d HistogramThresholds variables support + hook up to XML
[CL 30318527 by ben woodhouse in ue5-main branch]
2023-12-14 08:59:10 -05:00
ben woodhouse
4451ac584f PerfReportTool 4.225.0: Add support for inline graphs, so we can define graphs fully in a ReportType. This allows us to reference variables in the graph definition directly, e.g for declaring a stat string or setting a maxY which corresponds to the target FPS
[CL 30318261 by ben woodhouse in ue5-main branch]
2023-12-14 08:40:49 -05:00
ben woodhouse
52de449da0 PerfReportTool 4.224.1: Derived metadata populates variables
-add dumpVariablesAll param to dump all variables including metadata

[CL 30091707 by ben woodhouse in ue5-main branch]
2023-12-04 14:55:26 -05:00
ben woodhouse
2ea0faefb3 PerfReportTool 4.224.0: Adjust default colorization to make greens and reds lighter and more readable
- Add Variable support for hitch thresholds

[CL 30080549 by ben woodhouse in ue5-main branch]
2023-12-04 10:00:58 -05:00
ben woodhouse
9073333aa2 PerfReportTool 4.223.0. Budget and variable improvements
- Multiplier support for variables. Add multiplier="N" attribute to a variableset or variable
- FPSCharts : Compute frametime color thresholds automatically if MVP thresholds are specified and frametime is not
- Support empty color thresholds (useful if we want to clear via a variable)
- Add support for dumping the variables to the log for each CSV via -dumpVariables param

[CL 30060917 by ben woodhouse in ue5-main branch]
2023-12-01 19:11:26 -05:00
ben woodhouse
b12d868886 PerfReportTool 4.222.0 : support dereferencing variables with array indices for strings separated with commas. Also add validation for variable names.
[CL 29986252 by ben woodhouse in ue5-main branch]
2023-11-29 09:04:49 -05:00
ben woodhouse
1419a64864 Add Contains and Get methods for SummaryTableRowData
[CL 29984224 by ben woodhouse in ue5-main branch]
2023-11-29 06:52:20 -05:00