Commit Graph

52 Commits

Author SHA1 Message Date
ben woodhouse
e3ad811d6b Add missing file from CL 16110876
#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16110880 via CL 16110883 via CL 16110885 via CL 16110886
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16117146 by ben woodhouse in ue5-main branch]
2021-04-26 14:45:34 -04:00
ben woodhouse
d36b7af983 PerfReportTool 4.43
- Add support for >,<,>=,<= operators for metadata queries (for numerical fields)
- Use doubles for SummaryTable/SummaryTableColumn values, so we can accurately show display values (does not affect summary cache - this was already at double precision)

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16110876 via CL 16110877 via CL 16110881 via CL 16110882
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16117137 by ben woodhouse in ue5-main branch]
2021-04-26 14:44:53 -04:00
ben woodhouse
867df3f118 PerfReportTool 4.42
- Add -requireMetadata option to ignore CSVs without metadata
- Clean up help text so the lines arent too long for standard console output

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16105233 via CL 16105248 via CL 16105254 via CL 16105255
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116861 by ben woodhouse in ue5-main branch]
2021-04-26 14:28:01 -04:00
ben woodhouse
41de178a81 PerfReportTool 4.41
- add -summaryTableCacheUseOnlyCsvID param to ignore the ReportType hash and just use the CSV ID for summaryTableCache ID entries. This is a good idea if you want these files to persist and you don't want them to be regenerated when report types change
- Add ReportType and ReportTypeID to the summaryTable ToolMetaData entries
- Use the reportType name as part of the report hash (this will invalidate existing cache files!)

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16024419 via CL 16024452 via CL 16024531 via CL 16045954
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116846 by ben woodhouse in ue5-main branch]
2021-04-26 14:27:22 -04:00
ben woodhouse
14fb564e7e PerfReportTool 4.40
- Refactor code to avoid use of the term Metadata to refer to summary table row data. The term metadata was easily confused with CSV metadata, and in most cases, it wasn't actually metadata.
- This refactor resulted in some minor breaking changes in XML format and command line params. The affected reports and scripts have been fixed up accordingly

The following were renamed:
SummaryMetadata -> SummaryTableRowData
SummaryMetadataValue->SummaryTableElement
SummaryMetadataTable->SummaryTable
metadataKey -> summaryStatName (also affects XML)
metadataPrefix -> summaryStatNamePrefix (also affects XML)
metadataCache -> summaryTableCache
Commandline params, e.g: -metadataCache -> -summaryMetadataCache


#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16023141 via CL 16023153 via CL 16023173 via CL 16045518
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116817 by ben woodhouse in ue5-main branch]
2021-04-26 14:25:00 -04:00
ben woodhouse
5a8d2051f7 PerfReportTool 4.34
-5x faster metadata cache only reads:
 - Only read the initial CSV metadata entries before metadata filtering (since these always appear first)
 - Skip report type determiniation in metadataonly mode (this is slow and unnecessary)
 -crash fix (don't crash if old version metadata is encountered, just skip and log)

Querying a single device profile across 31k CSVs of mixed device profiles takes 2.1s instead of 10.2s previously

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16015980 via CL 16015986 via CL 16015993 via CL 16043535
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116807 by ben woodhouse in ue5-main branch]
2021-04-26 14:24:18 -04:00
ben woodhouse
08525cb9cf PerfReportTool 4.33
Open metadata and .bin files readonly

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 16013849 via CL 16013851 via CL 16013859 via CL 16043212
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16116794 by ben woodhouse in ue5-main branch]
2021-04-26 14:22:36 -04:00
ben woodhouse
177a5c926e PerfReportTool 4.32
- Add -metadataCacheIn mode for running without CSVs
 - Use a BlockingCollection to eliminate precache threading bottleneck and simplify precache thread producer/consumer code
 - Threading still hits a performance bottleneck at around 6 threads when running metadata queries currently, and gets slower after that as more threads are added.
    - Need further work to optimize GetReportTypeXML (too much unnecessary linq) and SummaryMetadata::TryReadFromCache

#ROBOMERGE-OWNER: ben.woodhouse
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-COMMAND: _robomerge ue5-main
#ROBOMERGE-SOURCE: CL 15974021 via CL 15974024 via CL 15974028 via CL 16027282
#ROBOMERGE-BOT: STARSHIP (Release-Engine-Staging -> Main) (v789-15992632)

[CL 16112788 by ben woodhouse in ue5-main branch]
2021-04-26 06:55:45 -04:00
Marc Audy
01b7c9f4f5 Merge UE5/RES @ 15958325 to UE5/Main
This represents UE4/Main @ 15913390 and Dev-PerfTest @ 15913304

[CL 15958515 by Marc Audy in ue5-main branch]
2021-04-08 14:32:07 -04:00
Marc Audy
0cbbc781ca Merge UE5/Release-Engine-Staging @ 15740152 to UE5/Main
This represents UE4/Main @ 15709114

[CL 15740605 by Marc Audy in ue5-main branch]
2021-03-18 15:20:03 -04:00
Marc Audy
8f73cd7fa9 Merge UE5/Release-Engine-Staging @ 15630841 to UE5/Main
This represents UE4/Main @ 15601601

[CL 15631170 by Marc Audy in ue5-main branch]
2021-03-05 19:27:14 -04:00
Marc Audy
ada7c144fa Merge //UE5/Release-Engine-Staging @14903491 to //UE5/Main
[CL 14906022 by Marc Audy in ue5-main branch]
2020-12-11 14:21:20 -04:00
Marcus Wassmer
3b81cf8201 Merging using //UE5/Main_to_//UE5/Release-Engine-Staging @14384769
autoresolved files
#rb none

[CL 14384911 by Marcus Wassmer in ue5-main branch]
2020-09-24 00:43:27 -04:00
Marc Audy
7379fa99c5 Merging //UE5/Release-Engine-Staging to Main (//UE5/Main) @ 14229157
[CL 14233282 by Marc Audy in ue5-main branch]
2020-09-01 14:07:48 -04:00
Marc Audy
a7c9001a94 Merging //UE5/Release-Engine-Staging to Main (//UE5/Main) @ 14075166
#rb
#rnx

[CL 14075271 by Marc Audy in ue5-main branch]
2020-08-11 01:36:57 -04:00
Marc Audy
11f5b21210 Merging //UE5/Release-Engine-Staging @ 13752110 to Main (//UE5/Main)
#rnx

[CL 13753156 by Marc Audy in ue5-main branch]
2020-06-23 18:40:00 -04:00
serge bernier
840e0710d6 PerfReportTool 4.03
- support multiple local player views.

#rb Mickael G.


#ROBOMERGE-SOURCE: CL 11884348 via CL 11884427
#ROBOMERGE-BOT: (v656-11643781)

[CL 11889385 by serge bernier in Main branch]
2020-03-03 17:12:33 -05:00
ben woodhouse
5bbef42ec9 PerfReportTool - remove some dead code
#ROBOMERGE-SOURCE: CL 10882070 via CL 10882085
#ROBOMERGE-BOT: (v626-10872990)

[CL 10882093 by ben woodhouse in Main branch]
2020-01-06 14:12:46 -05:00
Ryan Durand
9ef3748747 Updating copyrights for Engine Programs.
#rnx
#rb none
#jira none

#ROBOMERGE-OWNER: ryan.durand
#ROBOMERGE-AUTHOR: ryan.durand
#ROBOMERGE-SOURCE: CL 10869242 in //Fortnite/Release-12.00/... via CL 10869536
#ROBOMERGE-BOT: FORTNITE (Main -> Dev-EngineMerge) (v613-10869866)

[CL 10870955 by Ryan Durand in Main branch]
2019-12-26 23:01:54 -05:00
ben woodhouse
7b101a6080 CsvCollate 1.32- metadata filtering support:
-metadatafilter "key0=value0,key1=value1,..."

[FYI] serge.bernier,mickael.gilabert


#ROBOMERGE-SOURCE: CL 10761485 via CL 10761498
#ROBOMERGE-BOT: (v610-10636431)

[CL 10761500 by ben woodhouse in Main branch]
2019-12-17 09:18:04 -05:00
ben woodhouse
c792327437 CsvToSVG 3.31
- Reduce event spam by grouping duplicate events if they appear within a certain number of pixels of each other. Display the count
- Also reduce the frequency of event lines and reduce the alpha when spamming occurs


#ROBOMERGE-SOURCE: CL 10607478 via CL 10607481
#ROBOMERGE-BOT: (v607-10590470)

[CL 10607482 by ben woodhouse in Main branch]
2019-12-07 09:40:51 -05:00
ben woodhouse
8070fd1b89 CsvCollate 1.31
- Fixes an out-by-one bug with -avg. The stats were being divided by csvCount-1 instead of csvCount


#ROBOMERGE-SOURCE: CL 10505654 via CL 10505655
#ROBOMERGE-BOT: (v606-10482310)

[CL 10505656 by ben woodhouse in Main branch]
2019-12-04 06:27:12 -05:00
ben woodhouse
6143c2c427 PerfReportTool 4.01
- Batched graph generation is enabled by default (disable with -nobatchedgraphs)
- Report generation is 33% faster and no longer consumes the entire CPU
[FYI] will.fissler


#ROBOMERGE-SOURCE: CL 10468949 via CL 10471051
#ROBOMERGE-BOT: (v595-10452236)

[CL 10471304 by ben woodhouse in Main branch]
2019-11-27 11:41:46 -05:00
ben woodhouse
c8e0802da7 CsvToSVG 2.3
- Batched + multithreaded support via response files

PerfReportTool 4.00
 - Support batched graph generation. Increases perf by 30% over old multi process method. Significantly lower CPU and disk usage too. Enable with -batchedgraphs
 - Fixed determinism issues with report generation. Test cases are now identical between runs



#ROBOMERGE-SOURCE: CL 10318336 via CL 10318337
#ROBOMERGE-BOT: (v593-10286020)

[CL 10318338 by ben woodhouse in Main branch]
2019-11-20 07:46:12 -05:00
ben woodhouse
dc6e569d0c PerfReportTool 3.97
- Fix version


#ROBOMERGE-SOURCE: CL 10295103 via CL 10295108
#ROBOMERGE-BOT: (v593-10286020)

[CL 10295113 by ben woodhouse in Main branch]
2019-11-18 22:52:47 -05:00