Commit Graph

440 Commits

Author SHA1 Message Date
james hopkin
b920dd0d03 [robo] Removed accidentally checked in session test code
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20449836
#ROBOMERGE-BOT: (v952-20449836)

[CL 20449877 by james hopkin in ue5-main branch]
2022-06-01 04:55:24 -04:00
paul chipchase
aaec7fabd1 Allow the P4VUtils 'Virtualize and Submit' command to use precompiled binaries is they are available.
#rb Sebastian.Nordgren
#rnx
#jira UE-152958
#preflight 629717b72c618ddc669143d7

- Instead of just building the UnrealVirtualizationTool we will now check to see if there is a precompiled version we can use.
-- If the user has rebuilt the editor locally, then we will ignore any precompiled version of UnrealVirtualizationTool and rebuild that aswell incase there are code changes that it needs to pick up.
- To tell if an exe is locally built or a precompiled binary we check for a .version OR .target file (this can vary depending how a program is set up) then look for the JSON property 'IsPromotedBuild ' which when none zero means that the binary is probably prebuilt.
-- This isn't very robust and I am not happy with it, but we don't seem to have an official way to determine a precompiled binary. When we do get an offical way to do it I will update the command.

[CL 20448604 by paul chipchase in ue5-main branch]
2022-06-01 03:52:14 -04:00
paul chipchase
5afd605ecf Allow the P4VUtils 'Virtualize and Submit' command to work on multiple changelists at the same time.
#rb Sebastian.Nordgren
#jira UE-154011
#rnx
#preflight 6294a6eb380652524ebcc4a7

- If we use uppercase %C in P4V to pass the changelist number then we will get a list of all changelists that the user has selected rather than launching the command once per changelist which is what happens when the lower case %c is used
-- Due to the use of UBT, we can run into problems if the user tries to submit multiple changelists and they are processed in different processes. Even if we fixed the command to only run UBT one process at a time, running many versions of the submit tool will create many more perforce connections which we'd like to avoid, so having all of the changelists run through one instance is still prefered.
- Processing a changelist has been moved to a new method, ::ProcessChangelist which is pretty much the same code as we had in  ::Execute.
-- Rather than connecting to perforce for each changelist, this code has been kept in ::Execute and is only run once, the connection is then passed to ::ProcessChangelist.
- Logging has been improved to show when the tool is exiting, either from failure or success. The p4v terminal does not do a good job informating the user when the process has finished running so hopefully this will help.
- A small extension to ILogger has been added, ::NewLine which writes an empty line to the logger.
- This was the simplest way to add support to multiple changelists. We process each one by itself until we run out of changelists or we reach an error. However it is likely that packages in multiple changelists would be in the same project or at least use the same engine installation, so we could remove some overhead by parsing all changelists, gathering the packages, virtualizating those packages then submitting the changelists afterwards.
-- This would be a great approach for the average user as they will likely be submitting relatively small changelists (< 100 files) but would be a terrible approach if the entire project was being virtualized where the total number of packages being submitting could be in the 100k-million range. So we'd probably want a "process changelists separatly" mode even if we did make the optimized version.
-- Looking into adding a combined changelist mode will be added as an optimization task.
- Added a new preprocessor define 'UE_DEBUG_DISABLE_SUBMITS' that when enabled will cause the command to only pretend to submit the target changelist(s) this is intended for use in development to avoid submitting changelists over and over when testing the non-submission portion of the command.
-- Note that it is defined inside of a DEBUG check, so even if it is accidently submitted enabled, it will not be published.

[CL 20429873 by paul chipchase in ue5-main branch]
2022-05-30 07:34:53 -04:00
james hopkin
9440632288 [robo] Fixes for keeping ack field on message update
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20362246
#ROBOMERGE-BOT: (v948-20297126)

[CL 20362258 by james hopkin in ue5-main branch]
2022-05-25 06:55:31 -04:00
paul chipchase
d545d66b9a Rework the logic for finding the project associated with each package file to match the native code, including changes found in CL 20346906)
#rb trivial
#rnx
#preflight 628ccca9fc217779d4361cb5

- The native code changes we are trying to match from CL 20346906, fix a problem when parsing a package path containing more than one content directory.
- The method now takes an ILogger so that we can record problems found.
- Even though we don't use the .uplugin file, we now match the native code and look for it first, rather than looking for the /plugins/ directory immediately. This should reduce any differences between the two code paths.

[CL 20346914 by paul chipchase in ue5-main branch]
2022-05-24 08:51:08 -04:00
paul chipchase
64efab556e Fix more compilation warnings in P4VUtils.
#rb Sebastian.Nordgren
#rnx
#preflight 628c85f58673efbf3c0a5e3f

- Added checks when parsing xml to make sure that expected nodes/lists were found and are not null.
- Response was assigned as null, but nothing was checking for this. The initial value has been changed to an empty string which wioll invoke the user cancelling the operation as the default behaviour.
- StreamReader.ReadToEnd is a blocking call in an async method. Replaced with await StreamReader.ReadToEndAsync.

[CL 20346208 by paul chipchase in ue5-main branch]
2022-05-24 07:14:12 -04:00
paul chipchase
9fca28ee71 Fix some warnings introduced in the recent upgrade to .NET 6
#rb Sebastian.Nordgren
#rnx
#preflight 628b910a573a7de2c4249502

- Handle Path.GetDirectoryName and Directory.GetParent potentially returning null

[CL 20344754 by paul chipchase in ue5-main branch]
2022-05-24 02:29:04 -04:00
paul chipchase
0e85c4730c Fix P4Utils to compile with the changes to the logging API in CL 20245803
#rb Ben.Marsh
#rnx
#preflight 628b8e06693c5e1de2797dd6

[CL 20326531 by paul chipchase in ue5-main branch]
2022-05-23 09:49:24 -04:00
james hopkin
25ba5d05a9 [robo] Fixed disk usage output parsing
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20297126
#ROBOMERGE-BOT: (v946-20296680)

[CL 20297147 by james hopkin in ue5-main branch]
2022-05-20 12:48:10 -04:00
james hopkin
5f7234b8f2 [robo] Disabling broken disk usage check
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20296999
#ROBOMERGE-BOT: (v946-20296680)

[CL 20297005 by james hopkin in ue5-main branch]
2022-05-20 12:36:57 -04:00
james hopkin
b05c9fb412 [robo] Added disk usage (just /src) analytics event
[FYI] Ryan.Hummer


#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20296680
#ROBOMERGE-BOT: (v945-20292151)

[CL 20296761 by james hopkin in ue5-main branch]
2022-05-20 12:25:29 -04:00
james hopkin
becb52343b [robo] Don't clear ack in Slack message on update - initial ack already shows user is aware and unlikely to re-ack.
[FYI] Ryan.Hummer


#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 20292151
#ROBOMERGE-BOT: (v943-19904690)

[CL 20292163 by james hopkin in ue5-main branch]
2022-05-20 04:32:04 -04:00
Josh Adams
6f60e61383 - Some p4vutils code changes to match the already checked ion binaries
#rb trivial
#preflight skip

[CL 20248689 by Josh Adams in ue5-main branch]
2022-05-17 15:02:27 -04:00
Josh Adams
bcb77edc06 - Fixing up some P4VUtils paths in the installers
- Split up the binaries between platform since there are #if's due to WinForms
#rb trivial
#preflight skip

[CL 20247967 by Josh Adams in ue5-main branch]
2022-05-17 14:26:37 -04:00
Josh Adams
a6c5a6ccd9 - Updated p4vutils to dotnet6, so we can use OperatingSystem nicely
- Will compile on Mac and Linux now
- Mac replaced the WinForms functionality with AppleScript
- Linux will compile be have reduced functionality
- Fixed up paths for p4v settings and dotnet location
- Added binaries and installer scripts for all 3 platforms - won't need UGS to install, will copy to user-library location (may need some adustment on Linux, will address after)
#rb will.damon
#preflight skip

[CL 20244727 by Josh Adams in ue5-main branch]
2022-05-17 12:00:08 -04:00
guillaume abadie
d9be3f2407 Fixes an error in the GPU dump viewers when no passes has been dumped
#rb trivial
#preflight none

#ROBOMERGE-AUTHOR: guillaume.abadie
#ROBOMERGE-SOURCE: CL 20168246 via CL 20168619 via CL 20168654
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20170151 by guillaume abadie in ue5-main branch]
2022-05-12 16:16:05 -04:00
paul chipchase
bee76532da The VA tool will now give the user an error if they attempt to submit an empty changelist or a changelist containing a shelved file.
#rb Sebastian.Nordgren
#rnx
#jira UE-151464
#preflight 627a4c60fc07e0a9b4eefda9

### No files
- When submitting a change list with no workspace files (either empty changelist or only shelved files) our internal C# api does not return any errors.
- To get around this for now ::FindPackagesInChangelist can be changed to return null if we detect that there are no files to submit.
- I am following up with the original author to try and find out if the submit behavior in our API is intended or not.

### Shelved files
- Attempting to submit a valid changelist that has shelved files will eventually fail when we try to finally submit the changelist.
- This means that the tool will check all of the packages for virtualization first, before eventually failing on the submit.
- Most users will alt tab out of p4v during the submit and we cannot do anything fancy with the error reporting (like make the task bar icon flash etc) so might not notice that the submit failed for some time.
- So it makes sense for us to check for shelved files, before we kick off the virtualization process and if the changelist does have shelved files we can error out and the user should see it before they alt tab away.

[CL 20120836 by paul chipchase in ue5-main branch]
2022-05-10 07:37:37 -04:00
paul chipchase
32ce8db205 Small improvements to the P4VUtil Submit&Virtualize command logging
#rb trivial
#rnx
#preflight 627a14806a20515edc79c799

- Only display the p4 submit error messages, doo not include the perforce generic code as it can be confusing to the end user.
- If a submit fails, print a line to the log once the virtualization tags have been removed from the original changelist description. Previously the last message the user would see ended in "..." which implied that the process was still running.

[CL 20119794 by paul chipchase in ue5-main branch]
2022-05-10 03:51:07 -04:00
paul chipchase
75f8217ced Allow the P4VUtils submit command to deal correctly with changelists containing no package files.
#rb Per.Larsson
#jira UE-143675
#rnx
#preflight 6274f6118b2af58d6e5e44a1

- The c# p4 api seems to have problems when calling p4 where, with no valid files so make sure that we early out before calling that.
- Only run the virtualization process if we have package files, no point trying to virtualize anything else.
-- If the changelist does not contain any packages then we just submit the change list, we don't need to stamp it or display logging info about how 0 packages are in 0 projects etc.
- Moved the code that submits the changelist to it's own method.

[CL 20073750 by paul chipchase in ue5-main branch]
2022-05-06 06:45:36 -04:00
guillaume abadie
4dc8472228 Adds support for Texture2DArray in DumpGPU
#rb juan.canada
#preflight 62711cc29d6c2f8f5b1a2111

#ROBOMERGE-AUTHOR: guillaume.abadie
#ROBOMERGE-SOURCE: CL 20023927 via CL 20023941 via CL 20023946
#ROBOMERGE-BOT: UE5 (Release-Engine-Staging -> Main) (v943-19904690)

[CL 20024812 by guillaume abadie in ue5-main branch]
2022-05-03 09:58:16 -04:00
ryan hummer
ef6b18ff74 [robo] - Fixing path to graph preview image
#rnx
#jira UE-150120
#rb none


#ROBOMERGE-AUTHOR: ryan.hummer
#ROBOMERGE-SOURCE: CL 19979248
#ROBOMERGE-BOT: (v943-19904690)

[CL 19979259 by ryan hummer in ue5-main branch]
2022-04-29 10:52:47 -04:00
paul chipchase
b69cc572f5 Clean up the logging for the P4VUtils Submit and Virtualize command
#rb trivial
#rnx
#preflight 626baeec5c220f34acdb8128

[CL 19976351 by paul chipchase in ue5-main branch]
2022-04-29 05:36:44 -04:00
mark lintott
ba542a3885 Copyright fix
#jira none
#rb trivial
#preflight 6266bfea7e06ec7505abbebf

[CL 19906665 by mark lintott in ue5-main branch]
2022-04-25 14:45:28 -04:00
james hopkin
415b6a48d1 [robo] Restored commit server restriction when finding a workspace on auto-shelve
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 19904690
#ROBOMERGE-BOT: (v942-19904256)

[CL 19904717 by james hopkin in ue5-main branch]
2022-04-25 12:58:47 -04:00
james hopkin
40c105e835 [robo] Missed file in previous commit
#ROBOMERGE-AUTHOR: james.hopkin
#ROBOMERGE-SOURCE: CL 19904256
#ROBOMERGE-BOT: (v940-19807014)

[CL 19904263 by james hopkin in ue5-main branch]
2022-04-25 12:36:44 -04:00