Commit Graph

1484 Commits

Author SHA1 Message Date
robert manuszewski
77557567f4 Moved STAT_FAsyncPackage_CreateAsyncPackagesFromQueue to an inner scope to reduce the number of stat events it generates
#rb none

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 6674856 via CL 6674912 via CL 6674922
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6789478 by robert manuszewski in Dev-Anim branch]
2019-06-03 07:01:22 -04:00
dan oconnor
c460abcb2f Avoid callspace checking for non-net UFunctions
#rb Michael.Noland, Josh.Markiewicz

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: dan.oconnor
#ROBOMERGE-SOURCE: CL 6666904 via CL 6669570 via CL 6669605
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6786148 by dan oconnor in Dev-Anim branch]
2019-06-03 06:13:02 -04:00
dan oconnor
fd918f6084 Avoid unnecessary alloca call when not calling remote functions, remove unused parameter from UObject::GetFunctionCallspace
Upgrade notes: second parameter of GetFunctionCallspace overrides should be removed - it served no purpose
#rb Michael.Noland

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: dan.oconnor
#ROBOMERGE-SOURCE: CL 6635880 via CL 6639399 via CL 6639673
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6754029 by dan oconnor in Dev-Anim branch]
2019-05-31 18:30:57 -04:00
mickael gilabert
1b0c27ab81 Removed inserting packages by priority when EDL is enabled (on behalf of Per.Larsson)
#rb stefan.boberg
#rnx

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: mickael.gilabert
#ROBOMERGE-SOURCE: CL 6629191 via CL 6629192 via CL 6632492 via CL 6632712
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6749659 by mickael gilabert in Dev-Anim branch]
2019-05-31 18:11:42 -04:00
ben marsh
83bd3cd7c6 Copying //UE4/Dev-Build to Dev-Main (//UE4/Dev-Main)
#rb none
#rnx

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: ben.marsh
#ROBOMERGE-SOURCE: CL 6631504 in //UE4/Main/...
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6748759 by ben marsh in Dev-Anim branch]
2019-05-31 18:06:13 -04:00
mickael gilabert
5087eed175 Removed unnecessary validation logic from FAsyncLoadingThread::ProcessLoadedPackages - On behalf of stefan.boberg
#rb none

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: mickael.gilabert
#ROBOMERGE-SOURCE: CL 6623225 via CL 6623363 via CL 6624508 via CL 6624710
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v365-6733468)

[CL 6744910 by mickael gilabert in Dev-Anim branch]
2019-05-31 17:39:33 -04:00
ben zeigler
783d29a698 Fix obj refs code by merging parts of CL 5365249 and 5536455 as 6542056 conflicted with a change in framework. This fixes an infinite recursion crash in obj refs and changes it so you don't need to pass the GC collector to AddReferencedObjects but doesn't include the deprecation changes or setting the debug name on streamablemanager
[CODEREVIEW] bob.tellez


#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: ben.zeigler
#ROBOMERGE-SOURCE: CL 6578103 via CL 6581750 via CL 6581772
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim) (v363-6677109)

[CL 6699980 by ben zeigler in Dev-Anim branch]
2019-05-31 12:50:48 -04:00
robert manuszewski
71f7b31575 Fixing a crash when reporting long reference chains with 'obj refs' command.
#rb none

#ROBOMERGE-VERSION: 348-6547088
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 6543528 via CL 6543620 via CL 6543667
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6569456 by robert manuszewski in Dev-Anim branch]
2019-05-18 11:20:47 -04:00
bob tellez
b06ca21b0b #UE4 Better FGCObject reporting in obj refs. FGCObject names are now reported in the "obj refs" console command, provided that they pass in FGCObject::GGCObjectReferencer as the referencer when calling AddReferencedObjects. FGCObjects may now also implement GetReferencerPropertyName to describe more details about how it references an object.
#ROBOMERGE-VERSION: 348-6547088
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 6542056 via CL 6542588 via CL 6542593
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6568946 by bob tellez in Dev-Anim branch]
2019-05-18 11:12:37 -04:00
jamie dale
fd5e993dae Exposed Asset Registry GetDependencies and GetReferencers to scripting
#jira UE-74534
#rb Chris.Gagnon

#ROBOMERGE-VERSION: 348-6547088
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: jamie.dale
#ROBOMERGE-SOURCE: CL 6520136 via CL 6525931 via CL 6525997
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6556876 by jamie dale in Dev-Anim branch]
2019-05-18 10:04:06 -04:00
ben woodhouse
b92b5b4e0e Fix linker loop deadlock bug (causes loading deadlock in some cases)
#rb gil.gribb

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: ben.woodhouse
#ROBOMERGE-SOURCE: CL 6417518 via CL 6418865 via CL 6418880 via CL 6418961 via CL 6418984
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6470326 by ben woodhouse in Dev-Anim branch]
2019-05-15 05:52:23 -04:00
josh adams
ea9753cf64 - Added debug spikemark and spikemarkcheck to track objects that get destroyed after a mark, which can be used to track objects that go away right after being loaded; can help reduce memory spikes of objects being loaded and GCd right away
#rb none

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: josh.adams
#ROBOMERGE-SOURCE: CL 6402899 via CL 6403012 via CL 6404642 via CL 6404653
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6464786 by josh adams in Dev-Anim branch]
2019-05-15 04:21:39 -04:00
robert manuszewski
4f675b67b1 Fixing a crash when launching cooked projects with the Event Driven Loader disabled
#rb none
#jira UE-73368
#lockdown cristina.riveron

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 6316372 in //UE4/Release-4.22/... via CL 6317373
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6325451 by robert manuszewski in Dev-Anim branch]
2019-05-06 17:18:49 -04:00
david harvey
3662fcc9b7 [LLM] another pass over EngineMisc. moves about 15MB out in my test replay, mostly moved to LoadMapMisc and StreamingManager.
#rb anthony.bills

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: david.harvey
#ROBOMERGE-SOURCE: CL 6173661 via CL 6179493 via CL 6179684
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 6217403 by david harvey in Dev-Anim branch]
2019-05-01 18:46:25 -04:00
marc audy
d760d54632 Merging using //Ocean/Dev-EngineMerge-To-//UE4/Main
#rb
#rnx

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: marc.audy
#ROBOMERGE-SOURCE: CL 5986648 in //UE4/Main/...
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5999135 by marc audy in Dev-Anim branch]
2019-04-18 21:22:07 -04:00
johan torp
86974ccb3e Fix race condition in cook -diffonly
The same ubulk file, typically for a texture, was written by two different threads. This caused a fatal SavePackage assert in FAsyncWriteWorker::DoWork(). There was no need to write out these files to disk at all.

Also cleaned up surrounding code a little bit.

#jira ue-72635
#rb robert.manuszewski

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: johan.torp
#ROBOMERGE-SOURCE: CL 5937291 via CL 5937787 via CL 5937827
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5956295 by johan torp in Dev-Anim branch]
2019-04-17 17:00:59 -04:00
nick darnell
1b43fbbb03 Adding const variants of some of the more common AddReferencedObject(s) functions to allow for FGCObjects to store const pointers to UObjects or collections and report those references easily, otherwise people make the mistake of creating local ptrs that can't be nulled out correctly.
#rb Robert.Manuszewski
[FYI] Dan.Hertzka

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: nick.darnell
#ROBOMERGE-SOURCE: CL 5830834 via CL 5830835 via CL 5835213 via CL 5835996
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5875741 by nick darnell in Dev-Anim branch]
2019-04-12 21:09:15 -04:00
pj kack
8bbfe7b7af Optimize UPackage::IsFullyLoaded() for cooker.
The editor specific feature of querying the file system to identify newly created packages (not having a corresponding file on disk) is really slow.
Early out from this expensive check when the package already has a known file size.

VTune user-mode cpu sampling time results when cooking a big data set (~200 000 packages):
UCookOnTheFlyServer::MaybeMarkPackageAsAlreadyLoaded() down from 10 sec to 0.1 sec, a 100X speedup.
FLinkerLoad::LoadAllObjects down from 400 sec to 280 sec, a 1.4X speedup, i.e. ~4% (120 sec) of the total load time of 2750 sec.

#rb robert.manuszewski

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: pj.kack
#ROBOMERGE-SOURCE: CL 5818305 via CL 5818901 via CL 5818980
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5850341 by pj kack in Dev-Anim branch]
2019-04-12 13:26:44 -04:00
pj kack
123d246403 Back out integrated changelist 5586728 (5571078) to resubmit all cook -iterate optimizations implemented on //UE4/Dev-core/... (see 5533504)
New AssetRegistryState::InitializeFromExistingAndPrune temporarily disabled until some bugs have been fixed.

Test Scenario:
1) BuildCookStageAndRun with these arguments: -platform=Win64 -configuration=Development
2) CookIterate with these arguments: -run=Cook -CookCultures=en -TargetPlatform=WindowsClient -unversioned -stdout -unattended -iterate

Wall Time Results (as an average of running step 2) two times):
Before: ~09:40 (580 seconds) cook commandlet time
After: ~02:30 (150 seconds) cook commandlet time
=> 07:10 (430 seconds ) faster, i.e. a ~ 3.9x speedup

Win32 FileSystem Results:
Before: 1.5 million GetFileAttribute calls and 1.2 million FindNextFile calls
After: 35 0000 GetFileAttribute calls and 1.6 million FindNextFile calls
=> ~400 000 calls to FindNextFile replaces ~1.5 million calls to GetFileAttribute

#rb none


(peafour-cherrypick of //UE4/Dev-Core/[at]5645695 by PJ.Kack)

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: pj.kack
#ROBOMERGE-SOURCE: CL 5533504 via CL 5533655 via CL 5536177 via CL 5772728 via CL 5772753 via CL 5772793
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5783632 by pj kack in Dev-Anim branch]
2019-04-08 13:38:33 -04:00
bob tellez
b262c2b721 #UE4 Changed the order of the asset load error message to show the referencer first
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 5755606 via CL 5763296 via CL 5763365
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5776211 by bob tellez in Dev-Anim branch]
2019-04-08 13:02:06 -04:00
graeme thornton
6c356cc457 Edigration of an FLinkerLoad optimization from Dev-Core CL 5709116
Second optimization to a heavily hit function that uses an FArchiveFromStructuredArchive adapter. That class needs optimization, so temporarily use a straight FArchive path when text archive support is compiled out

fyi ben.woodhouse, gil.gribb, per.larsson

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: graeme.thornton
#ROBOMERGE-SOURCE: CL 5716883 via CL 5716884 via CL 5716885 via CL 5716886 via CL 5717811 via CL 5717889
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5728223 by graeme thornton in Dev-Anim branch]
2019-04-04 01:07:13 -04:00
bob tellez
bd38d54667 #UE4 Improve logging when assets fail to load. Failing to get the package linker will now produce fewer redundant log messages and all failure messages will include the asset that failed to load as well as the asset that was requesting the linker where possible.
#rb Robert.Manuszewski

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 5713888 via CL 5714486 via CL 5714487
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5721617 by bob tellez in Dev-Anim branch]
2019-04-03 21:43:47 -04:00
robert manuszewski
32f2f7a17e Fixing crashes in pkg info commandlet
#rb none

#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: robert.manuszewski
#ROBOMERGE-SOURCE: CL 5707932 via CL 5708541 via CL 5708552 via CL 5708563 via CL 5708976 via CL 5709035
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5718591 by robert manuszewski in Dev-Anim branch]
2019-04-03 21:04:29 -04:00
bob tellez
34417dbe90 #UE4 Fix a bug that caused logs about missing assets to not show their referencer
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 5641069 via CL 5641333 via CL 5648075
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5653500 by bob tellez in Dev-Anim branch]
2019-03-29 17:04:19 -04:00
bob tellez
e691ce122f Back out changelist 5533504. Crash at startup on forking linux servers. (Missing referencer information)
#ROBOMERGE-OWNER: lina.halper
#ROBOMERGE-AUTHOR: bob.tellez
#ROBOMERGE-SOURCE: CL 5571078 via CL 5572105 via CL 5572109
#ROBOMERGE-BOT: ANIM (Main -> Dev-Anim)

[CL 5585363 by bob tellez in Dev-Anim branch]
2019-03-27 01:37:40 -04:00