- This will make maintenance for multiple platforms a lot easier (i.e. just preflight)
- Will be easy to get callstack and debug since it will be compiled on the machine it is debugged on
- Easier to try out modifications on mimalloc itself
- Fix mimalloc compilation under Clang 10
- Fix mimalloc inconsistent usage of MI_ENCODE_FREELIST define
- Fix mimalloc inconsistent usage of _WIN32 define
- Implement MacOS and Unix -mimalloc command-line switch
- Some MacOS changes were contributed by Will.Damon
#rb Brandon.Schaefer, Will.Damon
#preflight 60b4ea613c6c4e000158233e
#rnx
#ROBOMERGE-SOURCE: CL 16512512 in //UE5/Main/...
#ROBOMERGE-BOT: STARSHIP (Main -> Release-Engine-Test) (v826-16501804)
[CL 16512522 by danny couture in ue5-release-engine-test branch]
- This will make maintenance for multiple platforms a lot easier (i.e. just preflight)
- Will be easy to get callstack and debug since it will be compiled on the machine it is debugged on
- Easier to try out modifications on mimalloc itself
- Fix mimalloc compilation under Clang 10
- Fix mimalloc inconsistent usage of MI_ENCODE_FREELIST define
- Fix mimalloc inconsistent usage of _WIN32 define
- Implement MacOS and Unix -mimalloc command-line switch
- Some MacOS changes were contributed by Will.Damon
#rb Brandon.Schaefer, Will.Damon
#preflight 60b4ea613c6c4e000158233e
#rnx
[CL 16512512 by danny couture in ue5-main branch]
This version of mimalloc is very efficient at distributing threaded allocations in a way that maintains
locality which in turn improve the amount of memory that we're able to send back to the system
after heavily multithreaded workloads. This also improves performance as less page fault and cache misses
are expected coming from more densily packed allocations.
mimalloc v1 seemed to waste more memory because of its commit size being larger than TBB.
However, its allocation patterns was already way tigther than TBB but for it to become apparent, you had
to activate the "page_reset" and "reset_decommits" options, which came at a performance loss.
mimalloc v2 offers both better locality and by default will more agressively decommit memory with
only minor performance loss in some cases and performance gain in many.
Given the advantages of mimalloc v2 compared to Intel TBB, we should probably consider it
as our next default allocator for the editor.
- All tests performed on AMD TR 3970X with 256GB RAM
- Loading FramingCameraTest map on special project with -ddc=cold and waiting until every asset is built
- 699s @ 32GB for tbb malloc
- 655s @ 37GB for mimalloc v1
- 757s @ 12GB for mimalloc v1 + page_reset and reset_decommits
- 604s @ 15GB for mimalloc v2
- Loading P_World on Reverb -ddc=cold and waiting until every asset is built
- 2372s @ 71GB for tbb malloc
- 2587s @ 75GB for mimalloc v1
- 3212s @ 34GB for mimalloc v1 + page_reset and reset_decommits
- 2503s @ 37GB for mimalloc v2
- Loading P_Construct_WP on special project with -ddc=cold and waiting until every asset is built
- 6404s @ 56GB for tbb malloc
- 6640s @ 37GB for mimalloc v2
- Loading Apollo_Terrain on FortniteGame with -ddc=cold and waiting until every asset is built
- 751s @ 33GB for tbb malloc
- 744s @ 25GB for mimalloc v2
- Cooking FramingCameraTest map on special project with a warmed-up DDC
- 379s @ 34GB for tbb malloc
- 367s @ 29GB for mimalloc v2
#rb Brandon.Dawson, Yuriy.ODonnell, Stefan.Boberg
[CL 15859558 by danny couture in ue5-main branch]
#jira UE-89981
#rb link.exe
#ROBOMERGE-SOURCE: CL 11897896 in //UE4/Release-4.25/... via CL 11897921
#ROBOMERGE-BOT: RELEASE (Release-4.25Plus -> Main) (v656-11643781)
[CL 11897947 by stefan boberg in Main branch]
#rb none
#jira UE-89981
#ROBOMERGE-SOURCE: CL 11880311 in //UE4/Release-4.25/... via CL 11880318
#ROBOMERGE-BOT: RELEASE (Release-4.25Plus -> Main) (v656-11643781)
[CL 11880329 by stefan boberg in Main branch]
Performs better than mimalloc in cooker benchmarks, but we still default to TBB malloc until the behaviour has been explored in more depth
To opt in to mimalloc, pass -mimalloc on the command line
#rb none
[CL 11114787 by Stefan Boberg in Dev-Core branch]
