Max Kellermann
a847b17009
mm: constify highmem related functions for improved const-correctness
...
Lots of functions in mm/highmem.c do not write to the given pointers and
do not call functions that take non-const pointers and can therefore be
constified.
This includes functions like kunmap() which might be implemented in a way
that writes to the pointer (e.g. to update reference counters or mapping
fields), but currently are not.
kmap() on the other hand cannot be made const because it calls
set_page_address() which is non-const in some
architectures/configurations.
[akpm@linux-foundation.org: "fix" folio_page() build failure]
Link: https://lkml.kernel.org/r/20250901205021.3573313-13-max.kellermann@ionos.com
Signed-off-by: Max Kellermann <max.kellermann@ionos.com >
Reviewed-by: Lorenzo Stoakes <lorenzo.stoakes@oracle.com >
Acked-by: David Hildenbrand <david@redhat.com >
Acked-by: Vlastimil Babka <vbabka@suse.cz >
Acked-by: Mike Rapoport (Microsoft) <rppt@kernel.org >
Acked-by: Shakeel Butt <shakeel.butt@linux.dev >
Cc: Alexander Gordeev <agordeev@linux.ibm.com >
Cc: Al Viro <viro@zeniv.linux.org.uk >
Cc: Andreas Larsson <andreas@gaisler.com >
Cc: Andy Lutomirski <luto@kernel.org >
Cc: Axel Rasmussen <axelrasmussen@google.com >
Cc: Baolin Wang <baolin.wang@linux.alibaba.com >
Cc: Borislav Betkov <bp@alien8.de >
Cc: Christian Borntraeger <borntraeger@linux.ibm.com >
Cc: Christian Brauner <brauner@kernel.org >
Cc: Christian Zankel <chris@zankel.net >
Cc: David Rientjes <rientjes@google.com >
Cc: David S. Miller <davem@davemloft.net >
Cc: Gerald Schaefer <gerald.schaefer@linux.ibm.com >
Cc: Heiko Carstens <hca@linux.ibm.com >
Cc: Helge Deller <deller@gmx.de >
Cc: "H. Peter Anvin" <hpa@zytor.com >
Cc: Hugh Dickins <hughd@google.com >
Cc: Ingo Molnar <mingo@redhat.com >
Cc: James Bottomley <james.bottomley@HansenPartnership.com >
Cc: Jan Kara <jack@suse.cz >
Cc: Jocelyn Falempe <jfalempe@redhat.com >
Cc: Liam Howlett <liam.howlett@oracle.com >
Cc: Mark Brown <broonie@kernel.org >
Cc: Matthew Wilcox (Oracle) <willy@infradead.org >
Cc: Max Filippov <jcmvbkbc@gmail.com >
Cc: Michael Ellerman <mpe@ellerman.id.au >
Cc: Michal Hocko <mhocko@suse.com >
Cc: "Nysal Jan K.A" <nysal@linux.ibm.com >
Cc: Oscar Salvador <osalvador@suse.de >
Cc: Peter Zijlstra <peterz@infradead.org >
Cc: Russel King <linux@armlinux.org.uk >
Cc: Suren Baghdasaryan <surenb@google.com >
Cc: Sven Schnelle <svens@linux.ibm.com >
Cc: Thomas Gleinxer <tglx@linutronix.de >
Cc: Thomas Huth <thuth@redhat.com >
Cc: Vasily Gorbik <gor@linux.ibm.com >
Cc: Vishal Moola (Oracle) <vishal.moola@gmail.com >
Cc: Wei Xu <weixugc@google.com >
Cc: Yuanchu Xie <yuanchu@google.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2025-09-21 14:22:15 -07:00
Vishal Moola (Oracle)
e05d3a6014
mm: remove unmap_and_put_page()
...
There are no callers of unmap_and_put_page() left. Remove it.
Link: https://lkml.kernel.org/r/20250709194017.927978-6-vishal.moola@gmail.com
Signed-off-by: Vishal Moola (Oracle) <vishal.moola@gmail.com >
Acked-by: David Hildenbrand <david@redhat.com >
Cc: Jordan Rome <linux@jordanrome.com >
Cc: Matthew Wilcox (Oracle) <willy@infradead.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2025-07-19 18:59:51 -07:00
Matthew Wilcox (Oracle)
234dda7a49
mm: remove zero_user()
...
All users have now been converted to either memzero_page() or
folio_zero_range().
Link: https://lkml.kernel.org/r/20250612143443.2848197-6-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Reviewed-by: Alex Markuze <amarkuze@redhat.com >
Cc: Christoph Hellwig <hch@lst.de >
Cc: Ilya Dryomov <idryomov@gmail.com >
Cc: Ira Weiny <ira.weiny@intel.com >
Cc: Jens Axboe <axboe@kernel.dk >
Cc: Xiubo Li <xiubli@redhat.com >
Cc: Dan Carpenter <dan.carpenter@linaro.org >
Cc: Viacheslav Dubeyko <Slava.Dubeyko@ibm.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2025-07-09 22:42:09 -07:00
Linus Torvalds
d8441523f2
Merge tag 'f2fs-for-6.16-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/jaegeuk/f2fs
...
Pull f2fs updates from Jaegeuk Kim:
"In this round, Matthew converted most of page operations to using
folio. Beyond the work, we've applied some performance tunings such as
GC and linear lookup, in addition to enhancing fault injection and
sanity checks.
Enhancements:
- large number of folio conversions
- add a control to turn on/off the linear lookup for performance
- tune GC logics for zoned block device
- improve fault injection and sanity checks
Bug fixes:
- handle error cases of memory donation
- fix to correct check conditions in f2fs_cross_rename
- fix to skip f2fs_balance_fs() if checkpoint is disabled
- don't over-report free space or inodes in statvfs
- prevent the current section from being selected as a victim during GC
- fix to calculate first_zoned_segno correctly
- fix to avoid inconsistence between SIT and SSA for zoned block device
As usual, there are several debugging patches and clean-ups as well"
* tag 'f2fs-for-6.16-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/jaegeuk/f2fs: (195 commits)
f2fs: fix to correct check conditions in f2fs_cross_rename
f2fs: use d_inode(dentry) cleanup dentry->d_inode
f2fs: fix to skip f2fs_balance_fs() if checkpoint is disabled
f2fs: clean up to check bi_status w/ BLK_STS_OK
f2fs: introduce is_{meta,node}_folio
f2fs: add ckpt_valid_blocks to the section entry
f2fs: add a method for calculating the remaining blocks in the current segment in LFS mode.
f2fs: introduce FAULT_VMALLOC
f2fs: use vmalloc instead of kvmalloc in .init_{,de}compress_ctx
f2fs: add f2fs_bug_on() in f2fs_quota_read()
f2fs: add f2fs_bug_on() to detect potential bug
f2fs: remove unused sbi argument from checksum functions
f2fs: fix 32-bits hexademical number in fault injection doc
f2fs: don't over-report free space or inodes in statvfs
f2fs: return bool from __write_node_folio
f2fs: simplify return value handling in f2fs_fsync_node_pages
f2fs: always unlock the page in f2fs_write_single_data_page
f2fs: remove wbc->for_reclaim handling
f2fs: return bool from __f2fs_write_meta_folio
f2fs: fix to return correct error number in f2fs_sync_node_pages()
...
2025-05-30 08:40:25 -07:00
Matthew Wilcox (Oracle)
97dfbbd135
highmem: add folio_test_partial_kmap()
...
In commit c749d9b7ebhttps://lkml.kernel.org/r/20250514170607.3000994-2-willy@infradead.org
Fixes: 00cdf76012willy@infradead.org >
Cc: Al Viro <viro@zeniv.linux.org.uk >
Cc: Hugh Dickins <hughd@google.com >
Cc: <stable@vger.kernel.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2025-05-20 22:49:39 -07:00
Matthew Wilcox (Oracle)
1313057c36
highmem: Add memcpy_folio()
...
The folio equivalent of memcpy_page(). It should correctly and
efficiently manage large folios:
- If one, neither or both is highmem
- If (either or both) offset+len crosses a page boundary
- If the two offsets are congruent or not
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Reviewed-by: Chao Yu <chao@kernel.org >
Signed-off-by: Jaegeuk Kim <jaegeuk@kernel.org >
2025-04-28 15:26:33 +00:00
Zi Yan
c51a4f11e6
mm: use clear_user_(high)page() for arch with special user folio handling
...
Some architectures have special handling after clearing user folios:
architectures, which set cpu_dcache_is_aliasing() to true, require
flushing dcache; arc, which sets cpu_icache_is_aliasing() to true, changes
folio->flags to make icache coherent to dcache. So __GFP_ZERO using only
clear_page() is not enough to zero user folios and clear_user_(high)page()
must be used. Otherwise, user data will be corrupted.
Fix it by always clearing user folios with clear_user_(high)page() when
cpu_dcache_is_aliasing() is true or cpu_icache_is_aliasing() is true.
Rename alloc_zeroed() to user_alloc_needs_zeroing() and invert the logic
to clarify its intend.
Link: https://lkml.kernel.org/r/20241209182326.2955963-2-ziy@nvidia.com
Fixes: 5708d96da2ziy@nvidia.com >
Reported-by: Geert Uytterhoeven <geert+renesas@glider.be >
Closes: https://lore.kernel.org/linux-mm/CAMuHMdV1hRp_NtR5YnJo=HsfgKQeH91J537Gh4gKk3PFZhSkbA@mail.gmail.com/
Tested-by: Geert Uytterhoeven <geert+renesas@glider.be >
Acked-by: Vlastimil Babka <vbabka@suse.cz >
Cc: Alexander Potapenko <glider@google.com >
Cc: David Hildenbrand <david@redhat.com >
Cc: John Hubbard <jhubbard@nvidia.com >
Cc: Kees Cook <keescook@chromium.org >
Cc: Kefeng Wang <wangkefeng.wang@huawei.com >
Cc: Mathieu Desnoyers <mathieu.desnoyers@efficios.com >
Cc: Matthew Wilcox <willy@infradead.org >
Cc: Miaohe Lin <linmiaohe@huawei.com >
Cc: Ryan Roberts <ryan.roberts@arm.com >
Cc: Vineet Gupta <vgupta@kernel.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-12-18 19:04:43 -08:00
Zi Yan
5708d96da2
mm: avoid zeroing user movable page twice with init_on_alloc=1
...
Commit 6471384af2https://lkml.kernel.org/r/97DB52E1-C594-49B5-9736-89AC302FAB01@nvidia.com
Link: https://lkml.kernel.org/r/20241011150304.709590-1-ziy@nvidia.com
Signed-off-by: Zi Yan <ziy@nvidia.com >
Acked-by: Vlastimil Babka <vbabka@suse.cz >
Acked-by: David Hildenbrand <david@redhat.com >
Cc: Alexander Potapenko <glider@google.com >
Cc: "Huang, Ying" <ying.huang@intel.com >
Cc: John Hubbard <jhubbard@nvidia.com >
Cc: Kees Cook <keescook@chromium.org >
Cc: Kefeng Wang <wangkefeng.wang@huawei.com >
Cc: Matthew Wilcox <willy@infradead.org >
Cc: Miaohe Lin <linmiaohe@huawei.com >
Cc: Ryan Roberts <ryan.roberts@arm.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-11-06 20:11:13 -08:00
Kefeng Wang
6359c39c9d
mm: remove unused hugepage for vma_alloc_folio()
...
The hugepage parameter was deprecated since commit ddc1a5cbc0https://lkml.kernel.org/r/20241010061556.1846751-1-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang <wangkefeng.wang@huawei.com >
Acked-by: David Hildenbrand <david@redhat.com >
Reviewed-by: Zi Yan <ziy@nvidia.com >
Reviewed-by: Barry Song <baohua@kernel.org >
Cc: Hugh Dickins <hughd@google.com >
Cc: Matthew Wilcox <willy@infradead.org >
Cc: Ryan Roberts <ryan.roberts@arm.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-11-06 20:11:12 -08:00
Kefeng Wang
28bdacbcb3
mm: move memory_failure_queue() into copy_mc_[user]_highpage()
...
Patch series "mm: migrate: support poison recover from migrate folio", v5.
The folio migration is widely used in kernel, memory compaction, memory
hotplug, soft offline page, numa balance, memory demote/promotion, etc,
but once access a poisoned source folio when migrating, the kernel will
panic.
There is a mechanism in the kernel to recover from uncorrectable memory
errors, ARCH_HAS_COPY_MC(eg, Machine Check Safe Memory Copy on x86), which
is already used in NVDIMM or core-mm paths(eg, CoW, khugepaged, coredump,
ksm copy), see copy_mc_to_{user,kernel}, copy_mc_{user_}highpage callers.
This series of patches provide the recovery mechanism from folio copy for
the widely used folio migration. Please note, because folio migration is
no guarantee of success, so we could chose to make folio migration
tolerant of memory failures, adding folio_mc_copy() which is a #MC
versions of folio_copy(), once accessing a poisoned source folio, we could
return error and make the folio migration fail, and this could avoid the
similar panic shown below.
CPU: 1 PID: 88343 Comm: test_softofflin Kdump: loaded Not tainted 6.6.0
pc : copy_page+0x10/0xc0
lr : copy_highpage+0x38/0x50
...
Call trace:
copy_page+0x10/0xc0
folio_copy+0x78/0x90
migrate_folio_extra+0x54/0xa0
move_to_new_folio+0xd8/0x1f0
migrate_folio_move+0xb8/0x300
migrate_pages_batch+0x528/0x788
migrate_pages_sync+0x8c/0x258
migrate_pages+0x440/0x528
soft_offline_in_use_page+0x2ec/0x3c0
soft_offline_page+0x238/0x310
soft_offline_page_store+0x6c/0xc0
dev_attr_store+0x20/0x40
sysfs_kf_write+0x4c/0x68
kernfs_fop_write_iter+0x130/0x1c8
new_sync_write+0xa4/0x138
vfs_write+0x238/0x2d8
ksys_write+0x74/0x110
This patch (of 5):
There is a memory_failure_queue() call after copy_mc_[user]_highpage(),
see callers, eg, CoW/KSM page copy, it is used to mark the source page as
h/w poisoned and unmap it from other tasks, and the upcomming poison
recover from migrate folio will do the similar thing, so let's move the
memory_failure_queue() into the copy_mc_[user]_highpage() instead of
adding it into each user, this should also enhance the handling of
poisoned page in khugepaged.
Link: https://lkml.kernel.org/r/20240626085328.608006-1-wangkefeng.wang@huawei.com
Link: https://lkml.kernel.org/r/20240626085328.608006-2-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang <wangkefeng.wang@huawei.com >
Reviewed-by: Jane Chu <jane.chu@oracle.com >
Reviewed-by: Miaohe Lin <linmiaohe@huawei.com >
Cc: Alistair Popple <apopple@nvidia.com >
Cc: Benjamin LaHaise <bcrl@kvack.org >
Cc: David Hildenbrand <david@redhat.com >
Cc: Hugh Dickins <hughd@google.com >
Cc: Jérôme Glisse <jglisse@redhat.com >
Cc: Jiaqi Yan <jiaqiyan@google.com >
Cc: Lance Yang <ioworker0@gmail.com >
Cc: Matthew Wilcox (Oracle) <willy@infradead.org >
Cc: Muchun Song <muchun.song@linux.dev >
Cc: Naoya Horiguchi <nao.horiguchi@gmail.com >
Cc: Oscar Salvador <osalvador@suse.de >
Cc: Tony Luck <tony.luck@intel.com >
Cc: Vishal Moola (Oracle) <vishal.moola@gmail.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-07-06 11:53:19 -07:00
David Hildenbrand
90b8fab5cd
mm/highmem: make nr_free_highpages() return "unsigned long"
...
It looks rather weird that totalhigh_pages() returns an "unsigned long"
but nr_free_highpages() returns an "unsigned int".
Let's return an "unsigned long" from nr_free_highpages() to be consistent.
While at it, use a plain "0" instead of a "0UL" in the !CONFIG_HIGHMEM
totalhigh_pages() implementation, to make these look alike as well.
Link: https://lkml.kernel.org/r/20240607083711.62833-3-david@redhat.com
Signed-off-by: David Hildenbrand <david@redhat.com >
Reviewed-by: Wei Yang <richard.weiyang@gmail.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-07-03 19:30:06 -07:00
Matthew Wilcox (Oracle)
9af47276ed
highmem: add kernel-doc for memcpy_*_folio()
...
This was inadvertently skipped when adding the new functions.
Link: https://lkml.kernel.org/r/20240124181217.1761674-1-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2024-02-22 10:24:41 -08:00
Matthew Wilcox (Oracle)
6eaa266b54
mm: add folio_fill_tail() and use it in iomap
...
The iomap code was limited to PAGE_SIZE bytes; generalise it to cover
an arbitrary-sized folio, and move it to be a common helper.
[akpm@linux-foundation.org: fix folio_fill_tail(), per Andreas Gruenbacher]
Link: https://lkml.kernel.org/r/20231107212643.3490372-3-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Reviewed-by: Andreas Gruenbacher <agruenba@redhat.com >
Cc: Andreas Dilger <adilger.kernel@dilger.ca >
Cc: Darrick J. Wong <djwong@kernel.org >
Cc: Theodore Ts'o <tytso@mit.edu >
Cc: Andreas Gruenbacher <agruenba@redhat.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-12-10 16:51:36 -08:00
Matthew Wilcox (Oracle)
a4fc4a0c45
mm: add folio_zero_tail() and use it in ext4
...
Patch series "Add folio_zero_tail() and folio_fill_tail()".
I'm trying to make it easier for filesystems with tailpacking / stuffing /
inline data to use folios. The primary function here is
folio_fill_tail(). You give it a pointer to memory where the data
currently is, and it takes care of copying it into the folio at that
offset. That works for gfs2 & iomap. Then There's Ext4. Rather than gin
up some kind of specialist "Here's a two pointers to two blocks of memory"
routine, just let it do its current thing, and let it call
folio_zero_tail(), which is also called by folio_fill_tail().
Other filesystems can be converted later; these ones seemed like good
examples as they're already partly or completely converted to folios.
This patch (of 3):
Instead of unmapping the folio after copying the data to it, then mapping
it again to zero the tail, provide folio_zero_tail() to zero the tail of
an already-mapped folio.
[akpm@linux-foundation.org: fix kerneldoc argument ordering]
Link: https://lkml.kernel.org/r/20231107212643.3490372-1-willy@infradead.org
Link: https://lkml.kernel.org/r/20231107212643.3490372-2-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Reviewed-by: Andreas Gruenbacher <agruenba@redhat.com >
Cc: Darrick J. Wong <djwong@kernel.org >
Cc: Theodore Ts'o <tytso@mit.edu >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-12-10 16:51:36 -08:00
Su Hui
73424d00dc
highmem: fix a memory copy problem in memcpy_from_folio
...
Clang static checker complains that value stored to 'from' is never read.
And memcpy_from_folio() only copy the last chunk memory from folio to
destination. Use 'to += chunk' to replace 'from += chunk' to fix this
typo problem.
Link: https://lkml.kernel.org/r/20231130034017.1210429-1-suhui@nfschina.com
Fixes: b23d03ef7asuhui@nfschina.com >
Reviewed-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Cc: Ira Weiny <ira.weiny@intel.com >
Cc: Jiaqi Yan <jiaqiyan@google.com >
Cc: Nathan Chancellor <nathan@kernel.org >
Cc: Nick Desaulniers <ndesaulniers@google.com >
Cc: Peter Collingbourne <pcc@google.com >
Cc: Tom Rix <trix@redhat.com >
Cc: Tony Luck <tony.luck@intel.com >
Cc: <stable@vger.kernel.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-12-06 16:12:49 -08:00
Matthew Wilcox (Oracle)
3de6047f18
highmem: Add folio_release_kmap()
...
This is the folio equivalent of unmap_and_put_page(), which remains as
a wrapper for it.
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Signed-off-by: Jan Kara <jack@suse.cz >
Message-Id: <20230921200746.3303942-1-willy@infradead.org >
2023-10-25 20:19:00 +02:00
Matthew Wilcox (Oracle)
b23d03ef7a
highmem: add memcpy_to_folio() and memcpy_from_folio()
...
Patch series "More filesystem folio conversions for 6.6".
Remove the only spots in affs which actually use a struct page; there
are a few places where one is mentioned, but it's part of the interface.
The rest of this is removing the remaining calls to set_bh_page(),
and then removing the function before any new users show up.
This patch (of 7):
These are the folio equivalent of memcpy_to_page() and memcpy_from_page().
[agruenba@redhat.com: use correct chunk size in memcpy()]
Link: https://lkml.kernel.org/r/20230802144354.1023099-1-agruenba@redhat.com
Link: https://lkml.kernel.org/r/20230713035512.4139457-1-willy@infradead.org
Link: https://lkml.kernel.org/r/20230713035512.4139457-2-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Cc: David Sterba <dsterba@suse.com >
Cc: Jan Kara <jack@suse.com >
Cc: Konstantin Komarov <almaz.alexandrovich@paragon-software.com >
Cc: Pankaj Raghav <p.raghav@samsung.com >
Cc: "Theodore Ts'o" <tytso@mit.edu >
Cc: Alexander Viro <viro@zeniv.linux.org.uk >
Cc: Christian Brauner <brauner@kernel.org >
Cc: Nathan Chancellor <nathan@kernel.org >
Cc: Nick Desaulniers <ndesaulniers@google.com >
Cc: Tom Rix <trix@redhat.com >
Cc: Andreas Gruenbacher <agruenba@redhat.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-08-18 10:12:29 -07:00
Fabio M. De Francesco
d0e135408e
highmem: Rename put_and_unmap_page() to unmap_and_put_page()
...
With commit 849ad04cf5viro@zeniv.linux.org.uk >
Signed-off-by: Fabio M. De Francesco <fmdefrancesco@gmail.com >
Reviewed-by: Eric Biggers <ebiggers@google.com >
Message-Id: <20230602103307.5637-1-fmdefrancesco@gmail.com >
Signed-off-by: Christian Brauner <brauner@kernel.org >
2023-06-05 13:51:00 +02:00
Jiaqi Yan
6efc7afb5c
mm/hwpoison: introduce copy_mc_highpage
...
Similar to how copy_mc_user_highpage is implemented for copy_user_highpage
on #MC supported architecture, introduce the #MC handled version of
copy_highpage.
This helper has immediate usage when khugepaged wants to copy file-backed
memory pages and tolerate #MC.
Link: https://lkml.kernel.org/r/20230329151121.949896-3-jiaqiyan@google.com
Signed-off-by: Jiaqi Yan <jiaqiyan@google.com >
Reviewed-by: Yang Shi <shy828301@gmail.com >
Cc: David Stevens <stevensd@chromium.org >
Cc: Hugh Dickins <hughd@google.com >
Cc: Kefeng Wang <wangkefeng.wang@huawei.com >
Cc: Kirill A. Shutemov <kirill.shutemov@linux.intel.com >
Cc: "Kirill A. Shutemov" <kirill@shutemov.name >
Cc: Miaohe Lin <linmiaohe@huawei.com >
Cc: Naoya Horiguchi <naoya.horiguchi@nec.com >
Cc: Oscar Salvador <osalvador@suse.de >
Cc: Tong Tiangen <tongtiangen@huawei.com >
Cc: Tony Luck <tony.luck@intel.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-04-18 16:29:51 -07:00
Peter Collingbourne
16d91faf09
kasan: call clear_page with a match-all tag instead of changing page tag
...
Instead of changing the page's tag solely in order to obtain a pointer
with a match-all tag and then changing it back again, just convert the
pointer that we get from kmap_atomic() into one with a match-all tag
before passing it to clear_page().
On a certain microarchitecture, this has been observed to cause a
measurable improvement in microbenchmark performance, presumably as a
result of being able to avoid the atomic operations on the page tag.
Link: https://lkml.kernel.org/r/20230216195924.3287772-1-pcc@google.com
Signed-off-by: Peter Collingbourne <pcc@google.com >
Link: https://linux-review.googlesource.com/id/I0249822cc29097ca7a04ad48e8eb14871f80e711
Reviewed-by: Andrey Konovalov <andreyknvl@gmail.com >
Reviewed-by: Catalin Marinas <catalin.marinas@arm.com >
Cc: Andrey Ryabinin <ryabinin.a.a@gmail.com >
Cc: Evgenii Stepanov <eugenis@google.com >
Cc: Peter Collingbourne <pcc@google.com >
Cc: Vincenzo Frascino <vincenzo.frascino@arm.com >
Cc: Will Deacon <will@kernel.org >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-03-28 16:20:09 -07:00
Al Viro
849ad04cf5
new helper: put_and_unmap_page()
...
kunmap_local() + put_page(), as done by e.g. ext2 directory handling.
Signed-off-by: Al Viro <viro@zeniv.linux.org.uk >
2023-03-07 01:50:53 -05:00
Matthew Wilcox (Oracle)
c643e6ebed
mm: fix memcpy_from_file_folio() integer underflow
...
If we have a HIGHMEM system with a large folio, 'offset' may be larger
than PAGE_SIZE, and so min_t will cap at 'len' instead of the intended
end-of-page. That can overflow into the next page which is likely to be
unmapped and fault, but could theoretically copy the wrong data.
Link: https://lkml.kernel.org/r/Y919vmSrtAgsf6K3@casper.infradead.org
Fixes: 00cdf76012willy@infradead.org >
Cc: "Fabio M. De Francesco" <fmdefrancesco@gmail.com >
Cc: Ira Weiny <ira.weiny@intel.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-02-09 16:51:30 -08:00
Matthew Wilcox (Oracle)
00cdf76012
mm: add memcpy_from_file_folio()
...
This is the equivalent of memcpy_from_page(). It differs in that it takes
the position in a file instead of offset in a folio, it accepts the total
number of bytes to be copied (instead of the number of bytes to be copied
from this folio) and it returns how many bytes were copied from the folio,
rather than making the caller calculate that and then checking if the
caller got it right.
[akpm@linux-foundation.org: fix typo in comment]
Link: https://lkml.kernel.org/r/20230126201552.1681588-1-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Cc: "Fabio M. De Francesco" <fmdefrancesco@gmail.com >
Cc: Ira Weiny <ira.weiny@intel.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-02-02 22:33:34 -08:00
Matthew Wilcox (Oracle)
6bc56a4d85
mm: add vma_alloc_zeroed_movable_folio()
...
Replace alloc_zeroed_user_highpage_movable(). The main difference is
returning a folio containing a single page instead of returning the page,
but take the opportunity to rename the function to match other allocation
functions a little better and rewrite the documentation to place more
emphasis on the zeroing rather than the highmem aspect.
Link: https://lkml.kernel.org/r/20230116191813.2145215-2-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org >
Reviewed-by: Zi Yan <ziy@nvidia.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-02-02 22:33:18 -08:00
Fabio M. De Francesco
1f8549fce5
mm: fix spelling mistake in highmem.h
...
Substitute "higmem" with "highmem" in highmem.h.
Link: https://lkml.kernel.org/r/20230105121305.30714-1-fmdefrancesco@gmail.com
Signed-off-by: Fabio M. De Francesco <fmdefrancesco@gmail.com >
Suggested-by: "Matthew Wilcox (Oracle)" <willy@infradead.org >
Reviewed-by: Ira Weiny <ira.weiny@intel.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
2023-01-18 17:12:54 -08:00
Max Kellermann
Vishal Moola (Oracle)
Matthew Wilcox (Oracle)
Linus Torvalds
Zi Yan
Kefeng Wang
David Hildenbrand
Su Hui
Fabio M. De Francesco
Jiaqi Yan
Peter Collingbourne
Al Viro