Anton Blanchard e35735b9a5
powerpc: Speed up clear_page by unrolling it ...
Unroll clear_page 8 times. A simple microbenchmark which
allocates and frees a zeroed page:
for (i = 0; i < iterations; i++) {
unsigned long p = __get_free_page(GFP_KERNEL | __GFP_ZERO);
free_page(p);
}
improves 20% on POWER8.
This assumes cacheline sizes won't grow beyond 512 bytes or
page sizes wont drop below 1kB, which is unlikely, but we could
add a runtime check during early init if it makes people nervous.
Michael found that some versions of gcc produce quite bad code
(all multiplies), so we give gcc a hand by using shifts and adds.
Signed-off-by: Anton Blanchard <anton@samba.org >
Signed-off-by: Michael Ellerman <mpe@ellerman.id.au >
2014-10-02 16:04:21 +10:00
2014-03-19 22:24:08 -04:00
2014-07-28 15:22:21 +02:00
2014-04-18 14:20:41 +02:00
2014-04-18 14:20:41 +02:00
2014-04-18 14:20:41 +02:00
2012-10-09 09:47:26 +01:00
2013-08-14 14:57:40 +10:00
2014-09-25 23:14:43 +10:00
2014-07-28 15:23:17 +02:00
2013-08-14 14:56:44 +10:00
2013-10-11 16:48:39 +11:00
2014-01-28 14:45:43 +11:00
2014-06-24 14:05:32 +10:00
2014-03-24 10:16:04 +11:00
2014-04-23 10:05:16 +10:00
2014-06-11 17:03:28 +10:00
2014-08-13 15:13:43 +10:00
2014-05-28 13:35:35 +10:00
2013-01-27 19:23:27 +01:00
2013-01-10 15:09:06 +11:00
2014-05-23 08:28:02 +09:00
2014-05-20 10:54:06 +10:00
2013-08-14 11:38:34 +02:00
2014-05-30 14:26:25 +02:00
2014-09-30 17:15:20 +10:00
2013-04-18 13:03:53 +10:00
2014-06-11 17:04:33 +10:00
2014-09-30 17:15:18 +10:00
2014-05-20 10:55:59 +10:00
2014-04-09 12:53:28 +10:00
2014-01-09 10:14:57 +01:00
2014-04-23 10:05:16 +10:00
2014-08-05 16:33:48 +10:00
2014-04-07 16:36:06 -07:00
2013-05-14 15:10:02 +10:00
2014-01-23 16:36:54 -08:00
2014-06-25 18:49:40 -05:00
2012-11-15 13:00:58 +11:00
2012-11-25 07:19:39 -06:00
2012-10-05 23:38:38 +02:00
2014-01-10 17:19:27 -06:00
2013-08-14 11:38:34 +02:00
2014-04-23 10:05:20 +10:00
2014-08-05 16:33:48 +10:00
2014-02-17 11:19:35 +11:00
2014-07-28 15:22:19 +02:00
2013-10-11 16:48:53 +11:00
2014-05-20 10:54:06 +10:00
2014-08-05 16:33:48 +10:00
2014-09-25 23:14:43 +10:00
2013-06-12 12:37:26 +01:00
2012-11-15 13:00:58 +11:00
2013-01-03 15:57:04 -08:00
2013-12-05 16:08:21 +11:00
2014-02-11 16:07:37 +11:00
2014-09-25 23:14:43 +10:00
2014-07-28 14:11:23 +10:00
2014-07-11 16:05:58 +10:00
2014-08-08 15:57:26 -07:00
2014-09-25 23:14:43 +10:00
2012-07-24 15:27:29 +08:00
2014-04-23 10:05:33 +10:00
2014-08-07 11:35:30 -07:00
2013-10-17 14:45:05 +02:00
2014-08-05 09:58:11 +02:00
2014-05-30 14:26:22 +02:00
2014-07-31 10:23:46 +02:00
2014-03-19 19:57:15 -05:00
2014-07-28 16:35:53 +02:00
2014-07-28 19:29:15 +02:00
2014-01-09 10:14:57 +01:00
2014-07-30 11:39:52 +02:00
2014-04-23 10:05:20 +10:00
2013-12-09 11:40:25 +11:00
2014-08-13 18:20:38 +10:00
2014-03-07 15:52:10 +11:00
2012-10-09 09:47:26 +01:00
2014-07-28 14:10:23 +10:00
2014-07-28 15:23:13 +02:00
2014-09-25 23:14:44 +10:00
2014-07-28 14:10:23 +10:00
2014-04-23 10:05:34 +10:00
2013-06-03 10:22:35 -07:00
2012-09-14 10:15:35 +02:00
2014-07-02 17:32:41 -05:00
2014-01-12 18:59:36 +01:00
2012-08-24 20:26:04 +10:00
2013-07-01 18:38:41 -05:00
2013-08-07 18:38:04 -05:00
2013-06-26 12:10:55 +02:00
2012-10-09 09:47:26 +01:00
2014-09-30 17:15:17 +10:00
2014-07-28 14:10:25 +10:00
2014-08-05 16:33:52 +10:00
2014-10-02 16:04:21 +10:00
2014-08-08 15:57:27 -07:00
2013-04-18 13:03:50 +10:00
2013-08-14 11:50:25 +10:00
2014-05-27 16:23:58 -06:00
2013-08-07 18:38:03 -05:00
2014-07-28 14:30:47 +10:00
2013-12-10 11:25:05 +11:00
2013-12-10 11:25:05 +11:00
2013-04-30 16:00:04 +10:00
2014-09-25 23:14:43 +10:00
2012-09-17 16:31:51 +10:00
2013-06-21 16:01:53 +10:00
2014-08-13 18:20:39 +10:00
2014-06-04 16:53:55 -07:00
2013-11-21 09:19:16 +11:00
2013-01-10 15:08:37 +11:00
2014-06-26 13:19:42 +02:00
2014-08-07 11:35:30 -07:00
2014-04-28 17:34:32 +10:00
2013-06-20 16:55:09 +10:00
2014-07-17 12:32:47 +02:00
2014-09-25 23:14:43 +10:00
2014-01-15 13:46:44 +11:00
2013-10-17 14:49:37 +02:00
2014-06-25 18:49:39 -05:00
2014-08-13 18:20:41 +10:00
2013-12-09 11:40:30 +11:00
2014-09-09 19:02:45 +10:00
2012-11-15 13:00:58 +11:00
2012-11-15 13:00:58 +11:00
2014-06-11 16:35:38 +10:00
2014-07-29 19:26:20 -05:00
2013-08-07 18:38:04 -05:00
2014-08-13 15:13:47 +10:00
2014-09-25 23:14:43 +10:00
2014-04-07 10:33:12 +10:00
2013-11-06 14:13:49 +11:00
2014-06-10 18:54:22 -07:00
2013-11-26 12:12:28 +01:00
2013-10-11 17:26:49 +11:00
2013-06-01 08:29:23 +10:00
2014-05-28 13:35:34 +10:00
2012-11-19 14:31:35 +01:00
2012-09-17 16:31:51 +10:00
2014-08-13 15:13:26 +10:00
2012-10-09 09:47:26 +01:00
2013-11-09 00:16:24 -05:00
2014-09-25 23:14:51 +10:00
2014-04-30 15:26:18 +10:00
2014-06-24 12:43:15 +10:00
2012-09-12 14:57:09 -05:00
2014-06-11 17:03:41 +10:00
2013-02-03 18:16:11 -05:00
2014-09-09 19:02:47 +10:00
2012-10-09 09:47:26 +01:00
2014-01-15 13:59:11 +11:00
2014-07-28 15:21:50 +02:00
2013-11-22 16:56:48 -06:00
2013-06-21 16:01:53 +10:00
2014-03-29 15:44:05 +01:00
2014-06-10 18:54:22 -07:00
2014-07-11 16:06:08 +10:00
2014-09-25 23:14:43 +10:00
2012-10-09 09:47:26 +01:00
2013-05-28 09:41:09 +02:00
2012-11-15 13:00:58 +11:00
2012-11-15 13:00:58 +11:00
2012-11-15 13:00:58 +11:00
2014-09-25 23:14:43 +10:00
2013-12-30 14:02:29 +11:00
2014-09-09 19:02:47 +10:00
2013-11-20 16:31:01 +01:00
2014-02-17 11:19:37 +11:00
2014-01-15 13:46:44 +11:00
2014-09-30 14:59:13 +10:00
2014-09-25 23:14:50 +10:00
2013-10-30 16:02:28 +11:00
Anton Blanchard
e35735b9a5