Linus Torvalds
635de956a7
The x86 MM changes in this cycle were:
...
- Implement concurrent TLB flushes, which overlaps the local TLB flush with the
remote TLB flush. In testing this improved sysbench performance measurably by
a couple of percentage points, especially if TLB-heavy security mitigations
are active.
- Further micro-optimizations to improve the performance of TLB flushes.
Signed-off-by: Ingo Molnar <mingo@kernel.org>
-----BEGIN PGP SIGNATURE-----
iQJFBAABCgAvFiEEBpT5eoXrXCwVQwEKEnMQ0APhK1gFAmCKbNcRHG1pbmdvQGtl
cm5lbC5vcmcACgkQEnMQ0APhK1hjYBAAsyNUa/gOu0g6/Cx8R86w9HtHHmm5vso/
6nJjWj2fd2qJ9JShlddxvXEMeXtPTYabVWQkiiriFMuofk6JeKnlHm1Jzl6keABX
OQFwjIFeNASPRcdXvuuYPOVWAJJdr2oL9QUr6OOK1ccQJTz/Cd0zA+VQ5YqcsCon
yaWbkxELwKXpgql+qt66eAZ6Q2Y1TKXyrTW7ZgxQi0yeeWqMaEOub0/oyS7Ax1Rg
qEJMwm1prb76NPzeqR/G3e4KTrDZfQ/B/KnSsz36GTJpl4eye6XqWDUgm1nAGNIc
5dbc4Vx7JtZsUOuC0AmzWb3hsDyzVcN/lQvijdZ2RsYR3gvuYGaBhKqExqV0XH6P
oqaWOKWCz+LqWbsgJmxCpqkt1LZl5+VUOcfJ97WkIS7DyIPtSHTzQXbBMZqKLeat
mn5UcKYB2Gi7wsUPv6VC2ChKbDqN0VT8G86XbYylGo4BE46KoZKPUNY/QWKLUPd6
0UKcVeNM2HFyf1C73p/tO/z7hzu3qLuMMnsphP6/c2pKLpdgawEXgbnVKNId1B/c
NrzyhTvVaMt+Um28bBRhHONIlzPJwWcnZbdY7NqMnu+LBKQ68cL/h4FOIV/RDLNb
GJLgfAr8fIw/zIpqYuFHiiMNo9wWqVtZko1MvXhGceXUL69QuzTra2XR/6aDxkPf
6gQVesetTvo=
=3Cyp
-----END PGP SIGNATURE-----
Merge tag 'x86-mm-2021-04-29' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
Pull x86 tlb updates from Ingo Molnar:
"The x86 MM changes in this cycle were:
- Implement concurrent TLB flushes, which overlaps the local TLB
flush with the remote TLB flush.
In testing this improved sysbench performance measurably by a
couple of percentage points, especially if TLB-heavy security
mitigations are active.
- Further micro-optimizations to improve the performance of TLB
flushes"
* tag 'x86-mm-2021-04-29' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
smp: Micro-optimize smp_call_function_many_cond()
smp: Inline on_each_cpu_cond() and on_each_cpu()
x86/mm/tlb: Remove unnecessary uses of the inline keyword
cpumask: Mark functions as pure
x86/mm/tlb: Do not make is_lazy dirty for no reason
x86/mm/tlb: Privatize cpu_tlbstate
x86/mm/tlb: Flush remote and local TLBs concurrently
x86/mm/tlb: Open-code on_each_cpu_cond_mask() for tlb_is_not_lazy()
x86/mm/tlb: Unify flush_tlb_func_local() and flush_tlb_func_remote()
smp: Run functions concurrently in smp_call_function_many_cond()
2021-04-29 11:41:43 -07:00
..
2021-04-26 16:32:11 -07:00
2021-03-25 09:28:32 -07:00
2021-03-01 11:45:04 +01:00
2021-02-16 12:09:52 +01:00
2021-03-24 14:01:58 +01:00
2021-02-09 12:26:40 +01:00
2021-02-01 11:29:11 +05:30
2021-02-16 14:47:46 -08:00
2021-04-26 12:11:52 -07:00
2020-12-01 18:49:32 +01:00
2021-04-06 15:33:32 -05:00
2021-03-08 11:59:17 +01:00
2021-02-02 00:16:57 +01:00
2021-04-07 08:36:38 +01:00
2020-12-15 16:18:23 -08:00
2021-04-26 12:30:36 -07:00
2020-12-09 19:26:02 -06:00
2021-04-28 15:59:13 -07:00
2020-12-07 18:22:35 -08:00
2021-04-06 21:04:36 -07:00
2021-04-23 09:29:49 +02:00
2021-04-16 20:30:54 +02:00
2021-03-15 18:42:01 +01:00
2021-04-10 21:18:24 +02:00
2021-04-10 21:16:54 +02:00
2021-01-13 15:08:41 +00:00
2021-03-17 12:13:19 +05:30
2020-11-05 14:56:50 +01:00
2021-04-28 15:59:13 -07:00
2021-03-21 21:29:26 +01:00
2021-01-28 21:24:40 -08:00
2021-04-23 13:18:35 +01:00
2021-01-09 13:51:36 -08:00
2021-01-05 22:22:07 -06:00
2021-01-23 14:57:21 +01:00
2021-04-29 11:06:13 -07:00
2021-03-29 22:49:54 -05:00
2021-04-06 10:22:02 +05:30
2021-04-28 15:56:51 -07:00
2021-02-08 13:23:42 +02:00
2021-03-31 15:57:48 -04:00
2021-03-08 11:33:28 +01:00
2021-04-22 11:19:49 +02:00
2020-11-20 09:34:14 +00:00
2021-04-26 17:04:27 +02:00
2021-01-14 17:31:05 -05:00
2021-03-22 08:55:28 +05:30
2021-01-20 12:31:43 +00:00
2021-04-09 14:54:23 -07:00
2021-04-14 16:30:30 +03:00
2021-03-08 15:16:30 -08:00
2020-12-04 13:30:59 +01:00
2021-03-08 10:21:11 -05:00
2021-04-12 09:19:58 -06:00
2020-12-15 22:46:16 -08:00
2021-02-26 09:41:04 -08:00
2021-02-08 08:33:16 -07:00
2020-12-01 14:53:39 -07:00
2021-03-04 17:36:59 -05:00
2021-04-28 14:39:37 -07:00
2021-02-23 09:54:51 -07:00
2020-11-19 08:55:44 -05:00
2021-03-17 16:34:11 +01:00
2020-11-13 15:45:54 +01:00
2020-11-06 08:08:37 -08:00
2021-02-12 17:37:23 -08:00
2021-01-27 18:18:15 -08:00
2021-04-27 10:16:46 -07:00
2021-02-16 15:23:23 -08:00
2021-01-12 17:24:30 -08:00
2020-12-29 15:36:49 -08:00
2021-01-14 19:29:58 -08:00
2020-12-02 09:46:55 -07:00
2021-01-24 14:27:17 +01:00
2020-11-20 14:45:33 +11:00
2021-02-26 09:41:03 -08:00
2021-04-08 16:04:20 -07:00
2021-04-04 13:34:46 -04:00
2020-12-15 12:13:40 -08:00
2021-02-17 14:07:48 +01:00
2021-04-07 11:05:44 -07:00
2021-02-22 09:45:23 -08:00
2021-03-22 23:06:48 +01:00
2020-12-15 12:13:45 -08:00
2021-04-23 09:03:16 +02:00
2021-02-14 18:15:15 +00:00
2021-04-08 16:04:20 -07:00
2021-04-08 16:04:20 -07:00
2021-02-16 12:01:32 +09:00
2021-03-11 14:40:50 +09:00
2021-01-22 11:08:56 +01:00
2020-12-03 11:20:52 +01:00
2021-01-21 14:06:00 -07:00
2021-01-08 11:02:18 -08:00
2020-11-19 11:25:42 +01:00
2021-03-08 10:21:11 -05:00
2021-02-11 18:31:48 +01:00
2021-02-04 17:00:32 +01:00
2021-03-10 09:16:09 +01:00
2021-02-04 19:25:47 +01:00
2021-04-26 12:30:36 -07:00
2021-04-07 19:26:44 +02:00
2021-04-29 11:41:43 -07:00
2021-03-22 15:23:32 -04:00
2021-01-22 14:58:01 +11:00
2021-01-16 15:12:06 -05:00
2021-04-16 17:06:34 +02:00
2020-12-11 14:10:44 +01:00
2021-03-09 15:40:16 +09:00
2021-03-22 12:32:31 -04:00
2021-03-23 14:58:10 +01:00
2021-04-22 08:20:15 +02:00
2021-01-07 15:21:27 +01:00
2021-01-08 15:57:29 -05:00
2020-12-15 10:57:29 +01:00
2021-01-18 14:26:51 +01:00
2021-04-08 12:21:13 +02:00
2021-02-25 18:28:24 +05:30
2020-11-25 12:03:48 +00:00
2021-02-24 09:54:24 -08:00
2021-02-26 13:59:32 -08:00
2021-01-13 22:00:37 +05:30
2021-02-04 14:42:00 +01:00
2020-12-22 19:50:40 +01:00
2020-12-14 11:51:46 +01:00
2021-01-20 18:52:12 +01:00
2021-03-19 07:44:28 +01:00
2021-01-24 18:19:46 -07:00
2021-01-06 08:40:56 -05:00
2021-01-06 08:38:29 -05:00
2020-12-08 18:21:16 +01:00
2021-03-22 03:57:39 +01:00
2021-02-17 14:12:43 +01:00
2021-04-07 14:53:04 -07:00
2020-11-15 09:49:10 -05:00
2021-02-16 09:59:41 +01:00
2021-02-08 12:28:07 +01:00
2021-01-30 11:47:12 -05:00
2021-03-15 11:09:38 +09:00
2021-01-27 15:20:02 -08:00
2021-03-16 16:55:05 +01:00
2021-03-12 15:10:03 +01:00
2021-01-04 11:42:26 -05:00
2020-12-10 12:42:59 -06:00
2021-04-12 15:04:23 +02:00
2021-02-11 16:19:20 +01:00
2021-01-16 18:14:53 +00:00
2020-11-16 16:31:41 +01:00
2021-02-26 09:41:04 -08:00
2021-04-08 19:12:20 +02:00
2021-04-27 13:08:12 -07:00
2021-04-23 10:14:32 +01:00
2021-04-23 10:14:32 +01:00
2020-12-17 11:18:00 -08:00
2021-03-16 16:49:31 +01:00
2021-02-07 14:51:11 -08:00
2021-02-09 12:43:42 -05:00
2021-02-24 10:13:55 -08:00
2021-04-08 10:24:36 -06:00
2020-11-16 08:08:54 -08:00
2021-02-26 09:40:59 -08:00
2021-03-17 16:34:08 +01:00
2021-02-23 19:26:43 +01:00
2021-03-11 20:47:09 +00:00
2021-03-11 20:47:09 +00:00
2021-01-26 14:24:26 +01:00
2021-02-24 13:38:32 -08:00
2021-02-11 19:56:15 +01:00
2021-03-30 19:37:20 +02:00
2020-11-16 15:20:01 +01:00
2021-02-24 13:38:32 -08:00
2021-03-25 09:22:55 -07:00
2021-02-24 13:38:35 -08:00
2021-04-28 17:22:10 -07:00
2021-02-23 11:29:52 -08:00
2020-11-16 08:14:30 -07:00
2020-12-11 12:58:52 +01:00
2021-02-11 13:24:44 -08:00
2021-03-10 15:20:24 -08:00
2021-02-23 13:39:45 -08:00
2021-02-16 13:14:06 -08:00
2020-11-11 16:41:31 -08:00
2021-04-08 16:04:20 -07:00
2021-02-18 23:17:57 -08:00
2020-12-02 22:10:35 -08:00
2021-04-08 19:09:02 +02:00
2021-02-04 14:42:00 +01:00
2021-03-17 16:34:07 +01:00
2021-04-11 19:30:41 -06:00
2020-11-24 14:42:09 +01:00
2021-02-12 15:27:17 +01:00
2021-04-08 20:18:38 +09:00
2020-11-23 14:16:55 +00:00
2021-02-21 10:29:20 -08:00
2020-12-15 22:46:15 -08:00
2021-02-12 15:27:17 +01:00
2021-04-26 15:03:23 -07:00
2021-01-27 12:27:36 +01:00
2021-02-23 11:29:52 -08:00
2020-11-24 16:47:48 +01:00
2021-04-26 10:25:03 -07:00
2021-03-22 04:23:14 +01:00
2021-04-22 15:55:22 +01:00
2021-01-22 11:08:56 +01:00
2021-01-26 07:42:27 +01:00
2020-12-09 09:39:37 -05:00
2020-12-17 13:30:45 -05:00
2021-04-08 14:05:19 +02:00
2021-02-08 12:24:04 +01:00
2021-02-24 13:38:31 -08:00
2021-04-26 10:25:03 -07:00
2021-01-07 16:17:31 +01:00
2021-03-11 14:40:50 +09:00
2021-03-06 12:40:21 +01:00
2021-03-08 14:27:43 -08:00
2021-03-08 14:27:43 -08:00
2020-12-29 15:36:49 -08:00
2020-12-15 16:19:31 +01:00
2021-02-17 14:12:42 +01:00
2020-11-09 18:12:39 +01:00
2021-03-08 12:06:29 -07:00
2020-11-23 18:09:29 +00:00
2021-01-21 16:16:10 +00:00
2021-02-22 10:22:54 -08:00
2021-02-26 09:41:02 -08:00
2021-02-26 09:41:05 -08:00
2021-02-26 09:40:59 -08:00
2021-03-08 11:43:35 +01:00
2021-01-29 15:39:48 -05:00
2021-02-26 09:41:03 -08:00
2021-01-22 15:09:42 +01:00
2021-01-12 21:13:01 +01:00
2020-11-15 09:49:15 -05:00
2021-02-22 13:16:53 -05:00
2021-02-19 11:54:08 +01:00
2021-02-19 11:54:08 +01:00
2021-02-19 11:35:28 +01:00
2021-04-13 09:16:12 -06:00
2021-01-14 17:18:25 +01:00
2021-04-08 16:04:22 -07:00
2021-01-04 13:35:14 -08:00
2021-01-14 09:52:54 +09:00
2021-01-14 11:20:17 +01:00
2021-01-14 11:20:17 +01:00
2021-04-28 12:37:53 -07:00
2020-12-15 22:46:16 -08:00
2020-12-03 12:56:03 -08:00
2021-03-22 15:23:32 -04:00
2021-03-22 15:23:32 -04:00
2021-04-12 14:20:19 -07:00
2020-12-15 22:46:15 -08:00
2021-04-12 10:36:00 -06:00
2021-01-19 12:02:20 -08:00
2021-01-19 11:47:31 -08:00
2021-02-09 09:30:16 +01:00
2021-03-25 09:22:55 -07:00
2021-03-13 11:27:31 -08:00
2021-02-26 09:41:00 -08:00
2021-02-26 09:41:00 -08:00
2021-02-26 09:41:00 -08:00
2021-04-09 18:48:22 +05:30
2021-02-24 13:38:35 -08:00
2021-04-04 18:29:37 -04:00
2021-02-24 13:38:33 -08:00
2021-03-13 11:27:30 -08:00
2021-04-28 12:00:13 -07:00
2020-12-15 12:13:41 -08:00
2020-12-19 11:18:37 -08:00
2021-03-25 09:22:55 -07:00
2021-02-26 09:41:00 -08:00
2021-02-24 10:25:37 -08:00
2021-04-08 16:04:20 -07:00
2020-12-22 12:55:08 -08:00
2020-11-25 15:45:11 +01:00
2021-02-27 08:07:12 -08:00
2021-04-09 14:54:23 -07:00
2021-01-30 01:22:31 +01:00
2021-03-29 15:56:48 +02:00
2021-01-04 11:42:21 -05:00
2021-04-08 22:18:36 -07:00
2021-02-23 20:32:11 -07:00
2021-02-11 13:24:44 -08:00
2021-03-17 14:31:17 -07:00
2021-01-25 22:06:11 +01:00
2021-04-23 10:14:32 +01:00
2021-02-04 18:05:59 -08:00
2020-12-09 09:39:38 -05:00
2021-03-22 15:01:45 -04:00
2021-02-26 09:17:24 -08:00
2020-11-30 10:52:22 -05:00
2020-12-02 14:05:52 -05:00
2021-03-22 10:19:00 -04:00
2020-11-22 10:48:22 -08:00
2021-04-06 08:34:39 +02:00
2021-04-02 16:26:33 +02:00
2020-11-27 16:10:06 +01:00
2021-01-26 11:12:00 -06:00
2021-02-12 19:23:57 -06:00
2021-02-11 08:33:41 +01:00
2021-02-17 13:17:49 -08:00
2021-04-21 10:24:41 -05:00
2021-04-26 08:51:23 -07:00
2021-04-01 14:07:41 -07:00
2021-02-24 13:38:29 -08:00
2020-12-15 12:13:38 -08:00
2020-12-22 12:55:08 -08:00
2021-02-26 09:41:01 -08:00
2021-04-27 13:08:12 -07:00
2021-02-26 09:40:59 -08:00
2021-03-10 12:46:04 +00:00
2021-02-03 19:05:50 +01:00
2020-12-01 14:53:40 -07:00
2021-03-10 09:34:06 +01:00
2020-12-10 14:55:49 -06:00
2021-02-23 14:11:13 -06:00
2021-02-23 14:12:01 -06:00
2021-04-08 16:04:20 -07:00
2021-04-19 20:03:29 +02:00
2020-11-09 18:12:34 +01:00
2021-03-10 10:56:46 +00:00
2021-02-16 15:23:23 -08:00
2021-04-02 17:02:31 +02:00
2021-02-24 14:52:41 +01:00
2021-01-22 17:08:28 +01:00
2021-03-16 10:14:11 +05:30
2021-04-08 19:14:46 +02:00
2020-11-23 18:34:55 +01:00
2021-04-07 19:18:23 +02:00
2021-01-27 17:44:18 -08:00
2020-12-15 12:13:46 -08:00
2021-01-24 14:27:17 +01:00
2021-01-24 14:27:20 +01:00
2021-04-28 15:43:58 -07:00
2021-03-17 16:34:08 +01:00
2020-12-15 22:46:15 -08:00
2021-04-05 13:18:22 +02:00
2020-12-04 08:44:24 +00:00
2021-03-06 12:40:22 +01:00
2021-03-06 12:40:22 +01:00
2021-02-04 05:27:20 -05:00
2020-12-01 12:01:03 -08:00
2020-11-23 13:43:07 -08:00
2020-11-18 10:51:17 -08:00
2021-02-26 09:41:03 -08:00
2020-11-20 14:45:33 +11:00
2020-12-17 14:19:01 +01:00
2021-04-12 14:49:31 +02:00
2020-11-03 11:16:04 +01:00
2021-04-08 14:05:19 +02:00
2021-02-17 14:07:44 +01:00
2020-12-15 22:46:15 -08:00
2021-03-15 13:54:54 -07:00
2021-03-08 14:17:35 -08:00
2020-11-02 17:09:59 -08:00
2021-04-28 12:00:13 -07:00
2021-03-24 17:16:15 -07:00
2021-03-22 08:23:48 -07:00
2020-12-03 11:20:52 +01:00
2021-03-31 13:53:38 +01:00
2020-11-26 22:05:42 +11:00
2020-12-15 22:46:18 -08:00
2020-12-10 13:14:37 -06:00
2021-01-25 17:32:10 +01:00
2021-03-16 22:13:11 +01:00
2020-12-11 12:47:17 +01:00
2020-12-15 22:46:18 -08:00
2021-02-26 09:41:01 -08:00
2020-11-24 10:11:52 -06:00
2021-01-16 23:19:26 +01:00
2021-03-29 15:57:03 +02:00
2020-12-15 15:57:25 -08:00
2021-02-04 05:27:42 -05:00
2021-03-22 02:45:52 +01:00
2020-11-30 02:13:02 +01:00
2021-03-18 22:39:30 -04:00
2020-11-02 14:42:57 +01:00
2021-04-28 13:33:57 -07:00
2021-03-30 16:35:16 +01:00
2020-12-01 11:23:34 +00:00
2020-12-16 11:30:10 -08:00
2021-03-22 15:23:32 -04:00
2020-12-07 18:25:02 -05:00
2020-11-06 10:05:18 -08:00
2021-03-10 09:51:45 +01:00
2020-11-13 15:28:12 +01:00
2021-04-22 12:04:26 +02:00
2021-03-10 09:34:10 +01:00
2020-12-15 12:13:43 -08:00
2020-12-15 12:13:39 -08:00
2020-11-23 10:31:06 -06:00
2021-04-28 13:33:57 -07:00
2020-12-10 16:17:15 +01:00
2020-12-29 15:36:49 -08:00
2021-03-16 15:22:18 -07:00
2021-04-07 01:29:06 +02:00
2021-02-26 09:41:02 -08:00
2021-03-08 14:18:46 -08:00
2021-02-26 09:41:02 -08:00
2021-03-06 12:59:10 +01:00
2020-11-23 09:15:15 -07:00
2021-01-18 21:39:28 +01:00
2020-12-10 10:45:36 +01:00
2021-01-04 13:53:38 -08:00
2021-01-04 13:53:38 -08:00
2021-02-26 09:41:04 -08:00
2021-03-10 15:52:31 +01:00
2021-04-19 16:03:15 +02:00
2021-03-11 16:04:39 +01:00
2021-04-28 12:37:53 -07:00
2021-02-17 14:25:50 -08:00
2021-03-13 11:27:30 -08:00
2021-02-26 09:41:04 -08:00
2021-01-15 13:23:36 +00:00
2021-01-07 00:06:39 +01:00
2021-03-02 17:25:46 -07:00
2021-02-20 10:13:32 -05:00
2020-12-02 15:07:56 +01:00
2021-03-17 15:51:17 +01:00
2021-01-12 14:26:31 +01:00
2021-04-11 19:30:25 -06:00
2021-01-22 18:20:52 -08:00
2021-02-02 14:50:15 +01:00
2021-03-01 15:25:24 -08:00
2021-01-19 22:31:10 +01:00
2021-03-16 22:13:10 +01:00
2021-03-18 18:25:31 +03:00
2020-12-14 16:40:27 -08:00
2021-04-16 21:03:50 +02:00
2020-12-16 00:07:17 -08:00
2021-01-06 16:24:59 -08:00
2021-03-22 23:06:48 +01:00
2021-01-27 17:26:42 +01:00
2021-01-06 17:17:22 -08:00
2021-04-14 16:30:30 +03:00
2021-03-04 09:51:50 -05:00
2020-11-10 20:39:40 -05:00
2020-12-07 18:25:02 -05:00
2021-02-02 17:02:05 -05:00
2020-12-16 12:33:35 -08:00
2021-02-09 12:27:29 -05:00
2021-04-10 10:36:34 +02:00
2021-03-10 09:34:06 +01:00
2021-04-15 10:32:17 +02:00
2021-02-13 17:17:53 +01:00
2021-03-10 09:51:45 +01:00
2020-11-09 18:39:36 +01:00
2021-04-26 22:55:12 +01:00
2021-02-15 18:50:01 +01:00
2021-03-17 21:30:15 +01:00
2021-04-09 16:00:00 +02:00
2021-04-29 11:06:13 -07:00
2021-03-19 22:23:19 +01:00
2021-02-25 14:26:00 -05:00
2021-01-21 16:16:10 +00:00
2021-04-06 11:55:11 -06:00
2021-03-22 15:02:14 +01:00
2021-04-06 16:17:57 -07:00
2021-02-23 07:52:58 -05:00
2021-03-14 04:37:35 -04:00
2021-03-08 14:18:46 -08:00
2021-02-09 12:15:07 +01:00
2021-02-26 09:41:00 -08:00
2021-01-26 19:18:50 +01:00
2021-01-07 16:17:31 +01:00
2020-12-02 20:20:05 +01:00
2021-01-21 14:06:00 -07:00
2020-11-15 09:49:09 -05:00
2021-01-13 22:25:07 +01:00
2021-03-08 11:33:39 +01:00
2021-01-19 10:20:07 -05:00
2021-03-19 12:13:10 +01:00
2021-03-30 13:42:33 -04:00
2021-01-24 14:27:17 +01:00
2021-01-13 22:25:03 +01:00
2021-02-26 09:41:01 -08:00
2021-02-26 09:41:01 -08:00
2021-02-08 22:58:55 +01:00