Jeremy Fitzhardinge fa28ba21ce x86: defer cr3 reload when doing pud_clear()
PAE mode requires that we reload cr3 in order to guarantee that
changes to the pgd will be noticed by the processor.  This means that
in principle pud_clear needs to reload cr3 every time.  However,
because reloading cr3 implies a tlb flush, we want to avoid it where
possible.

pud_clear() is only used in a couple of places:
 - in free_pmd_range(), when pulling down a range of process address space, and
 - huge_pmd_unshare()

In both cases, the calling code will do a a tlb flush anyway, so
there's no need to do it within pud_clear().

In free_pmd_range(), the pud_clear is immediately followed by
pmd_free_tlb(); we can hook that to make the mmu_gather do an
unconditional full flush to make sure cr3 gets reloaded.

In huge_pmd_unshare, it is followed by flush_tlb_range, which always
results in a full cr3-reload tlb flush.

Signed-off-by: Jeremy Fitzhardinge <jeremy@xensource.com>
Cc: Andi Kleen <ak@suse.de>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: H. Peter Anvin <hpa@zytor.com>
Cc: William Irwin <wli@holomorphy.com>
Signed-off-by: Ingo Molnar <mingo@elte.hu>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
2008-01-30 13:34:11 +01:00
..
2008-01-30 13:30:35 +01:00
2008-01-30 13:30:35 +01:00
2008-01-30 13:30:35 +01:00
2008-01-30 13:30:35 +01:00
2008-01-30 13:30:35 +01:00
2007-10-23 22:37:23 +02:00
2008-01-30 13:34:07 +01:00
2008-01-30 13:31:24 +01:00
2007-10-17 20:17:13 +02:00
2008-01-30 13:31:19 +01:00
2008-01-30 13:30:28 +01:00
2008-01-30 13:34:10 +01:00
2007-10-17 20:17:15 +02:00
2008-01-30 13:34:09 +01:00
2008-01-30 13:33:11 +01:00
2007-10-17 20:17:08 +02:00
2007-10-17 20:17:17 +02:00
2008-01-30 13:31:14 +01:00
2008-01-30 13:31:51 +01:00
2007-10-23 22:37:23 +02:00
2007-10-22 21:20:01 +02:00
2007-10-16 11:26:02 +02:00
2008-01-30 13:30:20 +01:00
2008-01-30 13:33:32 +01:00
2007-10-17 20:17:19 +02:00
2008-01-30 13:34:05 +01:00
2008-01-30 13:33:16 +01:00
2007-10-17 20:17:08 +02:00
2007-10-17 20:17:21 +02:00
2007-10-17 20:24:56 +02:00
2008-01-30 13:30:20 +01:00
2008-01-30 13:33:09 +01:00
2008-01-30 13:33:35 +01:00
2008-01-30 13:31:23 +01:00
2008-01-30 13:31:55 +01:00
2008-01-30 13:33:14 +01:00
2008-01-30 13:33:14 +01:00
2008-01-30 13:30:46 +01:00
2008-01-30 13:30:28 +01:00
2008-01-30 13:34:06 +01:00
2008-01-30 13:34:09 +01:00
2007-10-17 20:26:11 +02:00
2007-10-30 00:22:22 +01:00
2008-01-30 13:30:33 +01:00
2008-01-30 13:30:16 +01:00
2008-01-30 13:31:26 +01:00
2008-01-30 13:31:27 +01:00
2007-10-17 20:16:47 +02:00
2008-01-30 13:31:31 +01:00
2008-01-30 13:33:00 +01:00
2008-01-30 13:31:26 +01:00
2008-01-30 13:31:55 +01:00
2007-10-17 20:26:15 +02:00
2008-01-30 13:31:43 +01:00
2008-01-30 13:30:35 +01:00
2008-01-30 13:30:36 +01:00
2007-10-23 22:37:24 +02:00
2008-01-30 13:33:18 +01:00
2008-01-30 13:32:40 +01:00
2008-01-30 13:30:31 +01:00
2008-01-30 13:34:10 +01:00
2008-01-30 13:34:06 +01:00
2008-01-30 13:34:06 +01:00
2008-01-30 13:30:31 +01:00
2008-01-30 13:30:38 +01:00
2008-01-30 13:31:25 +01:00
2008-01-30 13:32:53 +01:00
2008-01-30 13:33:42 +01:00
2008-01-30 13:34:09 +01:00
2007-10-17 20:17:08 +02:00
2007-10-17 20:17:08 +02:00
2008-01-30 13:33:00 +01:00
2007-10-17 20:17:08 +02:00
2008-01-30 13:33:00 +01:00
2007-10-17 08:42:47 -07:00
2007-10-23 22:37:24 +02:00
2008-01-30 13:30:50 +01:00
2008-01-30 13:31:21 +01:00
2008-01-30 13:33:00 +01:00
2007-10-23 22:37:24 +02:00
2007-10-23 22:37:24 +02:00
2008-01-30 13:31:12 +01:00
2007-10-17 20:26:18 +02:00
2008-01-30 13:30:35 +01:00
2008-01-30 13:33:24 +01:00
2007-10-17 20:32:07 +02:00
2008-01-30 13:31:42 +01:00
2007-10-17 20:16:36 +02:00
2007-10-17 20:32:38 +02:00
2008-01-30 13:30:42 +01:00
2008-01-30 13:32:39 +01:00