Skip to content

Commit

Permalink
tracing, perf: Adjust code layout in get_recursion_context()
Browse files Browse the repository at this point in the history
In an XDP redirect applications using tracepoint xdp:xdp_redirect to
diagnose TX overrun, I noticed perf_swevent_get_recursion_context()
was consuming 2% CPU. This was reduced to 1.85% with this simple
change.

Looking at the annotated asm code, it was clear that the unlikely case
in_nmi() test was chosen (by the compiler) as the most likely
event/branch.  This small adjustment makes the compiler (GCC version
7.1.1 20170622 (Red Hat 7.1.1-3)) put in_nmi() as an unlikely branch.

Signed-off-by: Jesper Dangaard Brouer <brouer@redhat.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Cc: Arnaldo Carvalho de Melo <acme@kernel.org>
Cc: Jiri Olsa <jolsa@kernel.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Link: http://lkml.kernel.org/r/150342256382.16595.986861478681783732.stgit@firesoul
Signed-off-by: Ingo Molnar <mingo@kernel.org>
  • Loading branch information
Jesper Dangaard Brouer authored and Ingo Molnar committed Aug 25, 2017
1 parent 1d95311 commit d061841
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion kernel/events/internal.h
Original file line number Diff line number Diff line change
Expand Up @@ -208,7 +208,7 @@ static inline int get_recursion_context(int *recursion)
{
int rctx;

if (in_nmi())
if (unlikely(in_nmi()))
rctx = 3;
else if (in_irq())
rctx = 2;
Expand Down

0 comments on commit d061841

Please sign in to comment.